Senior Data Engineer

BettingJobs is currently recruiting for a Senior Data Engineer for a leading Sports Betting Business based in London.

As the Senior Data Engineer, you will be responsible for managing data storage, backup, and recovery mechanisms as well as developing and implementing data security and privacy.

The successful candidate will have excellent presentation, documentation, time management, and communication skills with the ability to work collaboratively and autonomously.

Responsibilities:

• Designing and implementing scalable data architectures and systems

• Developing and maintaining ETL (Extract, Transform, Load) pipelines.

• Managing data storage, backup, and recovery mechanisms

• Writing complex SQL queries to extract data for analysis.

• Developing and implementing data security and privacy

• Interfacing with clients, end users, and business stakeholders to provide transparency and receive guidance on projects, deliverables, and support.

Requirements:

• Experience (2+ year) working on the .Net Framework as a Software Engineer, particularly .NET 5+.

• Understanding of data modelling concepts and be able to design data models that are optimised for different user cases.

• Experience (2+ year) implementing data pipelines that run on Kafka or equivalent distributed event store and stream-processing platforms.

• Familiarity with SQL and experience (2+ year) working with and designing relational databases.

• Ability to debug and optimize failing or slow data pipelines and queries.

• Systems integration experience: networking, data migrations, API integration and design.

• Enthusiasm for clean systems, including documentation, logging, and reproducibility.

• Experience (2+ year) working with AWS S3, Athena, ECS, Cloud Formation, Lambdas & Cloudwatch.

• Excellent presentation, documentation, time management, and communication skills with the ability to work collaboratively and autonomously.

• Strong problem-solving skills with a pragmatic and analytical outlook.