Lead Data Engineer

Lead Data Engineer | Permanent | London | Hybrid | Financial Services

I am partnered with a client of mine within the Financial Services Sector who are looking for an experienced Lead Data Engineer to manage their data infrastructure and lead their engineering team. This role requires expertise in designing, building, and maintaining scalable data pipelines on AWS to support business goals. Please see further details below:

Location: London, hybrid

Salary: Up to £98,000 plus bonus

Key Responsibilities:

• Guide and mentor data engineers, set goals, and enforce best practices in coding, reviews, and documentation. Work with cross-functional teams to align data solutions with business objectives.
• Design and manage scalable ETL pipelines and data storage solutions on AWS. Ensure data quality and implement a data mesh architecture for decentralized data ownership.
• Use AWS services (S3, Step Functions, RDS, Glue, Lambda) to optimize pipelines, manage security, control costs, and oversee data lakehouse environments with Dremio.
• Stay updated on AWS and data engineering technologies, recommend new tools, and lead initiatives for process automation and efficiency.

Essential Experience:

• Strong expertise with AWS data services, such as S3, Step Functions, RDS, Glue, Lambda and more.
• Extensive background in building large-scale ETL pipelines.
• Proficiency in SQL and Python.
• Experience with data mesh architecture for decentralized data governance.
• Deep understanding of data warehousing concepts

If you are interested in discussing the role, please apply directly and I will be in touch.