Data Engineer

Data Engineer Industry: Defence & Security Rate: Flexible (DOE) - Outside IR35 Duration: 6 Months Extensions Location: Hybrid – 2 days per week in London Clearance: Active SC Clearance Required Start Date: 2 weeks notice max. The Opportunity: The UK’s 1 Digital Solutions Provider seeks an SC Cleared Data Engineer to support a key Defence & Security project with the Ministry of Defence. The Role: This is a chance to build something meaningful. You'll be responsible for designing and implementing a solid data ingestion, processing, and sharing strategy, working with modern technologies across cloud and on-prem environments. Taking ownership of data pipelines, you'll streamline workflows and work closely with key stakeholders to ensure secure and efficient data handling. Your skills in modern data tooling will help drive analytics and machine learning capabilities across the platform. Key Requirements: Security Clearance: Must hold active SC Clearance. Data Ingestion: Experience working with Kafka, SFTP, and APIs to manage secure data pipelines. Data Processing & Curation: Skilled in using Airflow and Spark to build scalable data workflows. Data Access & Tooling: Hands-on experience with Jupyter, Athena, Palantir, SageMaker, MLflow, and Starburst. Data Sharing: Proficiency in Kafka, Palantir, Python, and Tableau for secure data distribution. ETL & Transformation: Expertise in developing and optimising ETL pipelines for structured and unstructured data. Cloud & Security Best Practices: Strong understanding of governance frameworks and compliance requirements in high-security environments. For more information or to apply, please reach out to: Contact | 02077806706 LinkedIn | George Bates | LinkedIn Email | george.batesansonmccade.com Data Engineer

Location: The City, GB

Posted Date: 3/12/2025