Data Engineer

Job Overview:

We are looking for an experienced Senior Azure Data Engineer to join our growing data team. This is a fully remote position, and the successful candidate must hold DV clearance. You will be working for CapGemini subco centre, delivering solutions for their end clients. This role offers the opportunity to work with cutting-edge technologies in the cloud computing space, specifically with a strong focus on Microsoft Azure services. The ideal candidate will have deep expertise in building and optimizing data pipelines, architectures, and data sets, as well as experience in transforming data into meaningful insights for business decision-making.

Key Responsibilities:

• Design, build, and manage large-scale data processing systems using Azure data services (Azure Data Lake, Azure SQL Database, Azure Synapse, Azure Databricks).
• Develop and maintain ETL/ELT pipelines for the collection, transformation, and delivery of data.
• Optimize existing data architectures and workflows for performance, reliability, and scalability.
• Collaborate with data scientists, analysts, and stakeholders to understand data needs and develop solutions that meet business requirements.
• Implement and maintain data security and governance policies, ensuring compliance with relevant standards.
• Monitor, troubleshoot, and resolve data processing issues to ensure smooth and efficient operations.
• Leverage Azure tools like Data Factory, Logic Apps, and Functions to automate data workflows and improve operational efficiency.
• Collaborate on the design and implementation of data models and data lakes that are efficient and scalable.
• Document technical designs, processes, and workflows to enable team collaboration and knowledge sharing.

Required Skills & Qualifications:

• DV clearance is required.
• 5+ years of experience in data engineering or a similar role, with a significant focus on Azure data platforms.
• Proficient in Azure Data Services, including but not limited to:
• Azure Data Lake
• Azure SQL Database
• Azure Synapse Analytics
• Azure Databricks
• Azure Data Factory
• Azure Event Hubs/IoT Hub (a plus)
• Strong experience in ETL/ELT processes, data warehousing, and data pipeline orchestration.
• Deep understanding of data architecture principles, including data modeling, storage optimization, and performance tuning.
• Hands-on experience with programming and scripting languages such as Python, SQL, Spark, or Scala.
• Familiarity with DevOps practices for data (e.g., CI/CD for data pipelines) and tools such as Terraform or Azure DevOps.
• Experience in optimizing cloud-based data solutions, ensuring high availability and fault tolerance.
• Strong problem-solving skills and the ability to work independently in a fast-paced environment.
• Solid understanding of data security, governance, and compliance in cloud-based environments.
• Familiarity with AI/ML workflows and big data tools is a plus.

Preferred Qualifications:

• Azure certifications such as Azure Data Engineer Associate or Azure Solutions Architect.
• Familiarity with big data processing frameworks like Apache Hadoop or Apache Kafka.
• Experience working in Agile development environments and using project management tools like Jira.
• Prior experience with Azure-based data lakehouse architectures and data mesh concepts.

What We Offer:

• Fully remote working environment with flexible hours.
• 12-month contract role inside IR35.
• Day rates are flexible.
• Opportunities for continuous learning and professional growth through training and certifications.
• Access to cutting-edge technology in a dynamic and collaborative work culture.
• Comprehensive benefits package including healthcare, retirement plans, and paid time off.

How to Apply:

If you're passionate about data engineering, Azure technologies, and have DV clearance, we want to hear from you! Please submit your resume and a cover letter detailing your relevant experience.