Senior Data Engineer

Senior Data Engineer – Paris, France We are seeking a Senior Data Engineer to join an exciting project in the energy sector, based in Paris, France. This role offers an initial 3–6-month contract with the potential for extension. Key Responsibilities: Design and optimize data ingestion pipelines using AWS Glue, Lambda, and Step Functions. Enhance data processing workflows with PySpark, implementing best practices such as caching, partitioning, and schema inference. Develop and enforce robust data quality policies. Orchestrate data pipelines with GitHub Actions, leveraging multi-branch workflows, triggers, and conditions. Ensure the quality of the codebase with tools like Checkmarx and SonarQube. Deliver comprehensive technical documentation and conduct validation tests, including unit and integration tests. Essential Skills and Experience: At least 6 years of experience in data engineering. Proficiency in Python and PySpark. Hands-on experience with AWS services, including EC2, S3, Lambda, Step Functions, and CloudWatch. Expertise in Git workflows, particularly in multi-branch environments. Ability to develop new features, monitor data, and set up logging. Experience with data validation and creating scalable data engineering solutions. Nice-to-Have Skills: Knowledge of AWS SNS, Inspector, Secret Manager, and Athena. Familiarity with Git branch management in Databricks. Requirements: Fluency in French is mandatory. Availability to work onsite in Paris, with flexibility for remote works.

Location: Paris, FR

Posted Date: 1/20/2025