Data Engineer

Data Engineer (Developer) with Java/Scala or Python/Pyspark

Project description

We have an opportunity with one of the biggest insurance clients. Here you will join their long-term digital transformation programme as part of the Data & DevOps Team.

Responsibilities

• Lead technical discussions, relating to the analytics footprint, with the other areas of the business in all areas of data and analytics.
• Develop a highly scalable and secure data products & pipelines using Spark and Scala.

Skills

Must have

• Either experience in Scala development experience is a must with additional experience in Java needed or Experience in Python/Pyspark
• Knowledge of Continuous Integration and Continuous Deployment (CI/CD).
• Ability to work with senior stakeholders across multiple verticals.
• Lead the development and maintenance of data pipelines, ETL processes, and data integration workflows, ensuring the seamless flow of data across various systems and platforms.
• Maintain comprehensive documentation of data processes, system configurations, and best practices. Advocate for best practice within team and share the methodologies used with wider teams.
• Mentor junior engineers providing technical support and guidance.
• Own, write, and manage documentation of the analytics architecture.

Nice to have

• Must have proven history of multiple analytics projects on any cloud platform(for ex: Azure, AWS or GCP).
• Hands on experience in advanced Data model/Data mart design.
• Extensive experience with insurance industry.
• Excellent business analysis and reporting skills, working within a regulatory change function.
• Previous experience working in highly regulated Financial Services institutions is highly desirable.

Languages

English: C1 Advanced