Senior Data Engineer - Big Data Applications

Title : Senior Data Engineer Experience : 6 Years Notice Period : Immediate to 15 Days (Serving NP candidates) Work Location - Bangalore Mandatory skills : Big data applications, Spark, python, scala , AWS S3,Airflow,Data bricks, data platforms, Jenkins, CICD Pipelines Requirements : - 6 years of experience in developing scalable Big Data applications or solutions on distributed platforms. - 4 years of experience working with distributed technology tools, including Spark, Python, Scala - Working knowledge of Data warehousing, Data modelling, Governance and Data Architecture - Proficient in working on Amazon Web Services (AWS) mainly S3, Managed Airflow, EMR/ EC2, IAM etc. - Experience working in Agile and Scrum development process. - 3 years of experience in Amazon Web Services (AWS) mainly S3, Managed Airflow, EMR/ EC2, IAM etc. - Experience architecting data product in Streaming, Serverless and Microservices Architecture and platform. - 3 years of experience working with Data platforms, including EMR, Airflow, Databricks (Data Engineering & Delta - Experience with creating/ configuring Jenkins pipeline for smooth CI/CD process for Managed Spark jobs, build Docker images, etc. - Working knowledge of Reporting & Analytical tools such as Tableau, Quicksite etc. (ref:hirist.tech)

Location: bangalore, IN

Posted Date: 11/25/2024