Lead Azure Data Engineer - Databricks/Data Factory

Job Summary : We are seeking a highly skilled and motivated individual to join our team as a Senior Azure Data Engineer. The ideal candidate will have a strong background in Azure data technologies, a proven track record of ability to design and implement scalable and efficient data solutions. Responsibilities : - Design, develop, and deploy data pipelines and ETL processes using Azure Data Factory, Azure Databricks, and other Azure data services. - Implement data integration solutions to ingest, process, and transform data from various sources such as databases, data lakes, APIs, and streaming data. - Collaborate with data scientists and analysts to provide them with clean, structured data for analysis and reporting. - Optimize and tune data pipelines for performance, scalability, and cost efficiency. - Monitor and troubleshoot data pipelines to ensure availability, reliability, and data quality. Requirements and skills : - Bachelor's degree in Computer Science, Engineering, or a related field - Proven experience as a Data Engineer with expertise in designing and implementing data solutions on the Azure platform. - In-depth knowledge of Azure data services such as Azure Data Factory, Azure Databricks, Pyspark, Azure Synapse Analytics, Azure SQL Database, Azure Cosmos DB, etc - Strong programming skills in languages such as SQL, Python, or Scala - Experience with big data technologies such as Hadoop, Spark, or Kafka is a plus - Familiarity with data warehousing concepts and methodologies - Excellent problem-solving and analytical skills with a strong attention to detail. - Effective communication and collaboration skills with the ability to work in a cross-functional team environment. (ref:hirist.tech)

Location: in, IN

Posted Date: 11/24/2024