Azure Data Engineer - Databricks/Data Factory

Salary : 10 - 21LPA Job Title : Azure Data Engineer Experience : 5 years as Azure Data Engineer Location : Hyderabad Working Hours : 12.00pm to 9.00pm Job Description : Key Responsibilities : - Ensure that Health and Safety is the number one goal by following policies, processes, and always acting in a safe manner. - Design data storage systems that scale, perform, and are economical enough to satisfy the organization's requirements. - Develop and implement data integration processes, frequently using Azure Data Factory, to extract, transform, and load (ETL) data from various sources into Azure data warehouses or data lakes. - Use big data technologies like Apache Spark to handle and analyze enormous volumes of data. - Collaborate with data scientists to create data sets and engineer features for AI Initiatives - Implement and optimize data retrieval for Power BI solutions. What does it take to work for our company? - A master's degree in computer science, Statistics, Mathematics, or a related field is required. A bachelor's degree with significant relevant experience would suffice. - 5 years of data engineering experience leveraging technologies such as Azure Data Factory, Azure Synapse Analytics, Azure Stream Analytics, Azure Event Hubs, Azure Data Lake Storage, Azure Databricks - Experience with data pipelines and engineering infrastructure: You should have experience designing and implementing data pipelines and engineering infrastructure for machine learning systems. - Solid knowledge of data processing languages, including SQL, Python, Scala. - Experience with AI implementations and Power BI. - Experience with Microsoft Azure's data services: You should have hands-on experience with various data services offered by Microsoft Azure, such as Azure Machine Learning, Azure Databricks, and Azure Data Factory. - Familiarity with Azure Cognitive Services for integrating AI capabilities (like vision, language, and decision functionalities) directly into applications. - Ability to work with large datasets and experience with data processing tools like SQL, Pandas, and big data technologies such as Apache Spark. - Proficiency in Python, .NET C#, API development - Experience with SQL, NoSQL databases and Data Fabric architectures. - Strong communication skills to effectively collaborate with team members and stakeholders. - Strong problem-solving skills and ability to think algorithmically. - Ability to translate complex findings into a compelling narrative for non-technical stakeholders. - Certifications like Microsoft Certified: Azure Data Engineer Associate will be preferred. (ref:hirist.tech)

Location: hyderabad, IN

Posted Date: 11/23/2024