Senior Azure Data Engineer

Job Overview : We are seeking a highly skilled and experienced Senior Azure Data Engineer to join our team. The ideal candidate will have over 10 years of experience in designing, developing, and implementing data solutions on Azure. This role involves working closely with cross-functional teams to build scalable, efficient, and secure data platforms. You will play a key role in driving our data strategy, ensuring data integrity, and optimizing data pipelines for performance. Key Responsibilities : - Data Platform Architecture : Design and architect cloud-based data solutions using Azure Data Services (Data Lake, Azure SQL, Cosmos DB, Synapse Analytics, etc. - Data Pipeline Development : Build and manage ETL/ELT pipelines using Azure Data Factory, Databricks, and/or Azure Synapse to ensure efficient data ingestion, transformation, and storage. - Data Integration : Integrate diverse data sources (structured, semi-structured, and unstructured) into Azure data environments. - Performance Tuning : Optimize database performance, including tuning queries, indexing strategies, and partitioning for big data solutions. - Data Security & Governance : Implement robust data security policies, ensure compliance with regulatory standards, and manage data governance best practices. - Monitoring & Troubleshooting : Proactively monitor data environments using Azure Monitor, Azure Log Analytics, and resolve any data pipeline failures or bottlenecks. - Collaboration : Work with data scientists, analysts, and business stakeholders to translate business requirements into technical specifications. - Automation & CI/CD : Develop CI/CD pipelines for data solutions using Azure DevOps, ensuring smooth deployment processes. - Mentoring & Leadership : Provide guidance and mentorship to junior data engineers, fostering a collaborative learning environment. Required Skills & Qualifications : - Education : Bachelor's or Master's degree in Computer Science, Engineering, Data Science, or a related field. - Experience : 10 years of experience in data engineering with at least 5 years in Azure data solutions. - Azure Expertise : Proficiency with Azure Data Lake, Azure Data Factory, Azure Databricks, Azure Synapse Analytics, Azure SQL Database, and Cosmos DB. - ETL/ELT Tools : Extensive experience with Azure Data Factory and other ETL tools (i.e., SSIS, Informatica). - Big Data Technologies : Experience working with big data technologies like Hadoop, Spark, Databricks. - Programming Languages : Expertise in SQL, Python, Scala, or other relevant languages. - Data Warehousing : Strong experience with data modeling and building data warehouses on Azure Synapse or SQL Data Warehouse. - DevOps for Data : Familiarity with CI/CD tools such as Azure DevOps for automating data workflows and deployments. - Security & Compliance : In-depth knowledge of data security, privacy regulations (GDPR, HIPAA), and Azure's security frameworks (Azure Active Directory, RBAC, encryption). - Tools : Experience with Power BI or other visualization tools is a plus. - Certifications : Microsoft Certified : Azure Data Engineer Associate or equivalent certifications preferred (ref:hirist.tech)

Location: in, IN

Posted Date: 11/24/2024