Wipro - Senior Databricks Engineer - Azure Data Services

Responsibilities : 1. Role : Senior Databricks Engineer 2. Skills and Experience : - Extensive expertise in Databricks and Azure Data Factory (ADF). - Good understanding of Azure Synapse Analytics, ADLS, Azure SQL Server, Azure Logic Apps, APIs, Unity Catalog, Delta Lake, T-SQL, and Python. - Knowledge of Power BI connectors. 3. Responsibilities : - Design, develop, and maintain robust data pipelines using Databricks and ADF. - Integrate Databricks with Azure SQL Server for seamless data flow and advanced analytics. - Implement ETL processes to extract, transform, and load data from various sources into Azure data stores. - Maintain dashboards and reports in Power BI, leveraging its connectors to Databricks. - Optimize and troubleshoot existing ETL workflows for performance, reliability, and cost. - Ensure data quality and implement data governance practices. 4. Desirable Skills : - Experience with Delta Lake for data management in Databricks. - Familiarity with data lake architectures and data warehousing concepts. - Knowledge of CI/CD pipelines and DevOps practices for data engineering. - Certification in Azure or related cloud technologies. Note : If shortlisted, you will be invited for initial rounds on 30th November'24 in Bengaluru (ref:hirist.tech)

Location: in, IN

Posted Date: 11/24/2024