Data Engineer - ETL/SQL

Job Description : Key Responsibilities : - Cloud Data Engineering : Develop, deploy, and manage cloud-based data solutions on the Azure platform, focusing on data warehousing and ETL pipelines. - ETL Migration : Lead the migration of traditional ETL processes (using SSIS) from on-premise systems to the Azure cloud landscape, ensuring seamless data flow and integrity. - Database Development : Work with Azure SQL, Synapse, and Snowflake databases to design and optimize data models, queries, and storage solutions. - SQL Development : Utilize SQL Server and other SQL-based technologies to write efficient queries and optimize database performance. - Data Pipeline Design : Build and maintain scalable, high-performance data pipelines to process large datasets, ensuring accuracy and completeness of data for reporting and analytics. - Collaboration : Work closely with data scientists, analysts, and other stakeholders to understand data requirements and ensure data solutions align with business goals. - Performance Tuning : Optimize data queries and pipelines for improved performance and reduced latency in cloud environments. - Cloud Best Practices : Stay up-to-date with the latest Azure cloud technologies and best practices for cloud-based data engineering and Skills : - 3 years of experience in Data Engineering or Data Warehousing development and operations. - At least 2 years of experience working with cloud computing platforms, especially Azure. - Hands-on experience with Azure SQL, Azure Synapse, and Snowflake databases. - Strong experience with ETL processes, including migrating conventional SSIS ETL pipelines to the Azure cloud. - Proven proficiency in SQL development, with a strong preference for SQL Server. - Experience in designing and optimizing cloud-based data solutions for large-scale data processing and analytics. - Familiarity with cloud storage solutions, data lake architectures, and cloud-based data integration tools. Desired Skills : - Familiarity with Azure Data Factory, Azure Databricks, and other Azure-based data processing services. - Knowledge of NoSQL databases and experience with cloud-native data storage solutions. - Experience with DevOps or CI/CD pipelines for automating data operations and deployments. - Familiarity with data modeling and building data lakes in cloud environments. - Experience working in Agile development environments. Qualifications : - Bachelor's degree in Computer Science, Information Technology, or a related field. - Azure certifications (e. , Azure Data Engineer) are a plus (ref:hirist.tech)

Location: pune, IN

Posted Date: 11/22/2024