ETL Developer - Python/SQL Server

Job Description : As an ETL Developer, you will be responsible for : - Architecting and implementing efficient and scalable ETL processes to extract, transform, and load data from various sources into our data warehouse. - Data Integration & Transformation: Building and maintaining data pipelines using SQL, Python (Pandas, SQLAlchemy), and potentially Azure Data Factory (ADF) and Spark. - Optimizing SQL queries and ETL processes for performance and efficiency, including SQL tuning and index management. - Ensuring data accuracy, consistency, and completeness through rigorous data validation and quality checks. - Identifying and resolving data-related issues, including debugging code, analyzing logs, and conducting root cause analysis (RCA). - Creating and maintaining databases for development, testing, and production environments. - Working closely with data analysts, data scientists, and other stakeholders to understand data requirements and deliver effective solutions. - Participating in agile development processes, including sprint planning, daily stand-ups, and code reviews. - Utilizing GitLab or GitHub for version control and collaborative development. - Providing on-call support to address production issues and ensure data pipeline stability. - Creating and maintaining comprehensive technical documentation for ETL processes and data models. - Translating complex data into actionable insights to support business goals. Required Qualifications : - Bachelor's degree in Computer Science, Information Technology, or a related field, or equivalent practical experience. - Minimum of 5 years of professional experience working with Microsoft SQL Server (MS SQL). - Minimum of 3 years of hands-on experience with Python, particularly using Pandas and SQLAlchemy libraries for data manipulation and database interaction. - Minimum of 3 years of experience providing on-call support and resolving production data issues. Key Skills : - Extensive experience writing complex SQL queries for data retrieval, transformation, and analysis across multiple disparate databases. - Proficiency in stored procedures, functions, triggers, and other database objects. - Strong understanding of relational database concepts and data modeling. - Advanced SQL tuning and performance optimization skills. - Solid understanding of Python programming principles and best practices. - Extensive experience using Pandas for data manipulation, cleaning, and analysis of large datasets (2M rows). - Proficiency in using SQLAlchemy for database interaction and object-relational mapping (ORM). - Experience with Python debugging, log analysis, and root cause analysis. - Strong understanding of ETL principles and best practices. - Experience with SSIS or similar ETL tools. - Familiarity with Azure Data Factory(ADF) is a plus. - Familiarity with Spark and Scala concepts is a plus. - Ability to analyze code, logs, and system metrics to identify and resolve data issues. - Experience conducting root cause analysis (RCA) to prevent recurring issues. - Experience working in an agile development environment (e.g., Scrum, Kanban). - Ability to collaborate effectively with cross-functional teams. - Proficiency in using Git for version control (GitLab or GitHub). - Understanding of branching strategies and code merge processes. - Ability to create, configure, and maintain databases for development, testing, and production. - Understanding of database backup and recovery procedures. - Ability to interpret complex data and translate it into actionable insights for business stakeholders. - Familiarity with cloud platforms, particularly Microsoft Azure. - Understanding of big data technologies like Spark and Scala. (ref:hirist.tech)

Location: delhi, IN

Posted Date: 4/17/2025