Senior ETL Developer

Role : Senior ETL Developer Job description : - Interface with other technology teams to extract, transform, and load data from a wide variety of data sources using SQL and AWS big-data technologies. - Prepare High Level Design and ETL design - Creation and support of batch and real-time data pipelines built on AWS technologies including Glue, Redshift/Spectrum, Kinesis, EMR and Athena - Able to design AWS ETL workflows and ETL mapping. - Maintain large ETL workflows, Review and test ETL programs - Work closely with business end users to analyze, translate, develop, and troubleshoot ETL code. - Optimize ETL processes, SQL queries, and Azure Data Factory pipelines for improved performance and scalability. - Recognize areas for automation. - Design, develop, and deploy data pipelines using Azure Data Factory. - Configure and manage Azure Data Factory activities, datasets, and linked services. - Collect and Analyze in-depth, various campaign level data by applying various analytical quantitative techniques and provide suggestions relevant to the KPIs - Conduct data collection, cleaning, processing and analysis - Assist & lead in building infrastructure requirement for data extraction, transformation and loading from a variety of sources - Conduct Exploratory Data Analysis to create an Analytical dataset - Assist in troubleshooting data related issues - Analyze large amounts of information to discover trends and patterns - Design data integration framework and processes - Work closely with Account Management Team to understand Campaign objectives, structure and metrics Skills Required : - Experience knowledge of SQL Server for managing large volume of data - Experience in Azure - Problem-solving, troubleshooting, automation, scripting, and familiarity with cloud platforms. - Experience of dashboards with the use of visualization. (ref:hirist.tech)

Location: in, IN

Posted Date: 11/24/2024