Data Pipeline Engineer

Job Title : Data Pipeline Engineer Location : Bangalore Experience : 4-5 Years About the Role : Are you a skilled Data Pipeline Engineer looking to take your career to the next level? Join our dynamic team and work on cutting-edge data engineering solutions in a fast-paced environment You'll have the opportunity to design, implement, and optimize data pipelines that drive business insights and decision making. With a focus on scalability and performance, you'll collaborate closely with cross-functional teams to streamline data Responsibilities : - Design, develop, and maintain efficient and scalable data pipelines for real-time and batch data processing. - Utilize Python and SQL to handle complex data transformations and automate workflows. - Leverage AWS cloud services (S3, Lambda, RDS, etc.) for seamless data integration, storage, and processing. - Create, integrate, and manage REST APIs to enable smooth data flow between systems and applications. - Ensure data quality, performance tuning, and monitoring of the data pipeline infrastructure. - Collaborate with data scientists, analysts, and other engineers to deliver end-to-end data solutions. Skills and Qualifications : - Strong programming skills in Python for data manipulation and scripting. - Advanced knowledge of SQL for querying, transformation, and optimization. - Hands-on experience with AWS services for cloud-based data solutions. - Proficient in developing and integrating REST APIs. - Exposure to Docker and Kubernetes for containerization and orchestration is a plus. - Excellent problem-solving skills and the ability to work in an agile environment. (ref:hirist.tech)

Location: bangalore, IN

Posted Date: 11/22/2024