Data Engineer - Python/SQL

Job Description : We are seeking a talented Data Engineer to join our dynamic team in Bangalore or Chennai. The ideal candidate will have a strong background in data engineering, particularly in Google Cloud Platform (GCP), and will be responsible for designing and implementing data solutions that enable data-driven decision-making across the organization. Key Responsibilities : - Data Pipeline Development: Design, develop, and maintain robust data pipelines using GCP services such as Dataflow, Dataproc, and BigQuery to ensure efficient data processing and transformation. - ETL Processes: Implement ETL processes to extract, transform, and load data from various sources into data warehouses, ensuring data integrity and quality. - Collaboration: Work closely with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions that meet business needs. - Performance Optimization: Monitor and optimize data workflows and queries for performance and efficiency, ensuring scalability and reliability of data systems. - Documentation: Create and maintain comprehensive documentation for data pipelines, processes, and data models to ensure clarity and facilitate knowledge sharing within the team. - Data Governance: Ensure compliance with data governance policies and best practices, including data security and privacy considerations. Key Skills : - Proficiency in Google Cloud Platform (GCP) services, specifically BigQuery, Dataflow, and Dataproc. - Strong programming skills in Python for data processing and automation tasks. - Solid experience in writing complex SQL queries for data manipulation and analysis. - Familiarity with data modeling and data warehousing concepts. - Understanding of ETL processes and tools, with experience in building and optimizing ETL workflows. - Excellent analytical and problem-solving skills, with a keen attention to detail. - Strong communication skills to collaborate effectively with cross-functional teams. Qualifications : - Bachelor's degree in Computer Science, Information Technology, or a related field. - 3 years of experience as a Data Engineer or in a similar role. Benefits : - Competitive salary and performance-based bonuses. - Opportunities for continuous learning and professional development. - A collaborative and innovative work environment. (ref:hirist.tech)

Location: chennai, IN

Posted Date: 11/24/2024