Data Engineer - Google Cloud Platform

Job Description : GCP Data Engineer (Java) Location : PAN India Experience : 3-15 years in data engineering or cloud data are looking for a skilled GCP Data Engineer with expertise in data pipeline development on Google Cloud Platform, including BigQuery and Dataflow. The ideal candidate will have solid experience in Java and SQL for data manipulation, along with a strong background in building and managing large-scale data processing workflows on GCP. Key Responsibilities : - Design, develop, and deploy data pipelines using GCP tools, especially BigQuery and Dataflow. - Implement ETL processes to collect, process, and transform data for analytics and business intelligence. - Utilize Java and SQL to build, maintain, and optimize data transformation and integration workflows. - Perform data modeling and schema design to ensure efficient data storage and retrieval in BigQuery. - Optimize data processing in Dataflow to improve performance and cost-effectiveness. - Collaborate with data scientists, analysts, and business stakeholders to understand data requirements and provide data solutions. - Monitor and troubleshoot pipeline performance, ensuring data integrity and compliance with governance policies. Required Skills and Qualifications : - Google Cloud Platform (GCP) : Proficiency with GCP services, specifically BigQuery and Dataflow. - Java : Strong programming skills in Java for data processing and integration. - SQL : Advanced SQL skills for querying, data transformation, and optimization in large datasets. - Data Integration : Hands-on experience with ETL/ELT processes and designing data pipelines for scalable data solutions. Additional Skills : - Familiarity with other GCP tools such as Cloud Storage and Pub/Sub for real-time data streaming. - Knowledge of data quality and governance best practices. - Exposure to data visualization tools (e.g., Data Studio, Looker). - Experience with CI/CD pipelines for data solutions, using tools like Cloud Build or Jenkins. - Understanding of data partitioning, indexing, and storage optimization in big data environments. Preferred Qualifications : - Google Cloud Professional Data Engineer certification. - Experience with Apache Beam or similar data processing frameworks. - Strong analytical and problem-solving skills, with attention to detail. - Effective communication skills to work with technical and non-technical stakeholders. (ref:hirist.tech)

Location: in, IN

Posted Date: 11/25/2024