Principal Data Engineer

What We Are Looking For : As a Principal Data Engineer, you will take ownership of the ideation, architecture, design, and development of our enterprise data platform. You will play a key role in collaborating with cloud and security architects to ensure a seamless integration within our broader technology strategy. We are looking for someone with a passion for creating efficient, high-performance data systems that align with best practices and cutting-edge industry trends. Requirements : - 15 years of experience in data engineering with a strong background in software engineering and exposure to modern data landscapes. - Proven track record in architecting and building enterprise-scale data platforms in greenfield environments. - Expertise in developing end-to-end data platforms on Google Cloud Platform (GCP), leveraging tools such as BigQuery, Cloud Functions, Cloud Run, Dataform, Dataflow, Dataproc, and Pub/Sub. - Experience with microservices architectures, including Kubernetes, Docker, and Cloud Run for containerized environments. - Deep experience with batch and real-time streaming infrastructure and workloads, including tools like Apache Kafka, Spark, or equivalent technologies. - Strong knowledge in designing and implementing metadata management, including data catalogs, lineage tracking, data quality, and observability for large-scale workflows. - Expertise in data lakehouse architectures and hands-on experience with the GCP ecosystem. - Strong understanding of data modeling, architecture, and governance principles, with a focus on security and compliance. - Extensive experience in DataOps principles, including CI/CD, test automation, and observability tooling such as Grafana or Datadog. - Demonstrated experience in building Symantec layers for efficient data consumption and management. Nice to Have : - Experience with Data Mesh architecture to enable decentralized data ownership and self-service data platforms. - Experience in building scalable IoT architectures to handle massive real-time data streams from connected devices. - Proficiency in developing semantic layers that provide consistent and reusable data across different business domains. (ref:hirist.tech)

Location: bangalore, IN

Posted Date: 11/29/2024