QBrainX - Data Engineering Lead - Snowflake/Data Build Tool

Job title - Data Engineering Lead Exp - 6 to 8 years Job Location : Coimbatore / Hyderabad (Work from Office) Do you love building the infrastructure that fuels data-driven decision making? Are you passionate about wrangling raw data into a usable format? If so, then we want to hear from you We are searching for a Data Engineering Lead to join our growing team. In this role, you will play a key part in designing, developing, and maintaining our data pipelines. You will work closely with data scientists, analysts, and business stakeholders to ensure our data infrastructure meets the ever-evolving needs of the : - Design, develop, and maintain scalable data pipelines using technologies like Python and SQL. - Develop and implement data quality checks and monitoring processes to ensure data integrity. - Build and automate data ingestion processes from various sources (databases, APIs, etc.) to Snowflake. - Utilize cloud platforms (AWS, Azure, GCP) to build and manage data infrastructure. - Leverage Infrastructure as Code (IaC) tools like Terraform to provision and manage cloud resources. - Collaborate with data scientists and analysts to understand data requirements and translate them into technical solutions. - Version control code using Git and collaborate with the team through code reviews. - Document data pipelines and processes for future reference and knowledge sharing. Qualifications : - 6 years of experience in data engineering or a related field. - Proven experience in designing, developing, and deploying data pipelines. - Hands on experience with Snowflake, DataBricks, Python or Pyspark and SQL. - Should have experience working in Data Build Tool (DBT) with snowflake is required - Experience with data warehousing and data modeling concepts. - Experience working with cloud platforms (AWS, Azure, GCP) is a plus. - Working knowledge of Terraform and Infrastructure as Code (IaC) principles. - Experience with Git for version control. - Excellent communication and collaboration skills. - Ability to work independently and as part of a team. - Should have experience in leading the data engineering team. - Knowledge and Experience toward Architectural and design is added advantage. - Strong problem-solving and analytical skills. Bonus Points : - Experience with data orchestration tools (Airflow, Luigi, etc.). - Experience with data visualization tools (Tableau, Power BI, etc.) (ref:hirist.tech)

Location: in, IN

Posted Date: 11/23/2024