LoveLocal - Lead Data Engineer - ETL/PySpark

Role Overview : As the Lead Data Engineer, you will play a pivotal role in shaping our data architecture and infrastructure. You will lead a team of talented data engineers to design, implement, and optimize data pipelines and systems that support our analytics and business intelligence initiatives. Your work will directly impact our ability to understand and serve our local communities better. Key Responsibilities : - Lead the design and implementation of scalable data pipelines. - Collaborate with data scientists, analysts, and other stakeholders to ensure data availability and quality. - Architect and manage data storage solutions (e.g., databases, data lakes) that meet the needs of the organization. - Ensure data governance, security, and compliance with industry standards. - Install/update disaster recovery procedures. - Mentor and guide junior data engineers, fostering a culture of learning and innovation. - Stay updated on industry trends and technologies to continuously improve our data practices. Required Qualifications : - Proficiency in Python and SQL. - Experience with data warehousing solutions (e.g., Snowflake, Google Big Query) and data orchestration tools (e.g., Apache Airflow, Databricks Workflows, Dagster). - Strong understanding of SQL and NoSQL databases such as MySQL and MongoDB - Experience with Apache Spark and Apache Kafka - Familiarity with cloud platforms (e.g., AWS, Google Cloud, Azure) and their data services. (ref:hirist.tech)

Location: bangalore, IN

Posted Date: 11/28/2024