Technical Lead - Data Engineering

Job Title : Lead Data Engineer We are seeking a highly skilled Lead Data Engineer with expertise in Big Data technologies to join our dynamic team. As a Lead Data Engineer, you will play a pivotal role in designing, building, and optimizing large-scale data pipelines and systems to drive business insights and innovation. Key Responsibilities : 1. Design, implement, and manage scalable data architectures using Hadoop ecosystems, Hive, Spark, and Scala. 2. Lead the development and optimization of data pipelines for real-time and batch processing of large datasets. 3. Work with Big Data tools and frameworks to manage and process vast amounts of structured and unstructured data. 4. Implement efficient data storage solutions using TimeScaleDB and other database technologies. 5. Collaborate with cross-functional teams to gather requirements, define technical strategies, and deliver robust data solutions. 6. Ensure data quality, security, and governance standards are maintained across the platform. Qualifications : 1. Proven experience in Scala and Spark for data processing and ETL development. 2. Strong understanding of Hadoop, Hive, and other Big Data tools. 3. Experience with TimeScaleDB or other time-series databases. 4. Ability to lead a team and drive complex projects from concept to completion. 5. Excellent problem-solving and communication skills. (ref:hirist.tech)

Location: bangalore, IN

Posted Date: 11/27/2024