Big Data Developer

We are seeking an experienced Big Data Developer to join our dynamic team. The ideal candidate will have a strong background in big data technologies, data engineering, and distributed systems. This role requires expertise in handling large-scale data processing systems, ensuring data reliability, and driving data-driven : - Design, develop, and implement scalable Big Data solutions using Hadoop, Spark, and other data processing frameworks. - Develop ETL pipelines to ingest, process, and transform large data sets efficiently. - Work with structured, semi-structured, and unstructured data to create data pipelines that enable actionable insights. - Build and maintain data workflows and automated solutions for data processing. - Collaborate with cross-functional teams to gather requirements and deliver data solutions. - Ensure data quality, consistency, and security throughout the data lifecycle. - Optimize performance of data pipelines, ensuring minimal latency and high throughput. - Troubleshoot and resolve data-related issues, ensuring data integrity and availability. - Document system designs, data flows, and key technical details. Requirements : - Expertise in Hadoop Ecosystem (HDFS, Hive, HBase, YARN, etc. ). - Proficiency in Apache Spark, Kafka, and Scala/Java/Python. - Strong understanding of SQL and data manipulation techniques. - Experience with cloud platforms like AWS, Azure, or GCP. - Familiarity with data streaming technologies such as Kafka or Flink. - Hands-on experience with data visualization tools and BI platforms is a plus. - Bachelor's/Master's degree in Computer Science, IT, or a related field. - 6-8 years of experience in Big Data development and data engineering. - Strong problem-solving skills with excellent analytical capabilities. - Ability to work independently and as part of a collaborative team environment. (ref:hirist.tech)

Location: in, IN

Posted Date: 4/19/2025