Hadoop Developer - Hive/HDFS

Role : Hadoop Developer Job Description : - Develop, implement, and maintain large-scale data processing applications using Hadoop and related Big Data technologies. - Design and develop complex data pipelines for ingestion, transformation, and processing of structured and unstructured data. - Work with tools in the Hadoop ecosystem such as HDFS, MapReduce, Pig, Hive, HBase, and YARN. - Build, monitor, and optimize Hadoop clusters, ensuring high performance and fault tolerance. - Develop and maintain ETL processes to extract data from various sources, transform it, and load it into Hadoop-based data storage solutions. - Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions that meet business needs. - Optimize jobs to improve the performance and scalability of data pipelines. - Perform troubleshooting and debugging of Hadoop applications, identifying issues and resolving them efficiently. - Ensure data quality and consistency across the data pipeline. (ref:hirist.tech)

Location: in, IN

Posted Date: 11/27/2024