Big Data Developer - Hive/Spark

SALARY : Description : We are looking for an experienced Big Data Developer with a strong background in building scalable and efficient data pipelines. The ideal candidate should have hands-on experience with Hive, Spark, Hadoop, and MapReduce, and possess strong programming skills in Python, Java, or Scala Key Responsibilities : - Develop and maintain large-scale data processing pipelines using Hive, Spark, Hadoop, and MapReduce. - Collaborate with the data engineering team to design, implement, and optimize scalable data solutions. - Ensure data quality and integrity by implementing data validation and cleansing processes. - Utilize knowledge in Snowflake, Snowpark, and SnowSQL to handle large datasets and improve performance. - Work with both RDBMS and NoSQL databases to design and query data models. - Optimize and deploy data solutions on cloud platforms like AWS, Azure, or GCP. Required Skills : - Big Data Technologies : Hive, Spark, Hadoop, MapReduce. - Proficiency in at least one programming language: Python, Java, or Scala. - Strong understanding of data structures and programming basics. - Experience with Snowflake, Snowpark, and SnowSQL. - Good understanding of RDBMS and NoSQL database concepts. - Exposure to Cloud Platforms: AWS, Azure, GCP. Desired Skills : - Ability to write efficient and optimized code for processing large datasets. - Familiarity with CI/CD pipelines, version control systems, and testing frameworks. - Strong problem-solving skills and a desire to learn new Qualifications : - B.E/B.Tech in Computer Science, Information Technology, or a related field. (ref:hirist.tech)

Location: in, IN

Posted Date: 11/22/2024