Hadoop Developer - Scala/Spark

Profile : Hadoop Developer Work from office and Work from home Job description Role & responsibilities : - Minimum 2 Years Hands on experience in Hadoop Development, Scala, Spark. - knowledge in extract transform load (ETL) processes and data warehousing - Strong problem-solving and analytical skills - Excellent written and verbal communication skills - Ability to work well in a team and collaborate with others - Bachelor's degree in Computer Science or related field - Design, develop, test, deploy, and maintain large-scale big data processing pipelines using Hadoop ecosystem (HDFS, MapReduce) and Spark. - Collaborate with cross-functional teams to gather requirements and deliver high-quality solutions on time. - Develop expertise in working with various technologies such as Cloudera Manager, Python, Scala, Java, Kafka. - Troubleshoot complex issues related to big data processing workflows and provide timely resolutions. - Stay up-to-date with industry trends and best practices in big data analytics. - Meeting with the development team to assess the company s big data infrastructure. - Designing and coding hadoop applications to analyze data collections. - Creating data processing frameworks. - Extracting data and isolating data clusters. - Testing scripts and analyzing results. - Troubleshooting application bugs. - Maintaining the security of company data. - Creating data tracking programs. - Producing Hadoop development documentation. - Training staff on application use. Hadoop Developer Requirements : - Bachelor s degree in software engineering or computer science. - Previous experience as a hadoop developer or big data engineer. - Advanced knowledge of the hadoop ecosystem and its components. - In-depth knowledge of Hive, HBase, and Pig. - Familiarity with MapReduce and Pig Latin Scripts. - Knowledge of back-end programming languages including JavaScript, Node.js, and OOAD. - Familiarity with data loading tools including Squoop and Flume. - High-level analytical and problem-solving skills. - Good project management and communication skills. (ref:hirist.tech)

Location: in, IN

Posted Date: 11/28/2024