Senior Data Engineer - Hadoop

Summary of Responsibilities : - Manage Hadoop infrastructure and cluster performance. - Develop ETL and data pipelines within the Hadoop ecosystem. - Ensure data quality, governance, and security. - Collaborate with cross-functional teams for data processing and analytics. - Optimize Hadoop performance and resolve operational issues. - Automate workflows and leverage cloud-based big data solutions. - A Hadoop Data Engineer plays a key role in managing large-scale data storage and processing systems, ensuring that the Hadoop ecosystem operates efficiently and meets the organization's data needs. - 6 years of experience in information technology, Minimum of 3-5 years of experience in managing and administering Hadoop/Cloudera environments. - Cloudera CDP (Cloudera Data Platform), Cloudera Manager, and related tools. - Hadoop ecosystem components (HDFS, YARN, Hive, HBase, Spark, Impala, etc.). - Linux system administration with experience with scripting languages (Python, Bash, etc.) and configuration management tools (Ansible, Puppet, etc.) - Tools like Kerberos, Ranger, Sentry), Docker, Kubernetes, Jenkins - Cloudera Certified Administrator for Apache Hadoop (CCAH) or similar certification. - Cluster Management, Optimization, Best practice implementation, collaboration and support. (ref:hirist.tech)

Location: bangalore, IN

Posted Date: 11/21/2024