Big Data Developer - Hive/Hadoop

Position Name : Big Data developer Desired Skills and Experience : - AWS, EC2, HDFS, HQL, EMR, Sqoop - Strong Knowledge of Bigdata and Hadoop ecosystems like HDFS, Spark, MapReduce, Sqoop, Hive and AWS. - Experience in Loading and transforming large sets of structured, semi-structured and unstructured data from Relational Database Systems to HDFS and vice-versa using Sqoop tool. - Knowledge of designing and creating Hive external tables and creating Partitions and Bucketing techniques in Hive using Hive Query Language (HQL) - Knowledge of AWS Cloud computing in EC2, EMR, Lambda Functions, AWS Athena, AWS S3. - Experience of creating architecture on AWS, Deploying Hadoop clusters using AWS EC2. - Experience in varied business process including Production, Planning and Responsibilities : - Develop, test, and deploy big data applications and pipelines. - Work with Hadoop, Spark, Kafka, and related big data technologies. - Optimize data workflows for performance, scalability, and efficiency. - Collaborate with data analysts and data scientists to understand requirements. - Troubleshoot and resolve issues within the data processing : - Proven experience with big data technologies (e.g., Hadoop, Spark, Kafka). - Proficiency in programming languages like Java, Python, or Scala. - Strong understanding of distributed computing and data processing concepts. - Knowledge of ETL processes and data warehousing. - Bachelor's degree in Computer Science, Data Engineering, or related field. (ref:hirist.tech)

Location: chennai, IN

Posted Date: 11/23/2024