Aexonic - Senior Big Data Engineer - Google Cloud Platform

Key Responsibilities : - Design, develop, and optimize Big Data pipelines and workflows using Hadoop, Hive, PySpark, and Google BigQuery. - Architect data solutions to facilitate smooth data migration and processing between on-premises systems and Google Cloud Platform (GCP). - Create and manage Unix Shell Scripts for process automation and data handling tasks. - Perform in-depth data analysis and work comfortably with large datasets to derive actionable insights. - Collaborate effectively with cross-functional teams to understand data requirements and translate them into scalable data solutions. - Ensure data quality, integrity, and security across all stages of the data lifecycle. - Stay updated with the latest industry trends and emerging technologies to continuously improve data solutions. Mandatory Qualifications : - Minimum of 8 years of industry experience working with Big Data technologies. - Proficiency in Hadoop, Hive, and PySpark for data processing. - Strong experience with Unix Shell Scripting. - Expertise in SQL and extracting data from multiple sources. - Demonstrated experience in data analysis, specifically querying and analyzing large datasets on Hadoop HDFS using Hive and Spark. - Proven experience in architecting Big Data pipelines and data solutions. - Proficiency in Google BigQuery and migrating data pipelines to GCP. - Exceptional communication skills for clear requirement gathering and collaboration. Preferred Qualifications : - Google Cloud Platform (GCP) certification. - Professional experience with cloud hosting platforms, with a preference for GCP. (ref:hirist.tech)

Location: in, IN

Posted Date: 11/21/2024