Data Engineer - Java/Python

Job Title : Data Engineer. Location : Chennai. Job Type : Full-time. Experience : 2-4 years. Job Description : - Deliver features and stories as an individual contributor within given timeframes and expected quality. - Collaborate with cross-functional teams to design and implement data engineering solutions. - Develop and maintain large-scale data pipelines using Java/Python, Spark/Py-Spark, and Big Data technologies (Hadoop, Hive, -Yarn, Oozie, etc. - Work with cloud-based data warehouses (Snowflake) and cloud services (AWS EMR, S3, Lambda, RDS/Aurora). - Write efficient SQL queries for various databases (MySQL, SQL Server, Oracle, Hadoop, Snowflake). - Develop and maintain unit tests using Junit/Mokito/PowerMock. - Participate in agile ceremonies and contribute to the improvement of the development process. - Communicate effectively with clients and stakeholders to understand business requirements and provide solutions. Requirements : - 2-4 years of experience in data engineering. - Strong programming skills in Java/Python. - Experience with Big Data technologies (Hadoop, Hive, Yarn, Oozie, etc.) and cloud-based data warehouses (Snowflake). - Proficiency in SQL queries for various databases (MySQL, SQL Server, Oracle, Hadoop, Snowflake). - Experience with unit testing frameworks (Junit/Mokito/PowerMock). - Strong understanding of agile methodologies and version control systems (GitHub). - Experience with project management tools (VSTS) and build management tools (Maven/Gradle). - Familiarity with CI/CD pipelines (Azure DevOps). Nice to Have : - Experience with cloud services (AWS EMR, S3, Lambda, RDS/Aurora). - Knowledge of data engineering best practices and design patterns. - Certification in data engineering or related fields. (ref:hirist.tech)

Location: chennai, IN

Posted Date: 11/27/2024