Data Engineer - Java/Python

Job Description : We are seeking talented Data Engineers with expertise in Data & Analytics to join Xenspire/NTT Data for exciting projects. The ideal candidates will have strong experience in building, optimizing, and maintaining scalable data pipelines and infrastructure while ensuring data quality and governance. Key Responsibilities : - Design, build, and maintain scalable and reliable data pipelines to process large volumes of structured, semi-structured, and unstructured data from diverse sources. - Develop ETL processes to ingest, transform, and load data into data warehouses, ensuring data quality, integrity, and consistency. - Collaborate with stakeholders, report developers, and data scientists to understand data requirements and translate them into technical solutions. - Optimize the performance and efficiency of data infrastructure, including storage, processing, and querying. - Implement data governance policies to ensure compliance, security, and privacy of sensitive data. - Troubleshoot data-related issues, identify root causes, and deliver timely solutions. - Stay updated with the latest technologies and tools in the data engineering domain. Basic Qualifications : - Bachelor's degree in Technology or a related field. - 4 years of experience as a Data Engineer with a strong track record in designing and implementing data solutions. - Proficiency in programming languages such as Python or Java, with experience in building data pipelines and workflows. - Hands-on experience with cloud platforms like AWS, Azure, or Google Cloud Platform. - Expertise in cloud data warehousing technologies such as Snowflake or Redshift. - Familiarity with distributed computing frameworks like Cloudera, Apache Hadoop, and Spark. - Experience with AWS services such as S3, EC2, EMR, Glue, CloudWatch, Athena, and Lambda. - Strong knowledge of database concepts, data modeling, schemas, and query languages like SQL and Hive. - Hands-on experience with containerization and orchestration tools like Docker and Kubernetes. - Experience with CI/CD pipelines using tools like GitLab or Bitbucket. - Familiarity with data pipeline orchestration tools such as Airflow and Jenkins. Additional Skills (Good to Have) : - Knowledge of data visualization tools such as MicroStrategy, Tableau, and Power BI. - Familiarity with data quality and monitoring tools like Great Expectations or similar. - Experience with data governance tools such as Datahub or equivalent for lineage, cataloging, and dictionaries. - Experience with streaming data processing technologies like Kafka. - Background in the retail domain is a plus. Why Join Us : - Work on cutting-edge data engineering projects with a dynamic team. - Be part of a collaborative and innovative environment. - Opportunity to transition into a long-term role after the contract period. (ref:hirist.tech)

Location: bangalore, IN

Posted Date: 11/28/2024