Data Engineer - Python/SQL

Job profile and Role: Data Engineer Job description : - Strong experience with Postgres and SQL and experience working with, supporting and maintaining relational databases. - Experience building and optimizing 'big data' data pipelines, architectures, and data sets. - Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement. - Experience with AWS cloud services - Experience in migrating data across the database/environments with zero downtime. - Experience with AWS integration tool, AWS Glue. - Experience supporting complex ETL & ; Integration Projects - Create and maintain comprehensive documentation for advanced analytics models, data dictionaries, and data flows. - Hands on engineering of solutions and data pipelines utilizing CI/CD and automation. - Design and maintain testing processes and automation workflows for data feature changes, upgrades, and releases. - Strong analytic skills related to working with semi structured datasets. - Build processes supporting data transformation, data structures, metadata, dependency and workload management. - A successful history of manipulating, processing and extracting value from large, disconnected datasets. - Working knowledge of message queuing, stream processing, and highly scalable 'big data' data stores. - Strong project management and organizational skills. - Experience supporting and working with cross-functional teams in a dynamic environment. Required Skills - Bachelor's degree in Computer Science or equivalent degree. - 5 years of software experience - Experience with Machine learning frameworks and models. Pytorch experience preferred - Strong understanding of statistical analysis and mathematical data manipulation - Work with web technology including Java, Python, JavaScript, React/Redux, Kotlin. - Follow best practices for software development and deployment - Understanding of relational database, big data, and experience in SQL - Proficient at using GIT, GitFlow, JIRA, Gitlab and Confluence. - Strong analytical and problem solving skills. - Open-minded and passionate to learn and grow technology skills - Strong sense of accountability - Solution-focused and ability to drive change within the organization - Experience in writing unit/integration tests including test automation. - Strong testing and debugging abilities, functional, analytical and technical abilities, ability to find bugs, attention to detail, troubleshooting (ref:hirist.tech)

Location: karnataka, IN

Posted Date: 11/26/2024