Softpath Technologies - AWS Data Engineer - SQL/Python

Job Description : - Participate in efforts to design, build, and develop rapid Proof-of-Concept (POC) solutions and services - Build applications using Python, SQL, Databricks and AWS - Be a key team member in design and development of the Marketing product team - Working understanding of Agile, Scrum, Design Thinking, and Lean Startup principles - Apply knowledge of basic principles, methods and practices to simple and moderately complex assignments - Proactively identify and implement opportunities to automate tasks and develop reusable frameworks - Act as a run manager, provide Run/DevOps support - Adhere to standard methodologies for coding, testing and designing reusable code/component - Participate in sprint planning meetings and provide estimations on technical implementation - Contributed to the exploration and understanding of new tools and techniques, and propose improvements to the data pipeline - Work as a data engineer within the US Value & Access IS team that uses several Data, Search and AWS technologies - Implement standardized, automated operational and quality control processes to deliver accurate and timely data and reporting to meet or exceed SLAs - Collaborate with the other engineering team members to ensure all services are reliable, maintainable, and well-integrated into existing platforms - Review functional and technical designs to identify areas of risk and/or missing requirements - Provide technical write-ups and drawings to promote the proposed solutions. Requirements : - 3-5 years experience with automation of DevOps build using Experience working directly with technical and business teams - 3-5 years experience AWS cloud and AWS services such as S3 Buckets, Lambda, API Gateway, SQS queues - 3-5 years experience with batch job scheduling and identifying data/job dependencies - 3-5 years experience with data engineering using AWS platform and Python - Familiar with AWS Services like EC2, S3, Redshift/Spectrum, Glue, Athena, RDS, Lambda, and API gateway - A Techno-functional role, with a Total experience of 8 years - Familiar with software DevOps CI/CD tools, such Git, Jenkins, Linux, and Shell Script - Ability to learn quickly, be organized and detail oriented - Understanding of Spark, Hive, Kafka, Kinesis, Spark Streaming, and Airflow - Automated testing experience using MUNIT and HP ALM /Selenium/Appium/ SOAP UI - Experience in Software Engineering and Development - Understanding of database schema design - Proficient in one of the coding languages (Python, Java, Scala) - Experience in developing and supporting web applications including familiarity with web technologies and frameworks (D3 JS, React.js) (ref:hirist.tech)

Location: bangalore, IN

Posted Date: 11/25/2024