Senior Data Engineer - AWS Glue

Responsibilities : AWS Cloud Expertise : - Possess a minimum of 5 years of experience with AWS development. - Hands-on experience with data ingestion, transformation, and orchestration services like AWS Glue, AWS S3, Lambda, and Step Functions. - In-depth knowledge of AWS data management services, including RDS/Aurora, DynamoDB, and S3. - Experience with AWS CloudWatch for monitoring and logging. - Familiarity with AWS SDKs and CLI tools for programmatic access. - Strong understanding of AWS security best practices for data protection. Data Processing & Analytics : - Develop and implement data pipelines using PySpark for large-scale data processing on AWS clusters. - Write efficient SQL queries and stored procedures (PL/SQL) for data manipulation and analysis. - Experience with data migration tools like AWS DMS for seamless data movement between databases. Technical Skills & Problem-Solving : - Possess strong analytical and troubleshooting skills to identify and resolve data processing issues. - Excellent communication skills for collaborating effectively with stakeholders, analysts, and other technical teams. - Proven customer consulting experience to understand business needs and translate them into technical solutions. Project Management & Methodologies : - Work knowledge of Agile and traditional SDLC methodologies for project execution. - Participate in code reviews and contribute to a high-quality codebase. Requirements : - Minimum 5 years of experience as a Data Engineer with a strong focus on AWS cloud services. - Hands-on experience with AWS Glue, PySpark, and SQL (including PL/SQL). - Strong understanding of relational databases (MS SQL, Postgres SQL). - Familiarity with data migration tools and processes. - Experience with cloud monitoring and logging tools. - Excellent communication, collaboration, and problem-solving skills. - Working knowledge of Agile and traditional SDLC methodologies. What We Offer : - Work on cutting-edge data pipelines and data management solutions on AWS. - Contribute to a dynamic and collaborative team environment. - Be part of a company that leverages data to drive business growth. - Competitive salary and benefits package. - Opportunities for professional growth and development (ref:hirist.tech)

Location: bangalore, IN

Posted Date: 11/26/2024