AppSierra Solutions - Data Engineer - AWS Technologies

Description : We are seeking an experienced AWS Data Engineer proficient in AWS technologies, PySpark, Glue, S3, and Terraform to join our innovative team. As an integral part of our data engineering group, you will be responsible for designing, building, and maintaining scalable data pipelines that facilitate seamless data extraction, transformation, and loading (ETL) processes. This role demands a combination of analytical and technical skills to ensure the efficient processing of data from various sources into our cloud-based storage solutions. You will work closely with data scientists, insights analysts, and other stakeholders to understand their data needs and translate them into automated solutions. We prioritize teamwork and collaborative problem-solving, so your ability to communicate complex technical concepts to non-technical team members is essential. In addition, you will be expected to leverage your knowledge of Terraform for infrastructure as code to manage cloud resources efficiently. This position offers an exciting opportunity to be at the forefront of data engineering in a cloud environment and to contribute significantly to our data-driven decision-making processes. If you are passionate about working with cutting-edge technologies and driving impactful insights through data, we would love to meet you. Responsibilities : - Design and implement ETL processes using AWS Glue and PySpark to streamline data workload. - Develop data storage solutions leveraging AWS S3 for optimal performance and accessibility. - Automate the deployment and management of cloud infrastructure using Terraform. - Collaborate with data scientists and analysts to understand data requirements and translate them into robust data models. - Monitor and optimize data pipeline performance and troubleshoot issues as they arise. - Ensure data governance and integrity throughout all data processing stages. - Document processes, architectures, and workflows to maintain transparency and knowledge sharing within the team. Requirements : - Bachelor's degree in Computer Science, Information Technology, or a related field. - Proven experience as a Data Engineer or a similar role, particularly with AWS. - Strong proficiency in AWS services, particularly Glue, S3, and Lambda. - Expertise in data processing frameworks such as PySpark or Apache Spark. - Experience with Infrastructure as Code tools, specifically Terraform. - Familiarity with SQL and database management systems. - Excellent problem-solving skills and strong analytical thinking capabilities. (ref:hirist.tech)

Location: in, IN

Posted Date: 11/22/2024