Senior Data Engineer - PySpark/Python

Position : PySpark/Python with AWS Developer. Location : Bangalore. Number of Open Positions : 7. Experience Required : 7-9 Years. Relevant- Experience : 3 Years. Shift : General Shift. Remote Work : WFH. Notice period : 30 Days. Note WE ARE NOT CONSIDERING CANDIDATES- FROM DATA ANALYST OR DATA SCIENTIST. Role Overview : As a PySpark/Python Developer with AWS, your key responsibilities will include : - Developing and maintaining data processing pipelines using PySpark and Python. - Designing and implementing data workflows on AWS platforms. - Collaborating with cross-functional teams to understand data requirements and deliver effective solutions. - Optimizing data processing tasks to ensure high performance and efficiency. - Troubleshooting and resolving issues related to data pipelines and AWS infrastructure. - Ensuring data quality and integrity across the systems. - Documenting and sharing best practices for data engineering and cloud-based solutions. Qualifications : - 7-9 years of experience in PySpark/Python development with a strong focus on AWS. - Proven expertise in designing and implementing data processing pipelines and workflows. - Strong programming skills in Python and experience with PySpark. - Hands-on experience with AWS services such as S3, EC2, Lambda, Redshift, or Glue. - Solid understanding of data engineering principles and cloud architecture. - Ability to work independently and collaboratively in a team environment. - Excellent problem-solving skills and attention to detail. Preferred Qualifications : - Previous experience in similar roles with notable organizations. - Familiarity with other cloud platforms or technologies. - Experience in data warehousing and big data solutions. (ref:hirist.tech)

Location: bangalore, IN

Posted Date: 11/27/2024