Python/PySpark Developer - AWS Lambda

Exp : 5 to 8 year exp. Python/PySpark Developer with AWS Lambda Experience About the Role : We are seeking a highly skilled Python/PySpark Developer with a strong understanding of AWS Lambda to join our team. The ideal candidate will have a proven track record of designing, developing, and deploying scalable data pipelines and applications using Python and PySpark. Responsibilities : - Design, develop, and deploy robust and scalable data pipelines using Python and PySpark. - Develop serverless applications using AWS Lambda to automate tasks and trigger data processing workflows. - Optimize data processing pipelines for performance and efficiency. - Collaborate with data engineers, data scientists, and business analysts to understand data requirements and translate them into technical solutions. - Troubleshoot and resolve issues related to data pipelines and applications. - Stay up-to-date with the latest trends in data engineering and cloud technologies. Required Skills : - Strong proficiency in Python programming language. - Expertise in PySpark for big data processing and analysis. - Hands-on experience with AWS Lambda and other AWS services (e.g., S3, EC2, EMR). - Solid understanding of data engineering concepts, including data ingestion, transformation, and loading. - Experience with SQL and NoSQL databases. - Familiarity with data visualization tools (e.g., Tableau, Power BI). - Strong problem-solving and analytical skills. - Excellent communication and collaboration skills. Preferred Skills : - Experience with machine learning and data science frameworks (e.g., TensorFlow, PyTorch, Scikit-learn). - Knowledge of containerization technologies (e.g., Docker, Kubernetes). - Experience with cloud-native development and deployment. (ref:hirist.tech)

Location: noida, IN

Posted Date: 11/23/2024