JobRialto
QA Data/ Automation Engineer
Job Location
The Colony, TX, United States
Job Description
Job Summary
The QA Data/Automation Engineer will work closely with the development team in an agile environment to ensure data quality, integrity, and performance in data pipeline solutions. This role is responsible for designing, developing, and maintaining comprehensive test plans for scalable data pipelines on a cloud-native Lakehouse data platform. The QA Data/Automation Engineer will implement automated testing frameworks, write efficient SQL queries, and support continuous integration and deployment practices to uphold high data standards.
Key Responsibilities
• Design, develop, and maintain test plans and test cases for scalable data pipelines
• Implement automated testing solutions on a cloud-native Lakehouse data platform
• Write efficient SQL queries for data validation in extraction, transformation, and loading (ETL/ELT) processes
• Collaborate with product management and analysts to define data requirements and ensure quality assurance
• Optimize and troubleshoot data pipelines for performance and reliability
• Ensure data quality and integrity through testing and validation processes
• Apply DevOps principles and use CI/CD for deploying and operating automated testing frameworks
Required Qualifications
• Strong knowledge of software development patterns and quality assurance best practices
• Experience with ETL/ELT processes and data pipeline testing for EDI transactions (e.g., 835, 837, 834, 820, 276/277, 270/271, 999/997)
• Proficiency with SQL and database management
• Experience with version control, automated testing, and deployments using git-based tools (e.g., GitHub, GitHub Actions)
Education: Bachelors Degree
Location: The Colony, TX, US
Posted Date: 11/25/2024
The QA Data/Automation Engineer will work closely with the development team in an agile environment to ensure data quality, integrity, and performance in data pipeline solutions. This role is responsible for designing, developing, and maintaining comprehensive test plans for scalable data pipelines on a cloud-native Lakehouse data platform. The QA Data/Automation Engineer will implement automated testing frameworks, write efficient SQL queries, and support continuous integration and deployment practices to uphold high data standards.
Key Responsibilities
• Design, develop, and maintain test plans and test cases for scalable data pipelines
• Implement automated testing solutions on a cloud-native Lakehouse data platform
• Write efficient SQL queries for data validation in extraction, transformation, and loading (ETL/ELT) processes
• Collaborate with product management and analysts to define data requirements and ensure quality assurance
• Optimize and troubleshoot data pipelines for performance and reliability
• Ensure data quality and integrity through testing and validation processes
• Apply DevOps principles and use CI/CD for deploying and operating automated testing frameworks
Required Qualifications
• Strong knowledge of software development patterns and quality assurance best practices
• Experience with ETL/ELT processes and data pipeline testing for EDI transactions (e.g., 835, 837, 834, 820, 276/277, 270/271, 999/997)
• Proficiency with SQL and database management
• Experience with version control, automated testing, and deployments using git-based tools (e.g., GitHub, GitHub Actions)
Education: Bachelors Degree
Location: The Colony, TX, US
Posted Date: 11/25/2024
Contact Information
| Contact | Human Resources JobRialto |
|---|