Data Validation Specialist - Snowflake

Overview : Primary responsibility will be to ensure the accuracy, integrity, and consistency of data within the organization's databases and systems. You will work closely with cross-functional teams to implement data validation processes and procedures, ensuring that data entered into the system meets predefined standards and requirements. Responsibilities : - Develop and implement data validation rules and procedures to ensure the accuracy and integrity of data between two different environments. - Collaborate with developers to integrate data validation checks into the back-end systems and processes. - Design and execute automated tests to validate data quality and identify anomalies or errors. - Analyze data validation results and troubleshoot issues to determine root causes and implement corrective actions. - Develop and maintain documentation related to data validation processes, including validation rules, test cases, and procedures. - Work with cross-functional teams to define data quality standards and requirements. - Monitor data quality metrics and trends and provide recommendations for continuous improvement. Qualifications : - Bachelor degree in computer science, information technology, or a related field. - Proven experience in back-end data validation, data quality assurance, or a similar role. - Snowflake experience with strong understanding of database concepts, SQL, data modeling, and ETL processes. - Should have experience with ETL informatica Power Center, DataStage, shell scripting. - Ability to analyze complex data sets and troubleshoot data-related issues. - Experience with data validation tools and techniques, such as regular expressions, data profiling, and data cleansing. - Proficiency in scripting or programming languages (e.g., Python, Java) for automation. - Excellent analytical and problem-solving skills, with a keen attention to detail. - Strong communication and collaboration skills, with the ability to work effectively in a team environment. - Experience with Agile development methodologies is a plus. - Familiarity with reporting platforms and tools, and data visualization tools is a strong plus. Key Responsibilities : Data Validation : - Design, develop, and execute data validation procedures to ensure data integrity and accuracy across Snowflake-based data warehouses and databases. - Identify and resolve discrepancies, anomalies, or inconsistencies in data by performing both automated and manual validation checks. - Work with data engineers to develop and automate data validation processes, such as checks for missing values, outliers, and data type mismatches. Data Quality Assurance : - Monitor and enforce data quality standards for datasets within Snowflake. - Define data quality metrics and set up data validation rules for both batch and real-time data. - Perform regular data audits and reconciliation tasks to ensure the quality of data loaded into Snowflake. - Track and report on data quality issues and collaborate with teams to resolve them in a timely manner. Collaboration and Stakeholder Engagement : - Collaborate with data engineers and business analysts to understand data requirements and validate that data meets business and analytical needs. - Work with stakeholders to document data validation processes and create best practices for data governance and quality. - Provide insights into data integrity issues and suggest improvements or Responsibilities : - Utilize Snowflake's features (e.g., data loading, transformation, and querying) to validate and audit data effectively. - Develop and implement Snowflake-based SQL queries for data validation and quality assurance tasks. - Troubleshoot data loading and transformation issues in Snowflake and ensure data is accurately populated. Automation and Tool Development : - Build and maintain automated scripts, tools, and dashboards for ongoing data validation tasks. - Implement ETL pipeline validations and ensure data consistency during migration and transformation. Documentation & Reporting : - Document data validation procedures, rules, and best practices. - Prepare reports on data quality, trends, and issues for internal and external stakeholders. - Provide training and support to other teams on data validation techniques and tools. Required Skills and Qualifications : Experience : - Minimum 3-5 years of experience in data validation, data quality assurance, or data engineering. - Strong experience working with Snowflake (both on the cloud and data validation aspects). - Solid experience writing complex SQL queries for data analysis and validation. - Familiarity with ETL processes and tools (e.g., Talend, Informatica, Apache Airflow). Technical Skills : - Expertise in using Snowflake for data management, including querying, data transformation, and data governance. - Knowledge of cloud computing environments and data warehousing best practices. - Proficiency in SQL, including advanced querying and data transformation techniques. - Experience with data validation tools, scripting languages (e.g., Python, Bash), and test automation frameworks. - Analytical and Problem-Solving Skills : - Strong analytical skills with the ability to troubleshoot and identify data discrepancies. - Detail-oriented with an ability to identify, investigate, and resolve data-related issues quickly. (ref:hirist.tech)

Location: in, IN

Posted Date: 11/25/2024