Data Engineer

Job Description : Role & Responsibilities : - Design, develop, and maintain scalable data pipelines to extract, transform, and load (ETL) data from various sources into our data warehouse - Optimize and tune SQL queries for improved performance and efficiency - Collaborate with data scientists, analysts, and product managers to understand data requirements and deliver high-quality data solutions - Implement data quality checks and monitoring systems to ensure data accuracy and reliability - Develop and maintain documentation for data models, ETL processes, and data flows - Work with BI tools to create and optimize dashboards and reports for business users - Participate in data governance initiatives and ensure compliance with data privacy regulations - Continuously evaluate and implement new technologies and best practices in data engineering Ideal Candidate : - Bachelor's degree in computer science, Information Systems, or a related field - Minimum of 4 years of experience as a Data Engineer or in a similar role - Expert-level proficiency in SQL, including complex queries, stored procedures, and performance tuning - Strong experience with data warehousing concepts and techniques - Proficiency in working with BI tools such as Tableau, Power BI, or Looker - Experience with ETL tools and processes (e.g., Apache Airflow, Talend, or custom ETL pipelines) - Solid understanding of data modeling techniques (e.g., dimensional modeling, star schema) - Familiarity with cloud-based data platforms (e.g., AWS Redshift, Google BigQuery, or Azure Synapse) - Experience with version control systems (e.g., Git) and CI/CD practices - Strong problem-solving skills and attention to detail Preferred Qualifications - Experience with big data technologies (e.g., Hadoop, Spark) - Knowledge of programming languages such as Python, Java, or Scala - Familiarity with data streaming technologies (e.g., Kafka, Apache Flink) - Experience with NoSQL databases (e.g., MongoDB, Cassandra) - Understanding of machine learning concepts and their data requirements - Certifications in relevant technologies or platforms (ref:hirist.tech)

Location: bangalore, IN

Posted Date: 11/24/2024