ConveGenius - Data Engineer - ETL

Does working for 150 million children of Bharat excite you? Then this opportunity is for you About us : We are a leading Conversational AI company that's revolutionizing education for millions worldwide. Our knowledge bots are already empowering 35 million users, and we're at the forefront of shaping the future of EdTech in Naya Bharat. We're creating an omniverse in Conversational AI, where developers collaborate to innovate together. As part of our team, you'll have a pivotal role in turning complex educational data into practical insights that drive real change. We're deeply committed to enhancing education for 150 million children in India, partnering with state departments and supporting national initiatives like Vidhya Samiksha Kendra under the National Education Policy 2020. ConveGenius operates across three divisions: ConveGenius Digital uses AI and bots to make systemic improvements, ConveGenius Edu offers Swift PAL tablets and AR-enhanced learning, and ConveGenius Insights leads global research in educational science. If you're passionate about making a meaningful impact in education, have experience in both business and social sectors, and thrive in fast-paced environments, join us in transforming EdTech for Naya Bharat. Embrace our startup culture, where innovation and determination reshape India's educational future. Key Responsibilities : - Design, develop, and maintain data pipelines and ETL processes to efficiently ingest, transform, and load data from various sources into data warehouses and data lakes. - Collaborate with data scientists, analysts, and business stakeholders to understand data requirements and design data models that facilitate efficient data retrieval and analysis. - Optimize data pipeline performance, ensuring scalability, reliability, and data integrity. - Implement data governance and security measures to ensure compliance with data privacy regulations and protect sensitive information. - Identify and implement appropriate tools and technologies to enhance data engineering capabilities and automate processes. - Conduct thorough testing and validation of data pipelines to ensure data accuracy and quality. - Monitor and troubleshoot data pipelines to identify and resolve issues, ensuring minimal downtime. - Develop and maintain documentation, including data flow diagrams, technical specifications, and user guides. Qualifications : - Bachelor's degree in Computer Science, Engineering, or a related field. A master's degree is a plus. - Proven experience as a Data Engineer or in a similar role, with a strong understanding of data engineering concepts, practices, and tools. - Proficiency in programming languages such as Python, Java, or Scala, and experience with data manipulation and transformation frameworks/libraries (e.g., Apache Spark, Pandas, SQL). - Solid understanding of relational databases, data modeling, and SQL queries. - Experience with distributed computing frameworks, such as Apache Hadoop, Apache Kafka, or Apache Flink. - Knowledge of cloud platforms (e.g., AWS, Azure, GCP) and experience with cloud-based data engineering services (e.g., Amazon Redshift, Google BigQuery, Azure Data Factory). - Familiarity with data warehousing concepts and technologies (e.g., dimensional modeling, columnar databases). What We Offer & Benefits : At ConveGenius, we believe in creating a supportive and dynamic work environment where you can thrive professionally and personally. If you're passionate about making a difference in education and enjoy working in a diverse and inclusive setting, ConveGenius is the place for you - Experience working with a diverse team of professionals located throughout India. - Be part of an organization that operates in over two-thirds of India's states. - Play a crucial role in transforming the education sector in India. - Enjoy the security and peace of mind that comes with health insurance coverage. - Benefit from a flexible leave policy, including special provisions for period leaves. (ref:hirist.tech)

Location: guwahati, IN

Posted Date: 11/21/2024