UsefulBI Corporation - Solution Architect - Data Engineering

Job Role : Solution Architect. Location : Remote. Job Description : - Minimum 8years' Experience in Data Engineering. - Must have good knowledge and experience in Python. - Must have good Knowledge of Pyspark or Spark. - Must have good experience in AWS/Azure (Glue,- EMR). - Typically requires relevant analysis work and domain-area work experience. - Expert in the management, manipulation, and analysis of very large datasets. - Superior verbal and written communication skills, ability to convey rigorous mathematical concepts and considerations to non-experts. - Good knowledge of scientific programming in scripting languages like Python. Key Responsibilities : - Create and maintain optimal data pipeline architecture. - Assemble large, complex data sets that meet functional / non-functional business requirements. - Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc. - Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL and AWS 'big data' technologies. - Build analytics tools that utilize the data pipeline to provide actionable insights into customer acquisition, operational efficiency and other key business performance metrics. - Work with stakeholders including the Executive, Product, Data and Design teams to assist with data-related technical issues and support their data infrastructure needs. - Create data tools for analytics and data scientist team members that assist them in building and optimizing our product into an innovative industry leader. (ref:hirist.tech)

Location: in, IN

Posted Date: 11/22/2024