Data Engineer

As aData Engineer you will collaborate with and support the Finance BI and global finance team in building our Data Warehouse. You'll be required to develop scalable data pipelines, extract data from core systems, transforming it and loading into database/warehouse tables while also ensuring these are optimised for maximum performance within the tools available. You are expected to have strong collaboration skills and be a high performer within the Finance BI team.

Responsibilities

Design and develop data transfer engines and pipelines: highly scalable, end-to-end processes to consume, integrate, and analyse data from different data sources.

Perform data collection, cleansing, and integration for analytical needs.

Optimise storage and retrieval processes for maximum performance and efficiency.

Optimise data transfer engines and pipelines by monitoring, evaluating performance, and applying enhancement.

Design and develop data marts and define data models.

Participate in System Data Architecture and Data Governance activities

Adhere to and take part in enhancement of data management standards, coding standards, guidelines, and policies.

Employ strong engineering mind-set in design and development of automated monitoring, alerting, and recovery processes.

Collaborate with Source System analysts, Business Intelligence developers, Architects and Stake holders to ensure that requirements for integration, security, quality, and cross functional usage are addressed.

Help resolve data issues, troubleshoot system problems, and as needed, assist with reporting, debugging data accuracy issues, and other related functions.

Work in a collaborative environmentmeetings, iterative development, and design and code review sessions.

Collaborate with all technology and business functions to understand requirements
and produce clear specification and documentation

Implement quality checks and troubleshoot issues to ensure data accuracy and reliability.

Monitor and manage the performance of data systems.

Stay updated on emerging technologies and trends in data engineering.

Qualifications / Experience:

3-5 years of experience as a Data Engineer or a similar role.

Expert knowledge of data engineering tools and technologies (e.g. SQL, ETL, data warehousing).

Proficiency in T-SQL (4+ years of SQL experience)

4+ years of experience with schema design and dimensional data modelling

Proficiency in the Microsoft BI Tool Stack; Database, SSIS, SSAS, PowerBI (Nice to Have)

Experience with Azure cloud platform and Azure Data Factory

Knowledge of data modeling, database design, and data governance.

Experience with Continuous Integration Processes and Tools (AzureDevOps)

Experience with Change Management Processes and Cycles (Release and Deployment)

Experience with Microsoft SQL Data Tools (2019+)

Experience in working in Development Teams and Team Collaborative tools (Jira or similar)

Minimum bachelors degree in Computer Science, Data Engineering, Information Technology, or a related field.