ETL Data Engineer
Dublin
2
Negotiable
Ref: E17972SD
Job Description
My client is looking for an ETL Data Engineer to join their team.
My client is looking for an ETL Data Engineer to join their team.
Job Responsibilities
- Design and integration of new data feeds and migration of new data sets;
- Determine optimal solutions for integrating data from a variety of sources into a common data warehouse normalised structure, within an ETL Framework;
- Ongoing DWH modelling in a normalised star schema structure, along with building and maintaining de-normalised reporting data marts;
- Implement, maintain and monitor batch & stream data pipelines with best practice quality controls;
- Performance optimisation of data processing e.g. parallel processing, RAM and CPU usage as well as storage and growth monitoring and ongoing engagement with DBA’s;
- Work closely and collaboratively in an Agile environment with the broader Data Team to analyse issues and find new insights that help drive business performance;
- Delivery of “ETL activities as a service” to colleagues and customers across The company, on both a project and / or managed service basis;
- Ongoing unit testing, system integration testing and data reconciliations;
- Coordination & support for UAT;
- Automate the application of master data management transformations;
- Day to day operational support of data infrastructure, and services.
- Definition & Implementation of data security and compliance policies and regulations e.g. GDPR;
- Help define, implement and lead on robust data management data quality processes;
- Design and build best in class processes to clean and standardise data;
- Identify and help standardise the use and governance of data.
- Support the creation and maintenance of documentation deliverables including, but not limited to architecture diagrams, data flow diagrams, metadata, data dictionary, entity-relationship diagrams, data mapping documents, and other data design artifacts that define technical data specifications and transformation rules; and
- Support KPI definition process and hold custody of historic knowledge of data and meaning.
Experience Required
- Min 5 years Development experience in ETL, SQL Programming, systems integration and Data Warehousing environments;
- Bachelor’s degree in computer science/information systems;
- Deep knowledge of SQL, data modeling and data warehousing concepts;
- Experience in data management frameworks; Data Quality Profiling, Metadata Management, Master Data Management, cleansing/standardising, analysing;
- Expert familiarity with market leading data integration technologies;
- Good project management skills; experience managing projects / requests with multiple senior stakeholders
- Strong command of relevant programming/scripting languages: e.g. Java, Scala, Python, R;
- Strong understanding of Business Intelligence strategies/design as it relates to Data Analysis; and
- Expert familiarity with market leading data integration technologies.
