Data Engineer

My Dublin based client is recruiting for a Data Engineer to join the team on a perm basis, this will on a very flexible hybrid model. You will work in a fast moving, agile environment, in multi disciplinary teams. You will contribute to some of the most exciting digital programmes around for clients in a range of industries. The Data Engineer will build, optimise & maintain data applications, systems and services. This role will combine the discipline of software engineering with the knowledge & experience of building data solutions in order to deliver business value.

Job Responsibilities

• Building reliable, efficient data applications systems, services & platforms.
• Excellent understanding of coding best practices & design patterns.
• You will have experience with the following:
• Code & data versioning
• Code quality & optimisation
• Error handling & logging, monitoring
• Validation & alerting.
• Good experience in writing well tested object-oriented python.
• Good experience with using CI/CD tooling to analyse, build, test & deploy your code.
• Good understanding of design for data storage & data processing and with a particular focus on cloud data services.
• Strong experience in using parallel computing to process large datasets & to optimise computationally intensive tasks.
• Previous experience in deploying, scheduling & monitoring components in a workflow.
• Previous experience in writing complex queries against relational and non-relational data stores.

Experience Required

Deploy data pipelines & processes in a production-safe manner, using the latest technologies & with a DataOps culture.

You will work in a fast moving, agile environment within multi- disciplinary teams of highly skilled consultants, delivering modern data platforms into large organisations.

Essential and Desirable Skills

• You will to get involved in variety of projects within the cloud (AWS, Azure, GCP),
• You will learn about and use data services such as
• Databricks,
• Data Factory,
• Synapse,
• Kafka,
• Redshift,
• Glue,
• Athena,
• BigQuery,
• S3,
• Cloud Data Fusion

Educational Requirements

Computer Science Degree

Working Hours & Benefits

• 38 Hour Working Week
• Healthcare
• Pension
• Hybrid