Senior Data Engineer

Senior Data Engineer
Dublin Permanent Hybrid Negotiable Ref:

Job Description

My Dublin based client is looking for an experienced Senior Data Engineer to join their team. Exciting opportunity with a company who operate on a global scale.

Job Responsibilities

  • Develop, build and maintain data pipeline architecture
  • Assemble large and complex data sets that meet various business requirements in a functional manner
  • Identify, create, and implement process improvements for internal use
  • Key member of the involved with building the infrastructure required for optimal extraction and transformation of data from a wide variety of sources using Python and AWS and big data- technologies such as Glue, Lambda and EMR
  • Work closely with various stakeholders including the Product Managers, Executives, Engineers and Design teams to assist with technical issues and support the data infrastructure.
  • Work on various data tools for analytics and data scientist team members to help them in the process of building and optimizing the product into an world leader.

Experience Required

  • Strong Python coding knowledge
  • Previous experience creating/running Python or Pyspark projects working within AWS Glue.
  • Experience working with AWS Data Lakes
  • Previous work on AWS Data Pipeline and CI/CD processes
  • Technology skills with big data tools: Hadoop, Spark, Kafka, etc.
  • Working knowledge with data pipeline and workflow management tools: Luigi, Airflow, AWS
  • Experience with stream-processing systems: Kinesis, Spark-Streaming, etc
  • Familiarity with a variety of datasets, structured, semi structured and unstructured etc.
  • Experience building and optimizing and big data- data pipelines, architecture and data sets.
  • Strong analytic skills
  • Experience and capacity to support and working with cross-functional teams in a highly dynamic and ever changing environment.

Essential and Desirable Skills

  • 4+ years of total experience in a similar role
  • Must have a degree in Computer Science, Statistics, Informatics or a related degree

 

Consultant Details

Stephen Daly's Profile Picture
Name: Stephen Daly
Title: Director
Apply for Job Call me now Add to Shortlist

How to Apply

If you are interested in this role, then please Apply along with your updated CV and I will be in touch with you to discuss your application in more detail, otherwise feel free to connect with me by whichever medium you are most comfortable with be that Linkedin, Email or Telephone. Remember we have limited our site to a maximum of 200 Jobs so if this Role is not a 100% match to your requirements please be sure to connect with us as we will most likely have another role which you may find more suitable.

Apply for Job

Not what you're looking for?

If this isn't the job for you then why not reach out to one of our consultants today and send us your CV so we can find the one that is?

Reach out to a Consultant Upload your CV

Email Job Details

  • Enter your details below to email this job to yourself or a friend.

  • In order to submit this form you'll need to agree with our Privacy Policy

Apply for Job

  • Enter your details below to apply for this job, the consultant will then contact you as soon as possible.

  • Accepted file types: pdf, doc, docx, odt, Max. file size: 4 MB.
    Friendly advice to all candidates - ‘Keep it Simple’. We use an automatic scanner to capture your CV, and key details. We then transfer this info to our database. Automated scanners are not compatible with CV’s drafted on powerpoint or with images, or excessive in design. Please use where possible standard word documents for CV formatting and submission where possible. This will maximise your details being retrieved in searches for job roles that fit with your skills and experience. Thank you.
  • In order to submit this form you'll need to agree with our Privacy Policy

Upload your CV

  • Send us your CV and we'll be in touch with jobs relevant to you.

  • Accepted file types: pdf, doc, docx, Max. file size: 10 MB.
    Friendly advice to all candidates - ‘Keep it Simple’. We use an automatic scanner to capture your CV, and key details. We then transfer this info to our database. Automated scanners are not compatible with CV’s drafted on powerpoint or with images, or excessive in design. Please use where possible standard word documents for CV formatting and submission where possible. This will maximise your details being retrieved in searches for job roles that fit with your skills and experience. Thank you.
  • In order to submit this form you'll need to agree with our Privacy Policy
× Speak with our team