Big Data Engineer

Big Data Engineer Image
Big Data Engineer

Dublin South / Dublin City Centre

Permanent

Neg depending on experience

Ref: E2874NB

Job Description

My Dublin based client is recruiting for a Big Data Engineer with a strong Python background to join their team. This role is on a permanent basis working within a team.

Overview

The Big Data Engineer will understand and own the technical decisions that impact the end-users of our solutions. The client are enthusiastic about deploying open source technologies, so the successful candidate will work with state of the art data processing frameworks and technologies like Airflow and Spark.

Responsibilities

  • Strong programming skills including 2+ years of Python experience in a production environment.
  • Strong engineering background, preferred in fields such as Computer Science, Software Engineering, Physics, Mathematics.
  • Familiarity with ETL tools (Apache Spark, Hadoop, Airflow, etc), storage systems, cloud computing, front-end frameworks, and other technical tools.
  • Experience implementing ML/statistical algorithms using industry-standard, open-source libraries (Scikit-learn, Pandas, Spark ML)
  • Demonstrated ability to continuously learn, work independently, and make decisions with minimal supervision.
  • Skill and comfort working in a fast changing environment with dynamic objectives and iteration with stakeholders.

Experience with the following highly desirable:

•Amazon Web Services (S3, EC2, Redshift, EMR) •Java/Scala/Javascript •Linux •Implementing data security and privacy in a cloud environment

How to Apply

If you are interested in this role, then please Apply along with your updated CV and I will be in touch with you to discuss your application in more detail, otherwise feel free to connect with me by whichever medium you are most comfortable with be that Linkedin, Email or Telephone. Remember we have limited our site to a maximum of 200 Jobs so if this Role is not a 100% match to your requirements please be sure to connect with us as we will most likely have another role which you may find more suitable.

Apply for Job

Not what you're looking for?

If this isn't the job for you then why not reach out to one of our consultants today and send us your CV so we can find the one that is?

Reach out to a Consultant