Hadoop Consultant

Hadoop Consultant Image
Hadoop Consultant

Dublin City Centre



Ref: E167PK

Job Description

My client is looking for a Hadoop Consultant for a 6-12 month daily rate contract in Dublin City. The client will pay an attractive daily rate.


Skills Required:

  • General Programming (regex, functions, loops, data structures)
  • Big Data architecture mind-set e.g. data can be de-normalised on Hadoop it is not such an issue because storage is cheap
  • Data formats and Big Data formats (Textfile, avro, json, xml, etc.)
  • SPARK – Scala (could be java or python I guess)
  • Bash/Shell scripting (Job scheduling) – this could be python and is OS agnostic so might be better choice.
  • Hadoop File System Shell (File Movement)
  • Solr + understanding of Javascript (host job configuration details)
  • ETH (Jenkins/NEXUS/Maven/GIT/JIRA)
  • High level Groovy scripting (Used primarily for Jenkins deployments) (our pipeline is still in design will have completed in next few weeks)
  • Hive/BigSQL (these are different to Teradata) (TEXTFILE, SEQUENCEFILE, RCFILE, AVRO, ORCFILE, PARQUET)
  • SQL
  • Hbase (will need in real-time solutions)
  • Kafka (will need in real-time solutions)
  • Cyber arc (security)
  • Remedy (need to raise tickets before going live with changes)
  • Python/Notebooks Data profiling solution currently

How to Apply

If you are interested in this role, then please Apply along with your updated CV and I will be in touch with you to discuss your application in more detail, otherwise feel free to connect with me by whichever medium you are most comfortable with be that Linkedin, Email or Telephone. Remember we have limited our site to a maximum of 200 Jobs so if this Role is not a 100% match to your requirements please be sure to connect with us as we will most likely have another role which you may find more suitable.

Apply for Job

Not what you're looking for?

If this isn't the job for you then why not reach out to one of our consultants today and send us your CV so we can find the one that is?

Reach out to a Consultant