Data Engineer

Overview

We are actively seeking data engineering professionals who are passionate about the potential for automation to redefine the modern enterprise, and experienced working with leading-­‐edge data technologies. This is an

opportunity to be at the forefront of data engineering and automation in the European & Australasian markets, and to craft your own journey as you develop data engineering and data analytics capabilities within the organisation.

As a Data Engineer, you will be engineering new systems, product features and environments to grow and support our products. You’ll bring solid experience in emerging and traditional technologies, all in a Big Data and AWS Cloud environment. You will be engineering the technical design and development of systems and administering systems which support our product suite. You will take a Cloud-­‐Native approach to systems development and adhere to DevOps best practices in the delivery of engineering capabilities. You be offered the opportunity to innovate and rapidly iterate as we grow.

Responsibilities:

• Work with closely with the Head of Cloud Platform Engineering and liaise directly with the Head of Product, to ensure product features are engineered to specifications using best practice, and which align to the overall vision for the product.
• Work with the product development team to define and develop future state data solution architectures for the product suite.
• Championing company practices in areas of data engineering and data management methodologies, data architectures, data security, and compliance.
• Advise and embed the company’s standards, methods, tools and applications relevant to the areas of Business Intelligence, Data Analytics and Data Science.
• Understand and leverage Big Data as well as cloud based data technologies and applications and be able to engineer solutions for the business to effectively utilize these data solutions.
• Extracting and combining data from various heterogeneous data sources.

Basic Qualifications:

• Industry experience as a Data Engineer or related specialty (e.g., Software Engineer, Business Intelligence Engineer, Data Scientist) with a track record of manipulating, processing, and extracting value from large datasets.
• 4+ years Python experience.
• At least 2 years of experience working with diverse data sources, including both structured and unstructured data.
• Experience building/operating highly available, distributed systems of data extraction, ingestion, and processing of large data sets.
• At least 2 years’ experience working in an agile environment.
• At least 2 years’ experience working with Linux based systems.
• At least 2 years’ experience with some Big Data technologies (e.g. Hadoop, Hive, Spark, etc.)
• Strong analytical, evaluative and problem-­‐solving abilities.
• Effective written and verbal communication and interpersonal skills.

Preferred Qualifications:

• Degree in Computer Science, Math, Statistics or equivalent.
• Experience building data products incrementally, and integrating and managing datasets from multiple sources.
• Experience or a high degree of familiarity with Data Warehousing and working with Data Streams.
• 2+ years experience operating environments in the AWS Cloud.
• AWS Certificate at an Associate level is preferred but not essential.

Desirable Qualifications/Interests:

• Experience or a degree of familiarity or an interest in working with Serverless technologies (AWS Lambda).
• Hands on experience developing predictive analytics capabilities in any capacity.
• Experience providing technical leadership and mentoring other engineers on best practices in the database engineering space. This is desirable but not essential.
• An interest in or experience with Machine Learning technologies.
• Experience or an interest in working with Natural Language Processing data on a Python based project.
• Experience in, or an interest in working with Micro-­‐services architectures.
• Experience working with AWS Redshift and AWS Kinesis. This is desirable but not essential