[CLOSED] Data Engineer - Permanent - Remote

On behalf of our client, we are recruiting for a data engineer to work with billions of miles of vehicle driving data captured in multiple countries around the world. The company specialises in analysing and scoring driving behaviour, assessing eco driving, using AI to perform risk calculations and more.

Applicants must be well disciplined to work remotely and may be located anywhere in England. However, access to Epsom, Surrey, will be required for team meetings and ad-hoc occasions. The successful candidate will be able to optionally make use of the offices at any time, rather than working remotely, if desired.

In this role, the successful candidate will be:

• Building data pipelines from the ground up, from various data sources (S3, RDS, external sources) to get data into our datalake and cleaned, formatted and performantly available in our data warehouse.
• Managing large scale batch and streaming data pipelines in AWS cloud environments
• Creating vital tools and infrastructure to monitor and understand the data flow outputs and performance
• Maintaining the data models in the data warehouse to support Data Science, analysis and wider product requirements
• Proactively deploying improvements to system architecture and / or object library to improve efficiency / security / of owned systems
• Working closely with data scientists, ML engineers and analytics team to speed up delivery of cloud data services
• Working mainly with the following: Python, PostgreSQL, AWS tools (Redshift, Glue, Athena…), PySpark
• Developing new systems and tools to enable the teams to consume and understand data more intuitively

The right candidate will have the following technical skills:

• Experience building modern Datalakes and Data Warehouses
• Experience in working with large data sets with real-time streaming applications
• Experience in relational database (PostgreSQL, Redshift)
• Experience in AWS Cloud Services (S3, Glue, Athena, Redshift…)
• Some experience writing Infrastructure-As-Code (e.g. Terraform)
• Strong experience in SQL and Python
• Experience in ETL and related practices
• Good Experience in Apache Spark (Pyspark, spark streaming is a plus)
• Experience with modern software engineering practices (CI/CD, Testing, Version Control…)

Applicants should anticipate video calls and use of remote collaboration tools during the interview process and, if successful, part of day-to-day activities.

The company is able to offer a competitive salary between 45-75k, depending on experience, alongside generous pension contributions, holiday allowance and other perks.

Contact alex@inchecksoftware.com to apply or find out more