Back to results

Support Centre

Data Engineer

Location:
London
Hours Per Week:
40
13 Nov 2020
Job Description

Data Engineer

We are the biggest UK Homeware Retailer and the largest adopter of AWS Serverless in

Europe. We have recently transformed our digital platform using the latest technology to

build highly scalable, performant cloud-based data infrastructure, and we now have an

exciting opportunity for another Data Engineer to join our rapidly growing agile team.

 

You will be joining our Data Insight, Science and Engineering Team. Your primary focus will

be on building, expanding and optimising our data pipelines. You will develop high

performance data products to further enable our data driven approach. You will support the

improvement of our data self-service capability, building the technology to allow users to

access the data they need on demand.

 

You will be a part of a highly-skilled, self-organising team building forward-thinking solutions

and creating new capabilities to support multiple, cross-functional teams. We are

continuously looking to further improve our technology stack, data quality and reliability, and

your vision and ambition will contribute to shaping our solutions toward data-driven

decisions across the business.

 

You will be working to define AWS cloud based infrastructure as code using CI/CD

practices, developing high quality code in python, and designing data solutions that align

with business goals. The ideal candidate is self-directed, comfortable with challenging and

leading on best practice, and able to adapt to regularly shifting business requirements and

occasional ambiguity.

 

This is a fast-paced hands-on role, and would be well-suited to someone who loves coding,

clean design, clean architecture and using the latest tools and technology to tackle

constantly evolving business and tech challenges.

 

Responsibilities for Data Engineer

● Create and maintain optimal data pipeline architecture

● Assemble large, complex data sets that meet functional / non-functional business

requirements

● Identify, design, and implement internal process improvements: automating manual

processes, optimizing data delivery, re-designing infrastructure for greater scalability,

etc

● Build the infrastructure required for optimal extraction, transformation, and loading of

data from a wide variety of data sources using SQL and AWS ‘big data’ technologies

● Work with stakeholders, including Analytics and BI reporting teams, to assist with

data-related technical issues and delivery

● Work with data and analytics experts to strive for greater functionality in our data

systems

 

Experience required for Data Engineer

We are looking for a candidate with experience in a Data Engineer role,  you should also have

hands-on experience in most of the following key areas:

● Object-oriented/object function scripting languages in Python

● Building and optimising ETL / ELT data pipelines

● Advanced working SQL knowledge and experience working with relational

databases, as well as familiarity with one or more cloud-based data warehouses

such as Snowflake, Redshift, BigQuery

● Experience using noSQL databases such as DocumentDB or MongoDB

● Working with AWS cloud services in production (Cloudformation, API Gateway, AWS

Lambda, Step Functions, SSM, SNS, SQS, Firehose, S3, EMR/Glue, SageMaker

etc)

● Working with raw data, structured, semi-structured and unstructured data

● Experience combining large disconnected datasets using relevant tools/frameworks

such as Spark

● Experience of source control, Continuous Integration, Delivery and Deployment

through CI Pipelines

● Supporting and working with BI and Analytics teams in a dynamic environment

● Able to collaborate and effectively pair program with other engineers

● Strong analytical skills and problem-solving skills

● Knowledge of Scrum, Kanban or other agile frameworks is beneficial, but not

Required

If the opportunity to be part of shaping and transforming Dunelm’s Digital presence excites you, please apply for our immediate attention!