Data Engineer

Salary: £48,000 – £96,000 per year

Data Engineer

REMOTE – UK Based

£48,000 – £96,000 plus extensive benefits package

Our client is looking for a Data Engineer with knowledge of DevOps methods to join their innovative Advanced Analytics Team. You will be tasked with creating and managing Big Data infrastructure and tools, typically designing & building big data pipelines, platforms, and microservices paradigm to software development.

Job role and responsibilities:

This is an exciting opening for a Data Engineer to work on the collecting, storing, processing, and analysing of huge sets of data. The primary focus will be on choosing optimal solutions to use for these purposes, then maintaining, implementing, and monitoring them. Additional responsibilities for this role include:

• Integrating solutions with the architecture used across the business
• Build ETL/ELT best practices in a data environment, featuring big data pipelines, real time streaming using (e.g. Kafka) and leveraging high levels of proficiency across distributed computing principles
• Select and integrate any Data tools and frameworks required to provide requested capabilities, working closely with Cloud big data architecture (AWS, Azure, GCP) and be an SME in relation to knowledge of big data tools/platforms, data management tools, Cloud services and necessary infrastructure changes
• DevOps processes, implementing CI/CD pipelines and developing and managing scalable fault tolerant APIs

About You:

will be a confident Data Engineer who can demonstrate a track record in building scalable data solutions with a view to act as a trusted technology advisor.

You will have core knowledge across a variety of tools and platforms in data landscape, including appreciation of data management / governance and security. Other requirements for this role include:

• Python, Spark (PySpark/Scala) for data pipelines
• Good level of SQL skill and experience
• Strong engineering skills on a cloud Platform is essential (Azure/AWS/GCP). Other cloud platforms are desirable but not essential
• Strong collaboration skills, working both with internal and client stakeholders, ability to contribute thoughts to solutions and focus on common goals
• Strong communication and diligent listening skills
• Comfortable in a working from home environment

Desirable skills for this role include:

• Understanding of technologies like Elasticsearch, Airflow, Apache Nifi, Apache Beam, Storm
• Familiarity with service mesh patterns
• Experience of visualisation tools
• Programming skills in Java, GO
• Experience with noSQL database technologies like MongoDB, Cassandra, neo4j etc
• Understanding of Docker, Kubernetes, CI/CD and Observability like ELK, Prometheus, Grafana
• API implementation and management skills using cloud native tools or WS02, Apigee
• Experience with front end technologies like Angular, React
• Streaming frameworks like Kafka
• Experience in building microservices applications and event driven architecture

If you have strong mandatory skills, our client will support training and certification on other cloud platforms and technologies using their partnerships with technology providers.

Benefits:

Competitive salary:

Access to an annual bonus plan and share scheme making you a member not just an employee.

Private medical and dental insurance

Flexible retirement options,

Childcare vouchers

Cycle to work scheme.

Diversity is actively encouraged, and inclusivity is a top priority, with support networks for Parents, Women, LGBT+, BAME, Neurodiversity and Disability.