Data Engineer – Gcp

Salary: £72,000 – £84,000 per year

GCP Data Engineer with strong SQL & BigQuery experience needed by technology department BI & Process team of Media business that are currently going through a major technology modernisation program.

You’ll be responsible for leading ETL & ELT solutions for the delivery of business intelligence and data warehousing projects, working closely with suppliers who provide external development and operations, as well as with the BI team, internal technical and commercial teams.

Responsibilities

• Lead, develop, build, maintain and continuously improve data pipelines and structured datasets for further analysis and the delivery of business intelligence and data warehousing projects
• Integrate and ingest structured and unstructured data from a variety of sources both internal and external and in a variety of ways depending on the source
• Ensure high availability of all sales, finance, product usage and operational data
• Establish and maintain technical standards based on best BI/DW practices for data pipelines
• Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability
• Document and maintain source to target mappings for the data pipeline
• Assist in operational dataflow using tools such as Zapier

Skills & Experience Required 

• Must be able to demonstrate either a degree in a relevant subject and/or relevant hands-on Data Engineering experience
• Strong knowledge and experience of building scalable ETL/ELT pipelines in a GCP (Google Cloud Platform) environment
• Proven experience with SQL databases, both relational and non-relational in a cloud environment. Working with BigQuery in a production environment is essential, with other cloud technologies (within AWS and/or Azure for example) a bonus
• Advanced SQL is essential as it will be used extensively for this role and for various different use cases. As well as data extraction, data modelling and database manipulation for the data pipeline SQL will be needed to assist in process automation and creation of internal dashboards and tools using e.g. Retool.
• Experience creating and maintaining pipelines using Dataflow/Apache Beam/Cloud Composer/Airflow
• Use of Python for the creation and maintenance of data pipelines and for data modelling
• Extensive experience of extracting data via APIs
• Experience with dbt desirable
• Comfortable extracting business requirements and working with stakeholders
• Knowledge of data ingestion into Looker for Business Intelligence use desirable
• Prior experience of source control, Continuous Integration, Delivery and Deployment through CI Pipelines
• Excellent communication, analytical and problem-solving skills.

Location: Remote – has to be UK based – or Hybrid – they are based in Tunbridge Wells, Kent, South East. 

Salary: £72,000 – £84,000 plus bonus plus benefits including training and development, pension, private medical

Interviews taking place now so please get your application in now.