Lead Data Engineer

Salary: £96,000 per year

Lead Data Engineer – Python / AWS – Remote / London HQ

We’re looking for a Lead Data Engineer with 12+ years of experience who can to help us design and manage the data infrastructure uses to power our business operations on a day to day basis. They run Linux, Postgres, Redshift, Tableau, and Python on AWS and work hard to make sure our systems are secure, performant, accurate, and scalable.

The Lead Data Engineer will report to the Head of Infrastructure and Security, you will be responsible for:

* Designing, coding, testing, and documenting all new or modified BI infrastructure and systems,

* Managing the integration of internal data sources (SQL, S3, Flat Files, and others) while ensuring the appropriate protection of customer PII.

* Identification and aggregation of external sources of information that are relevant to our operational reporting needs.

* Establish and manage analytics methods, techniques and capabilities to enable the organisation to analyse data, to generate insights, create value and drive decision-making.

* Providing a uniform and reliable source of aggregated data for our global operations, customer support, and client success teams.

* Maintain and troubleshoot BI tools, systems, and software.

* Work across multiple data warehouses to identify, analyze, and interpret trends

The Lead Data Engineer will have:

* 12+ years of experience as a senior analyst or engineer in the data and/or BI Space

* Competent knowledge of SQL, in particular, extensive experience with PostgreSQL is required, you should be fluent with most of the following concepts:

* Core SQL concepts (joins, unions, grouping and sorting, indexes)

* Transactions, savepoints and isolation levels

* Types of locks, nowait queries and deadlocks

* Table inheritance

* Views, CTE, Prepared statements

* Window functions

* Debugging performance

* Experience managing, scaling and utilizing AWS Redshift for OLAP workloads

* Experience with data warehouse design, operation, and maintenance

* Experience managing and aggregating global sources of data.

* Experience with AWS, Infrastructure-as-code, and devops is considered a plus in this role

* Experience with SOC-2 and/or ISO27001 is considered a plus in this role

* You are a builder at heart and enjoy the challenge of creating well-crafted solutions to unique sets of problems.

Please apply if you have the above skillset – Lead Data Engineer

Job Types: Full-time, Permanent

Salary: £96,000-£ per year