Data Engineer ( NPPV3 )

Data Engineer ( NPPV3 )

Posted 1 day ago by Morgan McKinley

Apply
Negotiable
Outside
Remote
United Kingdom
Apply
Agile Methodology Apache Spark Architectural Patterns Automation Azure Databricks Azure Data Factory Azure Data Lake Azure DevOps Cloud Computing Cloud Technology Continuous Integration and Continuous Delivery Databricks Data Engineering Data Governance Data Quality DevOps Microsoft 365 Microsoft Azure Pyspark Security Clearance SQL (Programming Language) Stakeholder Management

Summary: The Senior Data Engineer role involves designing, building, and scaling modern cloud data platforms on Azure, with a focus on Databricks and lakehouse patterns. This position requires hands-on delivery within multi-disciplinary teams, supporting clients in transitioning from legacy data systems to scalable, cloud-native solutions. The role demands strong technical leadership and collaboration with various stakeholders to ensure data quality and performance. Candidates must have NPPV3 security clearance or be eligible for it.

Key Responsibilities:

  • Design and build robust, scalable data pipelines and platforms on Microsoft Azure
  • Lead hands-on delivery using Databricks (PySpark / Spark SQL) for data engineering and transformation workloads
  • Develop and maintain ingestion frameworks (batch and streaming) from a variety of source systems
  • Contribute to lakehouse architecture patterns using ADLS Gen2, Delta Lake, and modern data modelling approaches
  • Work closely with solution architects, analytics engineers and stakeholders to translate requirements into technical solutions
  • Champion data quality, reliability, performance and security best practices
  • Support CI/CD, automation and infrastructure-as-code approaches within data engineering workflows
  • Provide technical leadership and mentoring within delivery teams where appropriate

Key Skills:

  • Strong commercial experience as a Senior Data Engineer on Azure
  • Proven hands-on delivery with Databricks (PySpark, Spark SQL, Delta Lake)
  • Experience with core Azure services such as: Azure Data Lake Storage (ADLS Gen2), Azure Data Factory / Synapse Pipelines, Azure DevOps (or similar CI/CD tooling)
  • Strong SQL and data modelling experience
  • Experience building production-grade data pipelines (batch and/or streaming)
  • Comfortable working in agile delivery teams within consultancy or complex enterprise environments
  • Desirable: Experience working in public sector or regulated environments
  • Familiarity with lakehouse architectures and modern data platform patterns
  • Exposure to data governance, security and platform best practice
  • Experience operating in environments requiring NPPV3 or similar clearance

Salary (Rate): undetermined

City: undetermined

Country: United Kingdom

Working Arrangements: remote

IR35 Status: outside IR35

Seniority Level: Senior

Industry: IT

Detailed Description From Employer:

Senior Data Engineer ( NPPV3 )

Location: Fully Remote (UK)

Security Clearance: NPPV3 required (or eligible)

Contract Type: Outside IR35

Rate: Competitive (DOE)

Start: ASAP / Flexible

Overview

We’re supporting a leading consultancy client delivering complex data platform and analytics programmes across regulated and public-sector environments. They’re looking to engage an experienced Senior Data Engineer to help design, build and scale modern cloud data platforms on Azure , with a strong focus on Databricks and modern lakehouse patterns. This is a hands-on delivery role within multi-disciplinary teams, supporting clients moving from legacy or fragmented data estates towards scalable, cloud-native platforms.

Key Responsibilities

  • Design and build robust, scalable data pipelines and platforms on Microsoft Azure
  • Lead hands-on delivery using Databricks (PySpark / Spark SQL) for data engineering and transformation workloads
  • Develop and maintain ingestion frameworks (batch and streaming) from a variety of source systems
  • Contribute to lakehouse architecture patterns using ADLS Gen2, Delta Lake, and modern data modelling approaches
  • Work closely with solution architects, analytics engineers and stakeholders to translate requirements into technical solutions
  • Champion data quality, reliability, performance and security best practices
  • Support CI/CD, automation and infrastructure-as-code approaches within data engineering workflows
  • Provide technical leadership and mentoring within delivery teams where appropriate

Required Skills & Experience

  • Strong commercial experience as a Senior Data Engineer on Azure
  • Proven hands-on delivery with Databricks (PySpark, Spark SQL, Delta Lake)
  • Experience with core Azure services such as: Azure Data Lake Storage (ADLS Gen2) Azure Data Factory / Synapse Pipelines Azure DevOps (or similar CI/CD tooling)
  • Strong SQL and data modelling experience
  • Experience building production-grade data pipelines (batch and/or streaming)
  • Comfortable working in agile delivery teams within consultancy or complex enterprise environments
  • Desirable Experience working in public sector or regulated environments
  • Familiarity with lakehouse architectures and modern data platform patterns
  • Exposure to data governance, security and platform best practice
  • Experience operating in environments requiring NPPV3 or similar clearance

Clearance

Active NPPV3 clearance is required (or candidates must be eligible and willing to go through the process).

Apply
Similar Jobs
Loading data...