Contract Opportunity (Inside IR 35) - Data Engineer - London (3 days in office)
Posted 5 days ago by Alphayotta
Negotiable
Inside
Hybrid
Greater London, England, United Kingdom
Summary: The Data Engineer role is a contract position based in London, requiring a hybrid work arrangement with three days in the office. The candidate will be responsible for the entire data engineering process, including data ingestion, transformation, and warehousing, with a focus on Azure cloud delivery and SQL development. Collaboration with various teams is essential to deliver business-focused data products and ensure best practices are followed throughout the engineering process.
Key Responsibilities:
- Work closely with end-users and Data Analysts to understand business and data requirements
- Carry out ad hoc data analysis and ‘data wrangling’ using Synapse Analytics and Databricks
- Build dynamic meta-data driven data ingestion patterns using Azure Data Factory and Databricks
- Build and maintain business-focused data products and data marts
- Build and maintain Azure Analysis Services databases and cubes
- Share support and operational duties within the wider engineering and data teams
- Work with Architecture and Engineering teams to deliver on projects and ensure best practices
- Help define test criteria to establish clear conditions for success
- Manage user stories and acceptance criteria through to production
- Assist in testing and validation of new requirements and processes
- Stay up-to-date with industry trends and best practices in data engineering
Key Skills:
- Excellent data analysis and exploration using T-SQL
- Strong SQL programming (stored procedures, functions)
- Extensive experience with SQL Server and SSIS
- Knowledge of data warehouse modelling methodologies (Kimball, dimensional modelling, Data Vault 2.0)
- Experience in Azure (Data Factory, Databricks, Synapse Analytics, ADLS Gen2)
- Experience in building robust and performant ETL processes
- Build and maintain Analysis Services databases and cubes (multidimensional and tabular)
- Experience in using source control & ADO
- Understanding of deployment pipelines
- Excellent analytical and problem-solving skills
- Strong communication and interpersonal skills
- Integrity and a customer-focused philosophy
- Effective writing and verbal communication
Salary (Rate): undetermined
City: London
Country: United Kingdom
Working Arrangements: hybrid
IR35 Status: inside IR35
Seniority Level: undetermined
Industry: IT
Role Type: Contract
Location: London (3 days in office)
Job Title: Data Engineer
Work mode: Hybrid
Role Description
Description of role and key responsibilities:
The candidate will be required to deliver to all stages of the data engineering process – data ingestion, transformation, data modelling and data warehousing, and build self-service data products. The role is a mix of Azure cloud delivery and on-prem (SQL) development. Ultimately all on-prem will be migrated to cloud and decommissioned
The role will work closely with our Architect, Engineering lead, Analytics team, DevOps, DBAs, and upstream Application teams in Private Client Technology
Specifically, the person will:
- Work closely with end-users and Data Analysts to understand the business and their data requirements
- Carry out ad hoc data analysis and ‘data wrangling’ using Synapse Analytics and Databricks
- Building dynamic meta-data driven data ingestion patterns using Azure Data Factory and Databricks
- Build and maintain business focused data products and data marts
- Build and maintain Azure Analysis Services databases and cubes
- Share support and operational duties within the wider engineering and data teams
- Work with Architecture and Engineering teams to deliver on these projects. and ensure that supporting code and infrastructure follows best practices outlined by these teams.
- Help define test criteria to establish clear conditions for success and ensure alignment with business objectives.
- Manage their user stories and acceptance criteria through to production into day-to-day support
- Assist in the testing and validation of new requirements and processes to ensure they meet business needs
- Stay up-to-date with industry trends and best practices in data engineering
Core skills and knowledge:
- Excellent data analysis and exploration using T-SQL
- Strong SQL programming (stored procedures, functions)
- Extensive experience with SQL Server and SSIS
- Knowledge and experience of data warehouse modelling methodologies (Kimball, dimensional modelling, Data Vault 2.0)
- Experience in Azure – one or more of the following: Data Factory, Databricks, Synapse Analytics, ADLS Gen2
- Experience in building robust and performant ETL processes
- Build and maintain Analysis Services databases and cubes (both multidimensional and tabular)
- Experience in using source control & ADO
- Understanding and experience of deployment pipelines
- Excellent analytical and problem-solving skills, with the ability to think critically and strategically.
- Strong communication and interpersonal skills, with the ability to engage and influence stakeholders at all levels.
- To always act with integrity and embrace the philosophy of treating our customers fairly
- Analytical, ability to arrive at solutions that fit current / future business processes
- Effective writing and verbal communication