Senior Data Platform Engineer (Azure / Databricks)
Posted 2 days ago by NEBIRU
Negotiable
Undetermined
Remote
EMEA
Summary: The role of Senior Data Platform Engineer focuses on designing and building end-to-end data pipelines using Lakehouse architecture, with a strong emphasis on Python and Spark workloads. The position is fully remote and requires collaboration with various stakeholders to deliver reliable analytics solutions. Candidates should possess extensive experience in data engineering, particularly with Azure services and Databricks. The role also involves mentoring and providing technical guidance as a senior contributor.
Key Responsibilities:
- Design and build end-to-end data pipelines across ingestion, transformation, and serving layers using a Lakehouse architecture.
- Develop and optimize production-grade Python and Spark workloads for large-scale analytics.
- Model data structures, schemas, and lineage to support reliable analytics and reporting.
- Implement and maintain CI/CD pipelines for automated testing, deployment, and release.
- Ensure high code quality through testing, reviews, and engineering best practices.
- Monitor, troubleshoot, and improve data pipelines with strong observability and alerting.
- Collaborate with product, analytics, and business stakeholders on data solutions.
- Provide ad hoc mentoring and technical guidance as a senior individual contributor.
Key Skills:
- 5+ years of professional experience in Python-based data engineering.
- 2+ years of hands-on experience with Databricks and Lakehouse architectures.
- Strong experience in Azure data services (e.g. ADLS, Databricks, Storage).
- Solid understanding of data modeling, warehousing, and analytics concepts.
- Proven experience with CI/CD, Git-based workflows, and release automation.
- Experience designing and owning technical solutions end to end.
- Ability to work independently in a distributed, remote-first environment.
- Excellent English communication skills.
- Experience in regulated or enterprise environments is a strong plus.
Salary (Rate): undetermined
City: undetermined
Country: undetermined
Working Arrangements: remote
IR35 Status: undetermined
Seniority Level: undetermined
Industry: IT
Looking to start a new challenge as a freelancer? Get in touch now. Full remote role. CET working hours. You must be able to work B2B in your country of residence.
What you will do
- Design and build end-to-end data pipelines across ingestion, transformation, and serving layers using a Lakehouse architecture
- Develop and optimize production-grade Python and Spark workloads for large-scale analytics
- Model data structures, schemas, and lineage to support reliable analytics and reporting
- Implement and maintain CI/CD pipelines for automated testing, deployment, and release
- Ensure high code quality through testing, reviews, and engineering best practices
- Monitor, troubleshoot, and improve data pipelines with strong observability and alerting
- Collaborate with product, analytics, and business stakeholders on data solutions
- Provide ad hoc mentoring and technical guidance as a senior individual contributor
What you bring
- 5+ years of professional experience in Python-based data engineering
- 2+ years of hands-on experience with Databricks and Lakehouse architectures
- Strong experience in Azure data services (e.g. ADLS, Databricks, Storage)
- Solid understanding of data modeling, warehousing, and analytics concepts
- Proven experience with CI/CD, Git-based workflows, and release automation
- Experience designing and owning technical solutions end to end
- Ability to work independently in a distributed, remote-first environment
- Excellent English communication skills
- Experience in regulated or enterprise environments is a strong plus
Interested? Apply immediately!
myNEBIRU : Not into this role, but interested in what NEBIRU does? That’s totally fine. Visit to see how we can support you - even outside our client missions. Let’s build the bridge to your next step, together.