Data Engineer
Posted 1 day ago by iXceed Solutions
Negotiable
Undetermined
Hybrid
Northampton, England, United Kingdom
Summary: The Senior Data Engineer role in Northampton, UK, focuses on designing and optimizing scalable data pipelines and cloud-based solutions using Big Data technologies and AWS services. The position requires hands-on experience with PySpark, Python, SQL, and various AWS data services, while working in a fast-paced Agile environment. The ideal candidate will also engage in collaboration with stakeholders to resolve data issues and ensure high performance across data systems.
Key Responsibilities:
- Design, develop, and maintain scalable data pipelines using PySpark and Spark.
- Develop high-quality code using Python and SQL for data processing and transformation.
- Build and manage AWS-based data solutions using services such as Glue, CloudFormation, Lake Formation, IAM, Lambda, and Redshift.
- Work with cloud data platforms such as Snowflake and Redshift.
- Support and integrate streaming technologies like Apache Flink and Apache Kafka.
- Translate business requirements into robust technical solutions aligned with project quality standards.
- Collaborate with upstream and downstream stakeholders to identify, troubleshoot, and resolve data issues.
- Participate actively in Agile ceremonies including daily stand-ups, sprint planning, reviews, and retrospectives.
- Ensure high standards of performance, scalability, and reliability across data systems.
- Stay updated with emerging technologies and industry trends in data engineering and cloud development.
Key Skills:
- 6–8+ years of experience as a Data Engineer / Senior Data Engineer.
- Strong hands-on experience with Big Data technologies (PySpark, Spark).
- Proficiency in Python and SQL.
- Experience working with AWS services: Glue, CloudFormation, Lake Formation, IAM, Lambda, Redshift.
- Exposure to Snowflake, Apache Flink, and Apache Kafka.
- Strong analytical and problem-solving skills.
- Experience working in Agile/Scrum environments.
- Excellent verbal and written communication skills.
- Experience working in global delivery environments.
Salary (Rate): undetermined
City: Northampton
Country: United Kingdom
Working Arrangements: hybrid
IR35 Status: undetermined
Seniority Level: undetermined
Industry: IT
Role Title: Senior Data Engineer
Location: Northampton, UK (Hybrid – 2 days onsite per week)
Contract Duration: 6 Months
Role Overview
We are seeking an experienced Senior Data Engineer with strong expertise in Big Data technologies and AWS cloud services. The ideal candidate will be responsible for designing, developing, and optimizing scalable data pipelines and cloud-based data solutions in a fast-paced Agile environment. This role requires hands-on experience in PySpark, Python, SQL, and AWS data services, along with exposure to modern cloud and streaming technologies.
Key Responsibilities
- Design, develop, and maintain scalable data pipelines using PySpark and Spark.
- Develop high-quality code using Python and SQL for data processing and transformation.
- Build and manage AWS-based data solutions using services such as Glue, CloudFormation, Lake Formation, IAM, Lambda, and Redshift.
- Work with cloud data platforms such as Snowflake and Redshift.
- Support and integrate streaming technologies like Apache Flink and Apache Kafka.
- Translate business requirements into robust technical solutions aligned with project quality standards.
- Collaborate with upstream and downstream stakeholders to identify, troubleshoot, and resolve data issues.
- Participate actively in Agile ceremonies including daily stand-ups, sprint planning, reviews, and retrospectives.
- Ensure high standards of performance, scalability, and reliability across data systems.
- Stay updated with emerging technologies and industry trends in data engineering and cloud development.
Required Skills & Experience
- 6–8+ years of experience as a Data Engineer / Senior Data Engineer.
- Strong hands-on experience with Big Data technologies (PySpark, Spark).
- Proficiency in Python and SQL.
- Experience working with AWS services: Glue, CloudFormation, Lake Formation, IAM, Lambda, Redshift.
- Exposure to Snowflake, Apache Flink, and Apache Kafka.
- Strong analytical and problem-solving skills.
- Experience working in Agile/Scrum environments.
- Excellent verbal and written communication skills.
- Experience working in global delivery environments.