ML/Feature Store Engineer (Advanced Analytics)
Posted 4 days ago by Digitech Services
Negotiable
Undetermined
Remote
Remote
Summary: The ML/Feature Store Engineer will design and implement feature engineering pipelines for L2 and L3 Lighthouse AI Agents, focusing on deriving metrics and predictive features from the Medallion Lakehouse. This role emphasizes low-latency feature serving through an enterprise Feature Store. Collaboration with data scientists and ensuring the reliability of computed features is crucial. The engineer will also monitor feature performance to maintain model accuracy.
Key Responsibilities:
- Develop and maintain the enterprise Feature Store (e.g., Feast, Databricks Feature Store) for batch and real-time features.
- Collaborate with data scientists to operationalize machine learning models and compute features reliably.
- Build automated pipelines to extract features from the Gold layer of the Lakehouse and the Enterprise Knowledge Graph.
- Implement feature monitoring to detect data drift and ensure ongoing model accuracy.
- Work closely with the API & Security Engineer to expose features securely to the agent tier.
Key Skills:
- 4+ years of experience in data engineering or machine learning engineering.
- Hands-on experience with Feature Store technologies (Feast, Databricks Feature Store, or similar).
- Strong proficiency in Python, SQL, and Apache Spark.
- Experience operationalizing ML models (MLOps) and building scalable data pipelines.
- Familiarity with graph databases and extracting features from graph structures.
- Solid understanding of data quality monitoring and drift detection techniques.
Salary (Rate): undetermined
City: undetermined
Country: USA
Working Arrangements: remote
IR35 Status: undetermined
Seniority Level: undetermined
Industry: IT
Detailed Description From Employer:
Role: ML/Feature Store Engineer (Advanced Analytics)
Location: Remote, USA
Contract Position
Role Summary:
The ML/Feature Store Engineer will design and implement the feature engineering pipelines that feed the L2 and L3 Lighthouse AI Agents. This role focuses on computing derived metrics, risk scores, and predictive features from the Medallion Lakehouse and serving them with low latency via an enterprise Feature Store.
Key Responsibilities:
The ML/Feature Store Engineer will develop and maintain the enterprise Feature Store (e.g., Feast, Databricks Feature Store) to serve both batch and real-time features to the AI agents. They will collaborate with data scientists to operationalize machine learning models, ensuring that features like supplier risk scores, EAC variance predictions, and skills gap metrics are computed reliably. Building automated pipelines to extract features from the Gold layer of the Lakehouse and the Enterprise Knowledge Graph is a primary responsibility. They will also implement feature monitoring to detect data drift and ensure the ongoing accuracy of the models. Working closely with the API & Security Engineer is necessary to expose these features securely to the agent tier.
Required Skills & Qualifications:
Candidates must have 4+ years of experience in data engineering or machine learning engineering. Hands-on experience with Feature Store technologies (Feast, Databricks Feature Store, or similar) is required. Strong proficiency in Python, SQL, and Apache Spark is essential. Experience operationalizing ML models (MLOps) and building scalable data pipelines is expected. Familiarity with graph databases and extracting features from graph structures is highly desired. A solid understanding of data quality monitoring and drift detection techniques is necessary.