Job Description
Summary
The Al/Ml ops Engineer supports deployment, scaling, and operational reliability of machine learning systems, including LLMs, vector databases, and orchestration frameworks across cloud, hybrid, and on-prem environments.
Key Responsibilities
- Set up and manage runtime environments for LLMs, vector DBs, and orchestration flows.
- Support deployments across cloud, hybrid, and client-hosted infrastructures.
- Containerize systems using Docker and Kubernetes and manage inference scaling.
- Integrate observability tooling including prompt tracing, logs, and evaluation hooks.
- Collaborate on RAG stack deployments including retrievers, rankers, and toolchains.
- Support CI/CD pipelines, secrets management, and configuration management.
- Contribute to platform-level accelerators and infrastructure assets.
- Ensure systems meet compliance, governance, and audit expectations.
Required Qualifications
- 4–7 years of experience in DevOps, MLOps, platform engineering, or cloud infrastructure.
- Strong experience with Docker, Kubernetes, API hosting, and cloud-native services.
- Experience with vector DBs such as FAISS, Pinecone, or Weaviate.
- Familiarity with logging frameworks, APM tools, tracing, and versioning logs.
- Exposure to LangChain, LangGraph, LLM APIs, and retrieval architectures is a plus.
- Strong debugging skills and ability to work across cloud and hybrid environments.
Tech Stack
Docker, Kubernetes, Vector DBs (FAISS, Pinecone, Weaviate), LangChain, LangGraph, LLM APIs, Observability tools.
Compensation & Benefits
Competitive compensation aligned with market standards.
Health benefits, PTO, remote flexibility (varies by client).
Work Schedule
Monday–Friday, flexible hours, occasional on-call if applicable.
About the Client
Our client is a growing technology-focused organization committed to building scalable digital solutions.
Why Join the Team?
- Opportunity to work on advanced MLOps and AI platform engineering.
- Exposure to enterprise-grade AI/ML deployments.
- Collaborative environment with strong technical leadership.
How to Apply
Submit your resume to people@ignitetalentpartners.com. Shortlisted candidates will be contacted.