Mediabistro logo
job logo

DevOps Engineer (AI Platform with LLM Exp)

Virtusa, Indianapolis, IN, United States


DevOps Engineer (AI Platform with LLM Exp)
Location: Indianapolis, Indiana, United States

This role focuses on the implementation and operation of our AI platform. The engineer will handle LLM model onboarding configurations, manage deployments using Helm and ArgoCD, and help maintain CI/CD pipelines.

Key responsibilities and skills:

LLM model onboarding configurations

Deployment management with Helm and ArgoCD (GitOps)

CI/CD pipeline maintenance

LLM integration fundamentals (API familiarity, tokens, TPM/RPM limits, context windows, model versioning)

Programming in Python for gateway configurations, hooks, and custom callbacks

Working knowledge of Kubernetes, Docker, and YAML-based configuration management

Experience with AWS/cloud deployment

Helm, ArgoCD, GitOps, Docker, and CI/CD pipeline development

Qualifying experience includes a basic to high-level understanding of LLM integration and relevant cloud deployment expertise.

Virtusa is an Equal Opportunity Employer
All applicants will receive fair and impartial treatment without regard to race, color, religion, sex, national origin, ancestry, age, legally protected physical or mental disability, protected veteran status, status in the U.S. uniformed services, sexual orientation, gender identity or expression, marital status, genetic information or on any other basis which is protected under applicable federal, state or local law.

#J-18808-Ljbffr