DevOps Engineer (AI Platform with LLM Exp)
Virtusa, Indianapolis, IN, United States
Job Description - DevOps Engineer (AI Platform with LLM Exp) (CREQ253017)
This role would be more on the implementation side focusing on implementing and operating the platform. They will handle LLM model onboarding configs, manage deployments using Helm/ArgoCD. They will also help maintain CI/CD pipelines.
Key Skills
Basic to high level understanding of LLM integration
LLM fundamentals: LLM API familiarity (understanding tokens, TPM/RPM limits, context windows, model versioning)
Programming Python (for gateway configurations, hooks, and custom callbacks)
Working knowledge of Kubernetes
Helm and ArgoCD / GitOps experience
Docker and CI/CD pipelines
AWS/cloud deployment exposure
YAML-based configuration management
#J-18808-Ljbffr
This role would be more on the implementation side focusing on implementing and operating the platform. They will handle LLM model onboarding configs, manage deployments using Helm/ArgoCD. They will also help maintain CI/CD pipelines.
Key Skills
Basic to high level understanding of LLM integration
LLM fundamentals: LLM API familiarity (understanding tokens, TPM/RPM limits, context windows, model versioning)
Programming Python (for gateway configurations, hooks, and custom callbacks)
Working knowledge of Kubernetes
Helm and ArgoCD / GitOps experience
Docker and CI/CD pipelines
AWS/cloud deployment exposure
YAML-based configuration management
#J-18808-Ljbffr