LLM Deployment
Advanced3 daysGroups from 3$50 a person
About this training
Serve open language models in production, and keep them fast, affordable and observable.What you'll be able to do
- Deploy an open model behind an API
- Measure and tune latency and cost
- Set up monitoring and a rollback path
Outline
3 days of 2 h 10 min- Day 1Serving optionsHosted versus self-hosted; Packaging a model behind an API.
- Day 2Scale, latency and costBatching and caching; Autoscaling; Cost per request.Lab: Load-test a deployed model
- Day 3Monitoring and rolloutEvaluation in production; Safe rollout and rollback.Lab: Ship a model with monitoring in place
How it runs
- Live online, on the platform, at a time your group picks. In person at your office on request.
- Every session is recorded, so nobody misses anything.
- A certificate for everyone who completes the training.