This page documents AI Studio, our development environment for notebooks, jobs and deployments. Saturn Cloud also offers dedicated inference endpoints built with NVIDIA DSX. Talk to us about dedicated GPU capacity.

LLM Inference vLLM 7B

Run a 7B instruction model with vLLM for efficient token throughput

Use this template to launch a standard OpenAI-compatible endpoint with vLLM.