AI Inference API
Open-source LLMs served locally
Local Embeds —
Loading...
V100 cluster —
Loading...
Workstation —
Loading...
POST /v1/chat/completions · OpenAI-compatible · requires API key
Checking...
PostgreSQL · LiteLLM backend database · —