Skip to main content
50% off all plans, limited time. Starting at $2.48/mo
LiteLLM

LiteLLM

LiteLLM is an AI gateway that calls 100+ LLM APIs in OpenAI format, with cost tracking, load balancing, guardrails, and logging. One base URL covers Bedrock, Azure, Anthropic, VertexAI, and vLLM. 56,700+ GitHub stars.

At a glance

Version 1.95.1 OS Ubuntu Server 24.04 LTS Min RAM 2 GB IP IPV4,IPV6

Access

Open the LiteLLM dashboard: http://<SERVER_IP>:4000/ui

Log in with:

  • Username: admin
  • Password: LITELLM_MASTER_KEY from /root/litellm/.env

Retrieve the password:

grep '^LITELLM_MASTER_KEY=' /root/litellm/.env

Important Files & Directories

  • Install Path: /root/litellm
  • Compose File: /root/litellm/docker-compose.yml
  • Environment File: /root/litellm/.env
  • PostgreSQL Data: /var/lib/docker/volumes/litellm_postgres_data

Docker Management

View status:

docker ps

View logs:

cd /root/litellm
docker compose logs -f

Restart services:

cd /root/litellm
docker compose restart

Stop services:

cd /root/litellm
docker compose down

Start services:

cd /root/litellm
docker compose up -d

More in Self Hosted

Related apps.

Deploy LiteLLM now. From $2.48/mo.