About Getting Started
A Go-based MCP server example used to test LiteLLM’s MCP implementation alongside MCP clients and servers. It includes setup and run instructions for the server, Go client, and LiteLLM bridges.
Key features
- 01Go MCP server over SSE
- 02Go MCP client using SSE or HTTP
- 03LiteLLM SDK client test scripts
Use cases
- 01Testing LiteLLM MCP connectivity
- 02Trying Go client connections to MCP endpoints
MCP support
The project provides a Go MCP server and client, and scripts for testing LiteLLM MCP clients and proxy connections.
Configuration
Local server config is the same for every client. Copy it into your client’s MCP config file.
We haven’t collected a package or remote endpoint for this server. Follow the instructions in the project README.
Tools
Local servers expose tools only once running on your machine, and the maintainer has not provided a tool list.
Details
From the project READMEGetting Started
This project tests the initial LiteLLM MCP implementation with a few other MCP servers and clients. In particular the go-based mcp server and client from mark3labs
Requirements
You need to have the following installed
- go 1.24.1
- uv
Setup deps
uv venv --python 3.13
source .venv/bin/activate # windows -- source .venv/Scripts/active
uv pip install -r requirements.txt
# cd into each and install dependencies
cd client;go mod download; cd ..
cd server; go mod download; cd ..
Setup litellm proxy
Or via docker
docker compose up
Running MCP Go server
cd server
go mod download
go run main.go -t sse -p 8080 # transport over http network with port 8080
Running MCP Go client
# run go mcp server first on sse transport
cd client
go run main.go -t sse -mcpUri 'http://localhost:8080/sse' # connect to mcp server on uri
go run main.go -t http -mcpUri 'http://localhost:3000/mcp' # connect to http mcp server on uri
Testing Litellm sdk MCP client
# run go mcp server first on sse transport
# run client
cd bridge
python litellm_client.py
Testing python sdk on LiteLLM Proxy MCP
# run go litellm proxy
docker compose up
# run client
cd bridge
python mcp_client.py
# Initializing session...
# Session initialized
# Loading tools...
# Loaded 1 tools
# meta=None content=[TextContent(type='text', text='13:04', annotations=None)] isError=Fals
Testing Go client on LiteLLM proxy MCP
# run go litellm proxy
docker compose up
cd bridge
go run main.go -mcpUri http://localhost:4000/mcp
# 2025/03/29 06:02:11 Connected to server with name litellm-mcp-server
# 2025/03/29 06:02:11 Ping successful
# 2025/03/29 06:02:11 Found 1 tools
# 2025/03/29 06:02:11 Tool: get_current_time
# 2025/03/29 06:02:11 Calling get_current_time tool
# 2025/03/29 06:02:11 Result: 13:02
Comments
New to MCP?
From what the protocol is to installing your first server, these answers cover most first questions.
An open protocol that defines how AI applications connect to external tools and data in a uniform way. Clients talk to the model; MCP servers provide tools, resources and prompt templates. They exchange standard messages, so one server can be reused by many clients.