Manual API Reference Help & Troubleshooting

API Reference

Note: This is a quick reference of common endpoints. For the complete API reference, see docs/API.md in the repository.

OpenAI Compatible

MethodEndpointDescription
GET/v1/modelsList available models
POST/v1/chat/completionsChat completion (streaming)
POST/v1/messagesMessages-style completion

Ollama Compatible

MethodEndpointDescription
GET/api/tagsList all models
POST/api/chatChat completion
POST/api/generateText generation
POST/api/showModel info
GET/api/psLoaded models

Mesh Native

MethodEndpointDescription
GET/healthMesh status
GET/nodesAll nodes with models
GET/modelsModel list
POST/chatMesh routing
POST/pullDownload model

Chat Completion Example

OpenAI-compatible request:

curl -X POST http://localhost/v1/chat/completions \
  -H 'Content-Type: application/json' \
  -d '{
    "model": "llama3.1:8b",
    "messages": [{"role": "user", "content": "hello"}],
    "stream": true
  }'

Model Aliases

Use these names to route to the best available model: