將 LiteLLM 連接至 Open Flow

Choose a model, draft a response, or turn text into vectors while checking the limits available to your key.

每月 20,000 次免費應用程式呼叫(付費服務另計)

應用程式介紹和工具詳情以英文提供。

可以做什麼

Connect your LiteLLM gateway to use chat and message models, generate embeddings, compare model capabilities and prices, and inspect key spending.

Generate content and vectors

Call chat, message, and embedding models.

Inspect model access and budgets

Read model names, capabilities, pricing, and virtual-key spending.

所有工具

6 個工具

Create Chat Completion

Create a chat completion through the LiteLLM proxy's OpenAI-compatible `/v1/chat/completions` endpoint. LiteLLM routes the request to whichever upstream provider serves the model, with its load balancing, fallbacks, and budget checks applied.

litellm.create_chat_completion

Create Message

Create an Anthropic-format message through the LiteLLM proxy's `/v1/messages` endpoint, for any model the proxy serves.

litellm.create_message

Create Embedding

Create embeddings through the LiteLLM proxy's OpenAI-compatible `/v1/embeddings` endpoint.

litellm.create_embedding

List Models

List the model names this LiteLLM key can call.

litellm.list_models

Get Model Info

Read the context window, output limit, per-token pricing, and capabilities LiteLLM reports for each model deployment, so an agent can pick a model before calling it.

litellm.get_model_info

Get Key Info

Read the spend, remaining budget, rate limits, and allowed models of the LiteLLM virtual key used by this connection. The proxy master key has no stored record, so this action needs a virtual key.

litellm.get_key_info

將 LiteLLM 連接至 Open Flow

連接 LiteLLM

每月 20,000 次免費應用程式呼叫(付費服務另計)