mirror of
https://github.com/decolua/9router.git
synced 2026-05-08 12:01:28 +00:00
5c62e73cc6
- BaseUrlSelect: add cloud endpoint option, custom URL local state, always default to first option; new cliEndpointMatch helper; CLI tool cards refactor - API: new /v1/audio/voices and /v1/models/info; /v1/models filters disabled models, drop unused timestamp - initializeApp: guard tunnel/tailscale auto-resume to once-per-process - geminiHelper: ensureObjectType for schemas with properties but no type - skills: minor SKILL.md tweaks (chat/embeddings/image/stt/tts/web-*)
74 lines
2.5 KiB
Markdown
74 lines
2.5 KiB
Markdown
---
|
|
name: 9router-chat
|
|
description: Chat / code generation via 9Router using OpenAI /v1/chat/completions or Anthropic /v1/messages format with streaming + auto-fallback combos. Use when the user wants to ask an LLM, generate code, summarize text, or run prompts through 9Router.
|
|
---
|
|
|
|
# 9Router — Chat
|
|
|
|
Requires `NINEROUTER_URL` (and `NINEROUTER_KEY` if auth enabled). See https://raw.githubusercontent.com/decolua/9router/refs/heads/master/skills/9router/SKILL.md for setup.
|
|
|
|
## Endpoints
|
|
|
|
- `POST $NINEROUTER_URL/v1/chat/completions` — OpenAI format
|
|
- `POST $NINEROUTER_URL/v1/messages` — Anthropic format
|
|
|
|
## Discover
|
|
|
|
```bash
|
|
curl $NINEROUTER_URL/v1/models | jq '.data[].id'
|
|
# Per-model metadata (contextWindow, params)
|
|
curl "$NINEROUTER_URL/v1/models/info?id=openai/gpt-4o"
|
|
```
|
|
|
|
Combos (e.g. `vip`, `mycodex`) auto-fallback through multiple providers.
|
|
|
|
## OpenAI format
|
|
|
|
```bash
|
|
curl -X POST $NINEROUTER_URL/v1/chat/completions \
|
|
-H "Authorization: Bearer $NINEROUTER_KEY" \
|
|
-H "Content-Type: application/json" \
|
|
-d '{"model":"openai/gpt-5","messages":[{"role":"user","content":"Hi"}],"stream":false}'
|
|
```
|
|
|
|
JS (OpenAI SDK):
|
|
|
|
```js
|
|
import OpenAI from "openai";
|
|
const client = new OpenAI({ baseURL: `${process.env.NINEROUTER_URL}/v1`, apiKey: process.env.NINEROUTER_KEY });
|
|
const res = await client.chat.completions.create({
|
|
model: "openai/gpt-5",
|
|
messages: [{ role: "user", content: "Hi" }],
|
|
stream: true,
|
|
});
|
|
for await (const chunk of res) process.stdout.write(chunk.choices[0]?.delta?.content || "");
|
|
```
|
|
|
|
## Anthropic format
|
|
|
|
```bash
|
|
curl -X POST $NINEROUTER_URL/v1/messages \
|
|
-H "Authorization: Bearer $NINEROUTER_KEY" \
|
|
-H "anthropic-version: 2023-06-01" \
|
|
-H "Content-Type: application/json" \
|
|
-d '{"model":"cc/claude-opus-4-7","max_tokens":1024,"messages":[{"role":"user","content":"Hi"}]}'
|
|
```
|
|
|
|
## Response shape
|
|
|
|
OpenAI (`/v1/chat/completions`):
|
|
```json
|
|
{ "id": "chatcmpl-...", "object": "chat.completion", "model": "openai/gpt-5",
|
|
"choices": [{ "index": 0, "message": { "role": "assistant", "content": "Hello!" }, "finish_reason": "stop" }],
|
|
"usage": { "prompt_tokens": 8, "completion_tokens": 2, "total_tokens": 10 } }
|
|
```
|
|
|
|
Streaming (`stream:true`) emits SSE: `data: {choices:[{delta:{content:"..."}}]}\n\n` ... `data: [DONE]\n\n`.
|
|
|
|
Anthropic (`/v1/messages`):
|
|
```json
|
|
{ "id": "msg_...", "type": "message", "role": "assistant", "model": "cc/claude-opus-4-7",
|
|
"content": [{ "type": "text", "text": "Hello!" }],
|
|
"stop_reason": "end_turn", "usage": { "input_tokens": 8, "output_tokens": 2 } }
|
|
```
|