mirror of
https://github.com/decolua/9router.git
synced 2026-05-08 12:01:28 +00:00
5c62e73cc6
- BaseUrlSelect: add cloud endpoint option, custom URL local state, always default to first option; new cliEndpointMatch helper; CLI tool cards refactor - API: new /v1/audio/voices and /v1/models/info; /v1/models filters disabled models, drop unused timestamp - initializeApp: guard tunnel/tailscale auto-resume to once-per-process - geminiHelper: ensureObjectType for schemas with properties but no type - skills: minor SKILL.md tweaks (chat/embeddings/image/stt/tts/web-*)
74 lines
2.4 KiB
Markdown
74 lines
2.4 KiB
Markdown
---
|
|
name: 9router-web-fetch
|
|
description: Fetch URL → markdown / text / HTML via 9Router /v1/web/fetch using Firecrawl / Jina Reader / Tavily Extract / Exa Contents. Use when the user wants to scrape a webpage, extract URL content, read article, or convert a URL to markdown.
|
|
---
|
|
|
|
# 9Router — Web Fetch
|
|
|
|
Requires `NINEROUTER_URL` (and `NINEROUTER_KEY` if auth enabled). See https://raw.githubusercontent.com/decolua/9router/refs/heads/master/skills/9router/SKILL.md for setup.
|
|
|
|
## Discover
|
|
|
|
```bash
|
|
curl $NINEROUTER_URL/v1/models/web | jq '.data[] | select(.kind=="webFetch") | .id'
|
|
# Per-provider params
|
|
curl "$NINEROUTER_URL/v1/models/info?id=firecrawl/fetch"
|
|
```
|
|
|
|
IDs end in `/fetch` (e.g. `firecrawl/fetch`, `jina/fetch`). `fetch-combo` chains providers with auto-fallback.
|
|
|
|
## Endpoint
|
|
|
|
`POST $NINEROUTER_URL/v1/web/fetch`
|
|
|
|
| Field | Required | Notes |
|
|
|---|---|---|
|
|
| `model` (or `provider`) | yes | from `/v1/models/web` (`firecrawl/fetch` or `firecrawl`) |
|
|
| `url` | yes | URL to extract |
|
|
| `format` | no | `markdown` (default) / `text` / `html` |
|
|
| `max_characters` | no | truncate output |
|
|
|
|
## Examples
|
|
|
|
```bash
|
|
curl -X POST $NINEROUTER_URL/v1/web/fetch \
|
|
-H "Authorization: Bearer $NINEROUTER_KEY" \
|
|
-H "Content-Type: application/json" \
|
|
-d '{"model":"jina/fetch","url":"https://9router.com","format":"markdown"}'
|
|
```
|
|
|
|
JS:
|
|
|
|
```js
|
|
const r = await fetch(`${process.env.NINEROUTER_URL}/v1/web/fetch`, {
|
|
method: "POST",
|
|
headers: { "Authorization": `Bearer ${process.env.NINEROUTER_KEY}`, "Content-Type": "application/json" },
|
|
body: JSON.stringify({ model: "fetch-combo", url: "https://example.com", format: "markdown", max_characters: 5000 }),
|
|
});
|
|
const { data } = await r.json();
|
|
console.log(data.title, data.content.length);
|
|
```
|
|
|
|
## Response shape
|
|
|
|
```json
|
|
{
|
|
"provider": "jina-reader",
|
|
"url": "...",
|
|
"title": "...",
|
|
"content": { "format": "markdown", "text": "...", "length": 1234 },
|
|
"metadata": { "author": null, "published_at": null, "language": null },
|
|
"usage": { "fetch_cost_usd": 0 },
|
|
"metrics": { "response_time_ms": 850, "upstream_latency_ms": 700 }
|
|
}
|
|
```
|
|
|
|
## Provider quirks
|
|
|
|
| Provider | Auth | Best for |
|
|
|---|---|---|
|
|
| `firecrawl` | Bearer | JS-rendered pages, `format=markdown/html` |
|
|
| `jina-reader` | Bearer (optional) | Free tier (~1M chars/mo); fastest plain markdown |
|
|
| `tavily` | Bearer | Bulk extract; returns `raw_content` |
|
|
| `exa` | `x-api-key` | Pre-indexed pages; fast text extraction |
|