Extract

For AI agents: docs.octen.ai/capabilities/extract.md

​

Why Extract

• Read what the task points to. A pasted link, a cited source, a referenced doc: when the task names the page, the agent has to read that exact URL.
• Ingest knowledge. Turn a known set of URLs, such as docs, wikis, and blogs, into clean text for RAG indexing.
• Keep answers current. Re-read the specific pages that matter, such as pricing pages, docs, and changelogs, whenever they change.

​

Why Octen

• LLM-ready clean markdown. Every page parses into structured markdown, ready to drop into RAG pipelines and agents.
• Intelligent content parsing. Octen recognizes the page type and structure automatically, and extracts the main content precisely.
• Multimodal asset extraction. One request returns the text plus the page’s images, videos, and audio, made for multimodal agents and RAG.
• Success-only billing. Up to 20 URLs per request, each succeeding or failing independently, and only successful URLs are billed.

​

How It Works

1. Send up to 20 URLs.
2. Octen fetches each page and strips it to the main content.
3. The response returns one result per URL, with its content and a success or failure status.

​

Scenarios

​

Read pages

curl -X POST https://api.octen.ai/extract \
  -H "Content-Type: application/json" \
  -H "x-api-key: YOUR_API_KEY" \
  -d '{
    "urls": ["https://example.com/article", "https://example.com/report"],
    "format": "markdown"
  }'

​

Extract only the relevant parts

{
  "urls": ["https://example.com/annual-report"],
  "query": "revenue growth and guidance"
}

​

Force fresh content

{
  "urls": ["https://example.com/live-blog"],
  "max_age_seconds": 300
}

​

Collect media

{
  "urls": ["https://example.com/gallery"],
  "include_images": true,
  "include_videos": true,
  "include_audio": true
}

​

Next Steps