OPEN SOURCE · SELF-HOSTED · TRUSTED WEB DATA

Extrio.

Web data. With proof.

AI understands the page. You approve the rule. Every run is deterministic. Every item has a story.

v0.6 PUBLIC ALPHA
PIPELINE CONCEPT · NOT LIVE DATA

Execute the frozen rule. No LLM at runtime.

Apache-2.0 licensedNo LLM at runtimeEd25519-signed rulesYour infrastructure. Your data.

01 / THE PHILOSOPHY

Intelligence at the start.
Certainty in every run.

Websites change. Models are probabilistic. Your data pipeline should not be a black box. Extrio separates discovery from execution, with an explicit boundary at every step.

01 / EXPLORE

Let AI explore. Not improvise.

AI builds a constrained RulePlan from list and detail samples. The server validates and compiles it into extraction rules, never arbitrary model-generated code.

Page samples → RulePlan → GatherSpec
02 / REVIEW

Evidence before execution.

Review fields, selectors, and sample validation together. A human approves publication. The immutable rule version is bound to its review with an Ed25519 signature.

Candidate → Human review → Frozen version
03 / RUN

A trace behind every item.

Runs pin a rule and data contract, recording quality decisions, checkpoints, and lineage. Site changes produce new candidates for review, never silent rule mutations.

Frozen rule → Deterministic run → Evidence

Not another crawler. A reviewable, repeatable, traceable way to work with web data.

THE EXTRIO WAY

02 / THE WORKSPACE

From collection intent to item-level evidence.

A desktop workspace built for data operations. Rules, runs, and results stay connected, so the important questions do not disappear into logs.

Read the docs
EXTRIO CONSOLE / v0.6
Collected results and unconfirmed source coverage are reported separately and honestly.

Collected results and unconfirmed source coverage are reported separately and honestly.

FIG. 02

REAL LOCAL REVIEW CAPTURES · CHINESE CONSOLE · NOT A LIVE DEMO OR BENCHMARK

For teams that need to explain their data

Tender intelligenceRegulatory noticesPublic announcements

03 / UNDER THE HOOD

No black-box magic.
Just a well-defined pipeline.

The control plane accepts intent. Independent workers do the work. AI helps generate rules; production runs follow the reviewed contract.

SINGLE-INSTANCE / v0.6
CONTROL PLANE

React + FastAPI

Auth · Contracts · Durable commands · Operation state

/api/v1
202 Accepted · Operation → Job lease
INDEPENDENT WORKERHuman review / Ed25519 signature
01

Page samples

Crawl4AI

Public or authorized list/detail sources

02

Constrained compilation

RulePlan → GatherSpec

Model plans. Server validates.

03

Frozen rule version

RuleVersion

Immutable, after human approval

Shared persistenceSQLite / PostgreSQL · Durable job leases · File artifacts & keys
Downstream interfacesOpenAPI · Webhook · Governed MCP

Exploration and rule compilation use a model. Human approval is a mandatory publication boundary.

Current single-instance topology. Distributed high availability and multi-tenancy are not current release claims.

Explore the architecture
BUILT FOR THE AGENT ECOSYSTEM

Agents can use the data. Not bypass the review.

MCP exposes Extrio as a governed data tool. Agents can queue collection requests for review, trigger published rules, and query results with lineage. They cannot publish rules.

Explore MCP integration
EXTRIO / MCP7 TOOLS
create_collectionhuman review
trigger_runpublished rules
query_itemswith lineage
publish_rulehuman only

04 / BUILT IN THE OPEN

Trust begins with something you can inspect.

Read the code, the contracts, and the decisions. We would rather publish our boundaries and verification evidence than make promises you cannot reproduce.

APACHE2.0Free to use, modify, and contribute.
Available

Self-hosted Public Alpha

AI rule generation and repair, human publication, deterministic collection, evidence export, Webhook, and MCP.

Validating

Real-world reliability

Cross-site compatibility, browser-rendered sources, and drift recovery. Current evidence is primarily repository tests and local reviews.

Target

Single-organization 1.0

Focused on sustained operation and experience acceptance for real teams. Hosted evaluation, public benchmarks, and multi-tenant hardening remain on the roadmap.

05 / YOUR DATA. YOUR INFRASTRUCTURE.

Your next trusted dataset.
Starts on your terms.

Clone the source. Run it on your infrastructure. No hosted account required. No opaque service between you and your pipeline.

terminal
git clone https://github.com/iiwish/extrio.gitcd extriodocker compose up --build

Requires Git and Docker Compose. Create your instance administrator at 127.0.0.1:8080. Read the security and self-hosting guides before exposing the service.

 

Self-hosted public alpha. Not a hardened multi-tenant service.