← All projects

Own research infrastructure

Paperbase

built, no external users

Own research infrastructure. It answers this author's agents over MCP and is not offered to anyone else.

Own research infrastructure

An agent cannot tell you whether your idea is already published.

An index of AI research that keeps itself current, which an agent queries through nine tools over MCP. The pipeline works down a venue roster, pulls each paper's metadata, fetches the arXiv PDF and extracts the full text, so a phrase buried in a body paragraph is findable. A paper outside the index comes back as a visible stub that one call will ingest.

End to end47 seconds, one pass
paperbase / full run

One pass: a query over the corpus, the paper opened at the matching passage, its citation graph walked, and a missing paper pulled in.

Delivered interface
paperbase / search_papers

A regex query over the full text returns ranked hits with the matching phrase in its own sentence, scored and dated, in well under a second.

Illustrative product mockup: the tool names, the result shape and the corpus figures are real, and so are the papers on screen, though they were chosen to show the behaviour and not transcribed from a single run.

Impact

159,815
AI papers indexed
106,263
of them with full text extracted
9
query tools exposed over MCP
10
core venues swept, 2018 onward

Delivered

Resumable ETL+

DBLP roster to OpenAlex and Semantic Scholar metadata to the arXiv PDF to pymupdf4llm full text. A killed run continues from a durable cursor and a per-paper stage ledger rather than starting over.

Conservative dedup+

An alias crosswalk, a normalised soft key and cluster-merge, so the same paper arriving from three providers lands once. Every ingest is idempotent.

Pluggable retrieval+

Trigrep, a lexical trigram and regex engine, is the configured default; FTS5 gives SQLite BM25 with no binary to install. The strategy is a config value, not a rewrite.

Agent surface+

An MCP server exposing nine tools: search, get, read, find_related, list_venue, coverage, references, cited_by and add_paper. It also ships a paper-research skill.