Show HN: Paper Radar – daily ArXiv triage, now runs on Claude Haiku too

TypeSafe's System One model Jev powers Paper Radar, a serverless arXiv triage tool that asks one yes/no question per user interest and returns a calibrated probability instead of a written summary, reading all roughly 1,500 papers announced each weekday for about $0.06 a day. A real run on 2026-09-23 judged 50 papers in 5 seconds for 46,584 input tokens and $0.0020 on jev-1.13.0, and on four unseen Cochrane reviews the tool screened 19,447 records, reproducing 96.9% of the studies reviewers included while removing 78% of the reading for $0.60. The tool now also runs on Anthropic's Claude Haiku, publishing self-reported probabilities and a first-look calibration document, and ships with seven public RSS feeds covering AI, agents, efficiency, robot learning, neuroscience and clinical topics.

Jev reads every new paper on arXiv each morning. You read the few that matter. Also runs on Claude Haiku use-claude-instead-of-jev — same daily page, self-reported probabilities, first-look calibration https://github.com/Eliot5566/JEV-Paper-Radar/blob/main/docs/claude-calibration.md . Plain-English interests · calibrated probabilities · about 6 cents a day for all of arXiv · fork and go, no server Quick start quick-start-5-minutes-no-server · Try the demo try-it-in-10-seconds · How it works how-it-works · Benchmark measured-against-real-reviewers-decisions · 繁體中文 https://github.com/Eliot5566/JEV-Paper-Radar/blob/main/README.zh-TW.md <sub A real run: 50 new arXiv papers judged by Jev in 5 seconds for $0.002. No key? paper-radar demo shows the same page offline.</sub arXiv now receives more than 30,000 papers a month 32,040 in June 2026 https://blog.arxiv.org/2026/07/09/arxiv-now-hosts-over-3-million-articles/ , about 1,500 per weekday announcement. Nobody reads the listing any more. Keyword alerts miss papers that use different words, embedding recommenders quietly drop whatever does not look like your past reading, and running a chat LLM over the whole firehose every day is slow and costs real money. Most AI tools read a paper and write you a summary. Paper Radar does not write anything. It asks Jev https://typesafe.ai/blog/introducing-system-one-models-and-jev — TypeSafe's System One model — one yes/no question per interest and gets a probability back: introduces an agent benchmark, 0.97 . Your repo's code decides what that means. Judgement instead of prose is what makes the arithmetic work. There is nothing to parse and no invented labels, and one judgement costs a fraction of a generated sentence — cheap enough to read all 1,500 papers rather than a pre-filtered handful, which is where keyword alerts and embedding recommenders lose the paper you actually wanted. | | Keyword alerts | Embedding recommenders | LLM digest bots | Paper Radar | |---|---|---|---|---| | Reads every new paper | ✅ | ✅ | usually only a pre-filtered top-k | ✅ | | Understands meaning | ❌ | partly | ✅ | ✅ | | Explains why a paper matched | keyword | ❌ | free text | per-interest probability | | Thresholds you can tune and check | ❌ | ❌ | ❌ | ✅ calibrate | | Cost to read all of arXiv daily | free | free after setup | higher: you pay for generated text | ≈ $0.06 per day | <sub Measured, not guessed: a real run on 2026-09-23 read 50 papers in 5 seconds for 46,584 input tokens and $0.0020 932 tokens per paper, jev-1.13.0 . All of arXiv, about 1,500 papers per weekday, works out to roughly $0.06 a day. Output tokens are free. Every run logs its own tokens and cost in data/runs.jsonl ; paper-radar check estimates your profile before you spend anything.</sub Checked against real reviewers, not just claimed: on four Cochrane reviews it had never seen, screening 19,447 records reproduced 96.9% of the studies the reviewers included while removing 78% of the reading, for $0.60. The predictions that were wrong on the way there are published too — see the benchmark measured-against-real-reviewers-decisions . Seven radars run here every weekday. Take the RSS link for your field — nothing to install, no key, no account: https://eliot5566.github.io/JEV-Paper-Radar/public/ https://eliot5566.github.io/JEV-Paper-Radar/public/ | Feed | What it reads | |---|---| | AI https://eliot5566.github.io/JEV-Paper-Radar/public/ai/ | cs.AI, cs.CL, cs.LG — the broad one | | Agents https://eliot5566.github.io/JEV-Paper-Radar/public/agents/ | tool-using and web-browsing LLM agents | | Efficiency https://eliot5566.github.io/JEV-Paper-Radar/public/efficiency/ | faster, smaller, cheaper inference | | Robot learning https://eliot5566.github.io/JEV-Paper-Radar/public/robotics/ | cs.RO | | Neuroscience https://eliot5566.github.io/JEV-Paper-Radar/public/neuro/ | bioRxiv neuroscience + q-bio.NC | | Clinical AI https://eliot5566.github.io/JEV-Paper-Radar/public/clinical/ | PubMed — models evaluated on patients | | Signal https://eliot5566.github.io/JEV-Paper-Radar/public/signal/ | tech news, Reddit and Bluesky — with the retellings removed | Each is an ordinary config file in radars/ https://github.com/Eliot5566/JEV-Paper-Radar/blob/main/radars . Fork the repo and yours will be narrower, and much more useful. - A web page on GitHub Pages: must-read and maybe lists, near misses, and what your exclusions filtered out - An RSS feed feed.xml for any reader, including Zotero File → New Feed , so picks land next to your library - Optional digests on Slack, Discord, Telegram or email - Optional one-sentence TL;DRs in your language, written by any LLM for the top 10 papers only - An audit trail : every decision, probability and model version is committed to data/ 1. Fork this repo. Then open the Actions tab of your fork and click enable workflows GitHub turns them off in new forks . 2. Describe your interests in radar.toml https://github.com/Eliot5566/JEV-Paper-Radar/blob/main/radar.toml : one plain-English statement per interest. interests id = "agent eval" label = "Agent evaluation" text = "Benchmarks or methods for evaluating LLM agents on multi-step tool-use tasks" 3. Add a key under Settings → Secrets and variables → Actions : - TYPESAFE API KEY from console.typesafe.ai https://console.typesafe.ai/settings/keys , or - OPENROUTER API KEY if you are still on TypeSafe's waitlist. Set backend = "openrouter" and model = "typesafe/jev-1.13" in radar.toml ; OpenRouter serves Jev without a waitlist https://openrouter.ai/typesafe/jev-1.13 , or - ANTHROPIC API KEY to judge with Claude instead of Jev see below . Set backend = "claude" in radar.toml . 4. Turn on Pages: Settings → Pages → Source: GitHub Actions . 5. Run it: Actions → Paper Radar → Run workflow type 50 in limit for a cheap first test . If you already have an Anthropic API key, Claude can do the judging — same pipeline, same calibration step, no Jev waitlist: jev backend = "claude" model = "claude-haiku-5-5" the default; set it explicitly to pin a version paper-radar run --backend claude --limit 50 Two honest warnings. First, Claude's probabilities are self-reported, not calibrated : Jev returns a calibrated noul ; Claude returns a number it wrote in JSON. Run paper-radar label on a few dozen papers and then paper-radar calibrate to fit your thresholds to Claude before trusting a run — the Jev thresholds in radar.toml will not transfer. Second, the benchmark numbers in this README are Jev-only : the Cochrane screening result 96.9% recall, 78% work saved on 19,447 records was measured with Jev and does not apply to Claude. The API is also billed separately from a Claude Pro/Max subscription, and costs more per paper than Jev; set jev.price per mtok to roughly 0.15 for a Haiku cost estimate, and lower jev.requests per minute if you are on a low API tier. There is now a first-look calibration for the Claude backend — see docs/claude-calibration.md https://github.com/Eliot5566/JEV-Paper-Radar/blob/main/docs/claude-calibration.md . On 49 papers from the 2026-11-11 arXiv listing 6 relevant , Claude Haiku 5.5 scored Brier 0.040 and ECE 0.081, with suggested Claude thresholds of must read 0.65 and maybe 0.35, versus the Jev thresholds of 0.80 / 0.50. Read the provenance warning in that doc before trusting the numbers: the labels were made by Muse, not by the user, from titles and trimmed abstracts — this is a first look, not a user-validated calibration, and Claude is not claimed to be calibrated. For balance: the user never labelled papers for Jev either — the Jev thresholds are defaults from the repo's first commit and the only ground-truth measurement in the repo is the screening benchmark — so this is the first labelled measurement for either backend on the daily radar. After that it runs on weekdays at 02:00 UTC, right after arXiv's daily announcement. Your radar is at https://<you .github.io/<repo / and the feed at /feed.xml . No fork needed: any repository with a radar.toml can run Paper Radar as one step. Add a key as a repository secret Settings → Secrets and variables → Actions , then: .github/workflows/radar.yml on: schedule: - cron: "0 2 1-5" 02:00 UTC, weekdays workflow dispatch: jobs: radar: runs-on: ubuntu-latest steps: - uses: actions/checkout@v4 - uses: Eliot5566/JEV-Paper-Radar@v0.1.4 with: config: radar.toml typesafe-api-key: ${{ secrets.TYPESAFE API KEY }} anthropic-api-key: ${{ secrets.ANTHROPIC API KEY }} with backend: claude limit: "50" a cheap first test Pin to a release tag — @v0.1.2 is the first tag that contains action.yml @v0.1.1 predates it, so it cannot work . Other inputs: command run or screen , backend typesafe , openrouter , claude , mock , and args for extra flags such as --rejudge --no-notify . Keys are passed as secrets and are never printed in the log. No key needed. The demo uses fictional papers and a keyword heuristic in place of Jev, so you can see the output before you set anything up. pip install git+https://github.com/Eliot5566/JEV-Paper-Radar paper-radar demo writes ./paper-radar-demo/site/index.html Run it for real from your laptop: put your key in a .env file next to radar.toml it is git-ignored ... echo "TYPESAFE API KEY=your-key-here" .env ... or export it in your shell instead paper-radar check validate radar.toml, lint interests, estimate cost paper-radar run --limit 50 judge 50 papers, build ./site Real environment variables take precedence over .env , so the same commands work unchanged in CI. Jev reads your words literally Jev 1.13 jaggedness notes https://docs.typesafe.ai/model-jaggedness/jev-1.13 . paper-radar check warns about the common traps. | Do | Don't | |---|---| | One idea per interest — for interests , which combine with max | "RL for robots and also LLM agents" → split into two | | Put negatives in exclude , phrased positively: "The main application is medical imaging" | "Agents, but not robotics" | | Describe the paper: "Proposes a benchmark for …" | Ask for counts or dates: "published after 2024" | | Use weight = 0.5 for nice-to-have topics | Write ten near-duplicate interests | Measured on one day of 299 papers: the two interests worded as one crisp idea each "introduces a benchmark or an evaluation method", "makes inference faster or cheaper" produced 14 confident hits each. Three vaguer ones in the same profile — including "clearly outperforms previous approaches on a widely used task" — never crossed 0.95 at all. php flowchart LR A arXiv RSS<br/ bioRxiv / medRxiv<br/ any RSS -- B dedupe against<br/ last 14 days B -- C "Jev · one call per paper<br/ Noul per interest + exclusion<br/ Choice: paper type<br/ Noul: code released?" C -- D your code decides<br/ max / noisy-OR<br/ thresholds · exclusions D -- E site + RSS D -- F Slack · Discord<br/ Telegram · email D -- G data/ audit trail D -.top 10 only.- H optional LLM<br/ TL;DR in your language Paper Radar follows TypeSafe's own design patterns: - Atomic questions, composed in code. Each interest is a separate Noul. Relevance is max weight × p by default, or noisy-OR if you want papers that match several interests to rank higher. - Speculative fan-out. All questions for a paper go in one call; more interests add tokens but almost no latency. - Retrieve, then judge. Jev sees only the title, abstract and categories. Author names and affiliations are left out because they don't bear on the topic. - Cascade. Jev decides what deserves attention across thousands of papers. A generative model, if you turn it on, writes one sentence for the ten that made the cut. - Confidence-gated output. The must-read, maybe and near-miss bands come from thresholds you set and can verify with calibrate . Every paper on your page carries 👍 / 👎 links. Clicking one opens a pre-filled GitHub issue titled radar-label: <paper id yes ; submitting it is the whole interaction. The next run folds those issues into data/labels.jsonl , closes them, and calibrate fits your thresholds to them. In GitHub Actions the links point at your own repo automatically GITHUB REPOSITORY , so a fork needs no configuration. Locally, set output.feedback repo = "owner/name" or run paper-radar harvest --repo owner/name . TypeSafe's accuracy and calibration figures are self-reported. Check them on your own judgement instead: paper-radar label 2609.01234 yes or an arXiv URL paper-radar label 2609.04321 no paper-radar calibrate --precision 0.9 --recall 0.9 calibrate reports the Brier score, the expected calibration error, a precision and recall table, and the must read and maybe thresholds that hit your targets. Label about 30 papers, including some from the near-miss list. | type | what | notes | |---|---|---| | arxiv | official RSS, any categories, " " = every archive | new submissions and cross-lists; revisions skipped | | biorxiv / medrxiv | public details API | version-1 preprints, optional category filter | | pubmed | NCBI E-utilities, any PubMed query | errata and comments skipped; set NCBI API KEY to go from 3 to 10 req/s | | huggingface | Hugging Face Daily Papers | upvoted papers from any arXiv category; same ids as arxiv , so overlaps merge and the card shows the upvotes; min upvotes floor | | rss | any RSS or Atom feed | journals, lab blogs, hnrss.org , newsletters, GitHub releases.atom | | reddit | subreddit listings via OAuth | needs Reddit-approved REDDIT CLIENT ID + REDDIT CLIENT SECRET self-serve app creation closed 2025-11, anonymous JSON closed 2026-05 ; without them use the rss source on /r/<sub /top/.rss?t=day | | bluesky | public AppView author feeds | no key, no account; named accounts only — keyword search needs a login | sources type = "pubmed" query = '"atrial fibrillation" Title/Abstract AND "anticoagulant" Title/Abstract ' days = 2 email = "you@example.com" NCBI asks callers to identify themselves Ready-made profiles live in profiles/ https://github.com/Eliot5566/JEV-Paper-Radar/blob/main/profiles : LLM research, neuroscience bioRxiv , and a whole-arXiv watch for one narrow topic. PRs with your field's profile are very welcome. A paper feed has almost no duplicates and every item is a primary source. A news feed is the reverse: one announcement, then fifteen outlets reporting the announcement, then three subreddits linking the outlets. Asking "is this about AI?" on a feed of AI news fires on everything, which filters nothing. So radars/signal.toml https://github.com/Eliot5566/JEV-Paper-Radar/blob/main/radars/signal.toml asks about provenance instead of topic — is this a first-party announcement, does it report a number someone measured, can I use it today — and vetoes coverage-of-coverage, predictions and reaction posts. Before any of that, near-duplicates are folded into one story by canonicalised URL plus title token overlap: no model, no embeddings, and it runs before Jev, so one announcement costs one judgement instead of seven. Every folded copy is listed on the card rather than dropped. There is no X / Twitter source. X has had no free read API since 2023 and its terms forbid reading a timeline through anything else, so Bluesky's public AppView stands in for it: author feeds answer with no key, no account and no rate-limit deal. Its searchPosts endpoint answers 403 unless you are logged in, so the config names accounts rather than keywords — and every handle in it was checked against the live API, because several obvious guesses turned out to be squatted, empty or parody accounts. The labs themselves are not usefully on Bluesky; their own RSS is where first-party announcements come from. A review's title-and-abstract stage is the same shape as a daily radar pointed at a search strategy, with one difference that changes everything: a record is eligible only if every inclusion criterion holds, and one exclusion criterion disqualifies it. So screening is a separate command with its own scoring. The full story for review teams — how it works, how to run it, and the benchmark against Cochrane reviewers' decisions, with the honest limits — is in docs/screening.md https://github.com/Eliot5566/JEV-Paper-Radar/blob/main/docs/screening.md . cp profiles/systematic-review.toml review.toml edit the query and the criteria paper-radar screen -c review.toml --limit 50 a cheap first pass paper-radar screen -c review.toml Each criterion is one Noul. Eligibility is the geometric mean of the inclusion criteria, so every criterion's evidence counts rather than only the weakest one — combine = "min" restores the strict weakest-link reading. Every record ever screened is kept in full in data/screening/ , rejects included, because a review has to account for all of them. Writing criteria for screening is the opposite of writing interests. A radar combines interests with max , so one more interest is one more chance to match. Screening is a conjunction, so one more criterion is one more chance to veto a record . Write the fewest criteria that capture eligibility, and keep each one to something an abstract can actually answer. Measuring this is how we found it out: splitting compound criteria into more of them took one benchmark topic from 10.0% work saved to 0.1%. The output is the count block PRISMA 2020 asks for: Records identified 2314 Duplicate records removed 118 Records screened 2196 Records marked ineligible by this tool 1643 by an exclusion criterion 421 below the eligibility threshold 1222 Reports sought for retrieval 194 Needs manual review no abstract 359 PRISMA 2020 has a box for records "removed before screening" by automation tool exclusions , reported separately from human decisions. That box is the only one this tool is entitled to fill in. Screen a few hundred records yourself, label them, and make the tool prove itself against your own judgement: paper-radar label 42777254 yes paper-radar screen -c review.toml --report --recall 0.95 It fits the threshold to your recall target and reports WSS — work saved over sampling, the metric this literature uses — along with the studies that threshold would have cost you, by ID. Read those before deciding anything. Suggested threshold 0.372 Recall at that threshold 95.2% Workload saved WSS 61.4% You would read about 848 of 2196 abstracts and miss 1 of 21 eligible studies. Missed: pubmed:42771903 Twelve Cochrane reviews from the CLEF eHealth Technology Assisted Reviews 2019 https://github.com/CLEF-TAR/tar track, whose relevance judgments are made at the title-and-abstract stage — the stage this tool works at. Each review's criteria come from its own published selection criteria, quoted verbatim in benchmarks/clef tar 2019/criteria/ https://github.com/Eliot5566/JEV-Paper-Radar/blob/main/benchmarks/clef tar 2019/criteria . Four of them were never looked at while any of this was being built or fixed: | Held-out review | Records | Eligible | Recall | Work saved | Cost | |---|---|---|---|---|---| | Antihypertensives: RAS inhibitors vs other classes | 12,319 | 88 | 95.5% | 68.1% | $0.37 | | Thromboprophylaxis implementation | 3,574 | 11 | 100% | 95.1% | $0.11 | | Cyclodestructive procedures for glaucoma | 2,456 | 12 | 100% | 95.8% | $0.08 | | Psychological therapies for depression in COPD | 1,098 | 16 | 100% | 92.5% | $0.03 | 19,447 records, 127 eligible studies, 96.9% recall, 78.0% pooled work saved, $0.60. The eight reviews used during development did far worse — 38–48% pooled, with individual topics between 0.1% and 82%. Performance is dominated by the review, not by the tool. The held-out reviews are large and low in prevalence 0.3–1.5% eligible , which is the regime a real search is in; the development set included 146-record topics where 10% of records were eligible and there was little to save. Treat 78% as what a large search looks like, not as a number you can expect. Three rounds of it, including the predictions that were wrong, are in benchmarks/clef tar 2019/PREREGISTRATION.md https://github.com/Eliot5566/JEV-Paper-Radar/blob/main/benchmarks/clef tar 2019/PREREGISTRATION.md . Rerunning any of it is one command. - Not a replacement for a human screener. Published evaluations of automated screening report a mean recall around 93% and a mean WSS@95 of about 55%, and they consistently conclude that these tools belong alongside human reviewers rather than in place of one. Use it as a second screener, or to prioritise the order a human screens in. - The thresholds above are fitted on the same judgments they are scored against. That is the optimistic case. It says how well the scores could separate eligible studies from the rest, not what you get on a review nobody has screened yet. - A third of new PubMed records have no abstract at all. Measured on 40 consecutive records: 13 had a title and nothing else. Those are never auto-excluded — they go to a manual pile — so the workload saving applies to the records that have something to read. - Pin the model. A model change mid-review is a protocol deviation. Every screening record stores the model that produced it. - Nobody has run this alongside a live review yet. The benchmark replays decisions that were already made. If you shadow a review in progress, those numbers would be worth a PR more than anything here. - Abstracts only. Jev judges what the abstract says, not the full paper. - Jev is new. It launched in early access in September 2026. Its benchmark numbers are TypeSafe's own and have not been reproduced independently, so pin model and use calibrate . - Text in, choices out. Jev cannot count, compare dates or write prose, so Paper Radar never asks it to. - Adversarial abstracts. An abstract written to game classifiers can nudge a score. The worst case is one bad pick in your list: nothing is executed on the model's word. - Data sharing. Titles and abstracts public data are sent to your chosen provider. Nothing else is. - Not affiliated with TypeSafe AI. - One-click 👍/👎 on the page via GitHub Issues, harvested into labels.jsonl - A public demo radar so visitors see real output without a key - PubMed source via NCBI E-utilities - Screening mode for systematic reviews: criteria as Nouls, PRISMA 2020 counts, WSS measured against your own decisions - Validated against 12 Cochrane reviews' own title/abstract screening decisions - News mode: Reddit and Bluesky sources, with near-duplicate folding before judging - Hugging Face Daily Papers source - Lab mode : one repo, many members, a page per person plus a shared feed - Citation-claim checks and missing-methods flags for your must-reads - Local open-model backend for fully offline use Profiles, sources and notifiers are small, self-contained files, which makes them good first PRs. Run pytest before opening one. See CONTRIBUTING.md https://github.com/Eliot5566/JEV-Paper-Radar/blob/main/CONTRIBUTING.md . MIT licensed.