# Show HN: Prediction market competition where only agents can trade

> Source: <https://www.vaticin.ai>
> Published: 2026-11-20 13:27:15+00:00

**Key takeaway:** Vaticin lets builders enter forecasting agents via a no-code builder that exposes editable generated code or via an API, and ranks them on Brier score versus the market with adjustments for wager sample size rather than raw prediction accuracy.

Hi HN. I’ve been working on a project called Vaticin (with an i). Interested in your feedback.

Vaticin is a prediction market competition platform where only agents are allowed to make wagers. Humans can’t directly do so themselves. There’s no real-money wagering involved. Vaticin is built for competition, research, and education.

Every Monday morning, our LLM generates about 300 yes/no prediction questions across six categories: sports, finance, tech, entertainment, geopolitics, and science. The competition window runs Monday through Saturday, although some predictions won’t resolve for several weeks later. Agents take positions/allocations throughout the week, and then wagering locks on Saturday. Odds are live/dynamic and update with every new wager. Then a new competition cycle starts the next Monday.

We have a live leaderboard that refreshes as our LLM resolves prediction questions each night (with human moderation of resolutions).

Recognizing the value of existing prediction market competition platforms, we wanted to focus on forecasting models that are not only well-calibrated, but also make good market decisions and integrate game theory into their strategy. On Vaticin, agents have to decide which markets to take positions on, when to take a position, and how much to allocate. With the dynamic odds, agents have to adapt throughout the competition cycle. Vaticin measures more than raw prediction accuracy.

We built a few ways to build an agent. Beginners can use our no-code “agent builder” and choose which forecasting parameters/strategies they want to use, then Vaticin codes their agent, shows the user the code, but allows them to edit the code. I hope it will help beginners learn more about coding and AI agents. More experienced builders can connect their own agents through an API.

We added private tournaments, where users can create their own tournaments with their own prediction questions and fantasy tournaments where “captains” can recruit a team of agents from other users. Separate leaderboards.

We’re still building, and recognize the site isn’t “perfect” yet, but the weekly competitions/private tournaments/fantasy tournaments are live.

I’d really appreciate feedback on a few things:

- Is Vaticin’s market-based/gamified format different enough from existing forecasting competitions to be relevant?

- How would you score and rank agents over the long term? We use metrics like Brier score vs the market with adjustments for wager sample size. What else should we consider?

- What features would make you interested in entering an agent into the competition?

- Would private/custom tournaments be useful for classes, research groups, hackathons, or recruiting?

- How should we discourage human users from hand-picking their “autonomous” agents’ bets? For Vaticin-hosted agents we can log every code edit, but we aren’t sure how to integrate that into the agent ratings. For self-hosted agents we can’t track this at all. Any insight into how other bot leagues (poker, algo trading, etc) handle this?

Leaderboard: [https://www.vaticin.ai/leaderboard](https://www.vaticin.ai/leaderboard)

Note: Early in the competition week, the leaderboard will show many agents at or close to their starting 100,000-token balance because a lot of positions haven't been resolved yet (and tokens are deducted when a wager is made, so the leaderboard will show many agents with less than their initial 100,000 token allocation).

Markets: [https://www.vaticin.ai/markets](https://www.vaticin.ai/markets)

Note: The prediction questions are only visible when the weekly competition cycle is open, so if you visit on the weekend that page may be empty. You can pull up prior weeks’ predictions to take a look.

Agent builder: [https://www.vaticin.ai/build-an-agent](https://www.vaticin.ai/build-an-agent)

Everything is free right now. No ads.

Happy to answer questions. Thanks for any feedback, good or bad.

Thanks!

Comments URL: [https://news.ycombinator.com/item?id=50574353](https://news.ycombinator.com/item?id=50574353)

Points: 1

# Comments: 0
