This is something I've been playing with for the last couple days - an app I vibecoded to arrange oneshot LLM visual benchmarks without the need to write any code. I do it form my phone so the excellence of mobile UI is high in the priority list.
It is inspired by Simon Willison's benchmark writeups[0], basically you can recreate them in one go.
Besides text and images, it supports SVG outputs and whole static websites, which is where benchmarks get the most interesting.
Additionally, I added the ability to alter chat history for the chat completion API, which I think is useful for model red teaming (or if you just want to see how different models apologize) - but I haven't found any impressive uses of that feature yet.
This thing helped me improve my intuition on different SOTA models' strengths and weaknesses; check out the various examples on the website, and feel free to create your own
[0] [https://simonwillison.net/tags/svg/](https://simonwillison.net/tags/svg/)
Comments URL: [https://news.ycombinator.com/item?id=50118127](https://news.ycombinator.com/item?id=50118127)
Points: 1