{"slug": "datasette-arrows-0-1a0", "title": "datasette-arrows 0.1a0", "summary": "Datasette creator Simon Willison released datasette-arrows 0.1a0, a plugin that adds Apache Arrow streaming as an export format for Datasette 1.0a43, the version that introduced streaming export support through the register_output_renderer() plugin hook. Datasette core already streams CSV and TSV so tables with millions of rows can be exported without loading them into memory, and datasette-arrows extends that pattern to Arrow's IPC streaming format; Willison said Claude Fable 5.2 suggested the format and built the plugin in almost a single shot. The Arrow option appears in Datasette's export dialog on the main branch, with grouping alongside CSV and TSV in the \"All rows in this table\" section slated for the next alpha release.", "body_md": "**Release:** [datasette-arrows 0.1a0](https://github.com/datasette/datasette-arrows/releases/tag/0.1a0)\n\n[Datasette 1.0a43](https://docs.datasette.io/en/latest/changelog.html#a43-2026-11-15) added the ability for plugins to implement streaming export formats. Datasette core supports streaming CSV and TSV - you can export millions of lines of data from a table without needing to load it all into memory, because those two file formats support streaming data in chunks. The [register_output_renderer()](https://docs.datasette.io/en/latest/plugin_hooks.html#register-output-renderer-datasette) plugin hook can now be used to implement the same pattern for other formats.\n\nI've learned never to release a new plugin feature without accompanying it with a plugin that uses it.\n\nClaude Fable 5.2 suggested the [Apache Arrow streaming](https://arrow.apache.org/docs/python/ipc.html) format as a good option, and built this plugin in almost a single shot.\n\nAdd the plugin to Datasette (`datasette install datasette-arrows`) and the export dialog gains this new Arrow option:\n\nThis screenshot is from Datasette's `main` branch - the most recent release doesn't yet group streaming formats such as Arrow with the TSV and CSV in the \"All rows in this table\" section, but that's coming in the next alpha release.", "url": "https://wpnews.pro/news/datasette-arrows-0-1a0", "canonical_source": "https://simonwillison.net/2026/Nov/18/datasette-arrows/", "published_at": "2026-11-18 17:09:59+00:00", "updated_at": "2026-11-19 03:44:49.135534+00:00", "lang": "en", "topics": ["developer-tools", "ai-tools"], "entities": ["Datasette", "datasette-arrows", "Simon Willison", "Apache Arrow", "Claude Fable 5.2"], "also_reported_by": [], "takeaway": "Datasette 1.0a43's register_output_renderer() hook now lets plugins stream export formats in chunks, as datasette-arrows 0.1a0 does for Apache Arrow, avoiding loading millions of rows into memory.", "recommendation": null, "alternates": {"html": "https://wpnews.pro/news/datasette-arrows-0-1a0", "markdown": "https://wpnews.pro/news/datasette-arrows-0-1a0.md", "text": "https://wpnews.pro/news/datasette-arrows-0-1a0.txt", "jsonld": "https://wpnews.pro/news/datasette-arrows-0-1a0.jsonld"}}