Hotdata has open-sourced and donated its implementation of DuckLake for Apache DataFusion to the Apache DataFusion Contrib organization, enabling DataFusion to use DuckLake's lakehouse format with rel…
Icebug-format, a new open-source graph standard combining Apache Arrow and Compressed Sparse Rows (CSR) into an immutable, interoperable format, has been released under the MIT license. The format, wh…
Apache Iceberg voted to deprecate equality deletes in V4, forbidding new writes while keeping read support for backward compatibility. The community also debated whether V4 manifests should be Parquet…
DuckDB's August 2026 ecosystem newsletter highlights new extensions and features, including an ADBC extension enabling connections to over 30 external databases and asynchronous I/O for v2.0, which im…
QuestDB 10.0 introduces QWP, a binary columnar protocol over WebSocket that handles both writes and reads from a single client, achieving around 3.6x faster ingestion than the InfluxDB Line Protocol a…
A developer released RocheDB v0.6.0, a ring-oriented NoSQL document and vector database written in Nim. The release focuses on locality validation, topology remapping, and safer query boundaries, movi…
A developer compares Pandas and Polars for data engineering in 2025, finding that Polars outperforms Pandas by 5x in speed and uses 8x less memory on a 1GB CSV benchmark. The post provides a practical…
ClickHouse has released an official ADBC driver, providing zero-conversion, end-to-end columnar data movement via Apache Arrow for analytics and AI applications. The driver, distributed through the AD…
Researchers introduced Jailbreak, a system that uses large language models to regenerate database storage readers, bypassing traditional database drivers like JDBC and ODBC to read storage files direc…
The Apache data lakehouse community focused on governance this week, with Parquet voting on versioned releases and Polaris aligning with the incubating Ossie semantics project. Iceberg Rust released R…
Greg Reda prototyped a PDF chatbot from scratch in October 2023, deliberately avoiding frameworks like LangChain to understand pipeline mechanics. The two-phase architecture separates ingestion from i…
BitVanes, a zero-trust RAG pipeline engine written in Rust and compiled to WebAssembly, processes documents locally without sending sensitive data to cloud services. The engine outputs Apache Arrow Re…
The Apache Iceberg community debated a v2 loadTable endpoint for the REST catalog protocol this week, with Ryan Blue proposing the change to support optional locations and snapshots while moving crede…
Wes McKinney, creator of Pandas and Apache Arrow, warns that 'vibe coding' is dangerous while advocating for agentic engineering in an interview about AI in data work. McKinney emphasizes the need for…