Confluent Cloud launched Tableflow, a managed feature that materializes Apache Kafka topics as Apache Iceberg or Delta Lake tables, eliminating custom data pipelines by automatically handling schemati…
A developer provides an honest comparison of Azure Databricks and Microsoft Fabric for data platforms on Azure in 2026, highlighting strengths and overlaps. The guide includes a feature comparison tab…
Azure Databricks provides a production-grade feature engineering pipeline for MLOps using Apache Spark, Delta Lake, and MLflow. The pipeline follows the Medallion Architecture with Bronze, Silver, and…
Databricks open-sourced Omnigent, an AI agent governance layer, and introduced LTAP, an architecture unifying transactional and analytical workloads on a single copy of data, at its Data + AI Summit 2…
Kythera Labs is building an AI-native healthcare strategy platform on Databricks that gives health systems access to expert intelligence by transforming 339 billion claims records into a trustworthy d…
Confluent released a 2026 guide recommending a unified streaming (kappa) architecture to eliminate training-serving skew in ML pipelines, citing DoorDash's 35.7% feature-value mismatch and Netflix's $…
Confluent released a guide for building real-time hyper-personalization systems using streaming-native data engines, arguing that batch architectures cannot capture user intent within the critical sec…
Databricks announced the unification of OLAP and OLTP in its Lakehouse with a new LTAP architecture, combining Lakebase and the Lakehouse under a single governance model. The company also introduced L…
Databricks announced major updates to Unity Catalog at the Data+AI Summit 2026, including AI runtime governance with hard spend caps and contextual service policies, external engine writes to managed …
ClickHouse, the open-source database, has built a thriving ecosystem around open standards including OpenTelemetry for observability, the Model Context Protocol for AI agents, and open table formats l…
Imply launched Lumi Loglake, a log search facility for object storage that enables interactive searches of unstructured log data directly in AWS S3, Delta Lake, and Apache Iceberg without indexing. Th…
Monte Carlo announced support for Databricks' Agent Bricks platform, extending its observability coverage to AI agents built on enterprise data. The integration creates a continuous audit trail from r…
Databricks announced the general availability of Spatial SQL, enabling organizations to perform geospatial analysis directly within its lakehouse platform without requiring separate spatial databases …
Python developers processing billions of rows or running distributed machine learning pipelines now have seven specialized libraries—including PySpark, Dask, and Polars—that handle datasets exceeding …