Faire, a technology wholesale platform, is hiring a Senior Staff Machine Learning Platform Engineer with a salary range of $295k–406k per year, based remotely in the US or in San Francisco, CA. The ro…
A major Canadian freight railroad spanning roughly 20,000 route miles and moving over C$250 billion in goods annually used Databricks' Genie Code, Unity Catalog, custom Agent Skills, and a Streamlit a…
Databricks announced the beta of FILE type, a new native column type for multimodal data that stores unstructured data as a governed column in tables, making it AI-ready and queryable alongside struct…
A Databricks-focused consultancy, Zephico, breaks down the real costs of migrating from Snowflake to Databricks, arguing that the true benefits come from moving for ML and streaming workloads rather t…
LakeSail released Sail, a drop-in Apache Spark replacement written in Rust that unifies batch, stream, and AI workloads, claiming ~4× faster performance (up to 8× in specific workloads) and 94% lower …
Confluent Cloud launched Tableflow, a managed feature that materializes Apache Kafka topics as Apache Iceberg or Delta Lake tables, eliminating custom data pipelines by automatically handling schemati…
A developer provides an honest comparison of Azure Databricks and Microsoft Fabric for data platforms on Azure in 2026, highlighting strengths and overlaps. The guide includes a feature comparison tab…
Azure Databricks provides a production-grade feature engineering pipeline for MLOps using Apache Spark, Delta Lake, and MLflow. The pipeline follows the Medallion Architecture with Bronze, Silver, and…
Databricks open-sourced Omnigent, an AI agent governance layer, and introduced LTAP, an architecture unifying transactional and analytical workloads on a single copy of data, at its Data + AI Summit 2…
Kythera Labs is building an AI-native healthcare strategy platform on Databricks that gives health systems access to expert intelligence by transforming 339 billion claims records into a trustworthy d…
Confluent released a guide for building real-time hyper-personalization systems using streaming-native data engines, arguing that batch architectures cannot capture user intent within the critical sec…
Confluent released a 2026 guide recommending a unified streaming (kappa) architecture to eliminate training-serving skew in ML pipelines, citing DoorDash's 35.7% feature-value mismatch and Netflix's $…
Databricks announced the unification of OLAP and OLTP in its Lakehouse with a new LTAP architecture, combining Lakebase and the Lakehouse under a single governance model. The company also introduced L…
Databricks announced major updates to Unity Catalog at the Data+AI Summit 2026, including AI runtime governance with hard spend caps and contextual service policies, external engine writes to managed …
ClickHouse, the open-source database, has built a thriving ecosystem around open standards including OpenTelemetry for observability, the Model Context Protocol for AI agents, and open table formats l…
Imply launched Lumi Loglake, a log search facility for object storage that enables interactive searches of unstructured log data directly in AWS S3, Delta Lake, and Apache Iceberg without indexing. Th…
Monte Carlo announced support for Databricks' Agent Bricks platform, extending its observability coverage to AI agents built on enterprise data. The integration creates a continuous audit trail from r…
Databricks announced the general availability of Spatial SQL, enabling organizations to perform geospatial analysis directly within its lakehouse platform without requiring separate spatial databases …
Python developers processing billions of rows or running distributed machine learning pipelines now have seven specialized libraries—including PySpark, Dask, and Polars—that handle datasets exceeding …