Cloudera launched Anywhere Cloud, a hybrid data and AI platform that lets enterprises run AI workloads across public cloud, sovereign environments, and on-premises data centers without moving data. Th…
Cloudera launched Anywhere Cloud on August 19, a hybrid data and AI platform providing a single control plane for workloads across public cloud, sovereign cloud, and on-premises environments, with sup…
Google Cloud's Managed Service for Apache Spark offers serverless and traditional cluster deployment modes, with serverless optimized for intermittent, bursty workloads and traditional clusters for co…
Cloudera Inc. launched Cloudera Anywhere Cloud, a platform designed to give AI agents secure, governed access to sensitive data across public cloud, on-premises, sovereign cloud, and edge environments…
Databricks closed a funding round at a $188 billion valuation, led by Coatue Management with roughly $3 billion invested, nearly tripling its valuation from $62 billion in late 2024. The company repor…
Microsoft's Fabric IQ workload introduces Ontology, a feature in public preview that gives data a shared business meaning by defining concepts and relationships independent of physical data storage. T…
The Awesome-FDE-Roadmap, a comprehensive guide for Forward Deployed Engineers (FDEs), outlines the hybrid role of software engineer, AI/data architect, and strategic consultant, emphasizing the need t…
AI-powered pipeline automation is emerging as a solution to the growing complexity of data pipelines, reducing development time by 60% and failures by 45%, according to a developer's guide. The approa…
LakeSail released Sail, a drop-in Apache Spark replacement written in Rust that unifies batch, stream, and AI workloads, claiming ~4× faster performance (up to 8× in specific workloads) and 94% lower …
Snowflake Inc. announced the spark-migration skill in its CoCo AI coding agent, which migrates Apache Spark codebases to Snowpark Connect with minimal manual changes. The tool scans files for compatib…
Snowflake and Google Cloud are collaborating on an Apache Iceberg-based lakehouse architecture that enables multi-engine interoperability without data duplication. The approach uses Iceberg as an open…
Apache Spark enables production-grade AI pipelines by structuring distributed loading, exploratory data analysis, feature engineering, tuning, and evaluation, achieving 0.8526 accuracy, 0.9043 ROC-AUC…
Google Cloud introduced the Agentic Data Cloud at Google Cloud Next 2026, unifying data, AI models, and operational databases into a single System of Action to address infrastructure bottlenecks for a…
The United States is changing how it allocates research funding, with a focus on investing in individual scientists over legacy institutions and increasing funding to AI research, according to the Dir…
Apache Spark 4.2 introduces native vector similarity search, Metric Views for governed business metrics, and real-time Python streaming, positioning Spark as an AI-native data platform. The release ta…
Databricks raised funding at a $188 billion valuation, driven by Coatue's bet on enterprise AI governance tools that are outpacing the underlying AI models. The company, founded by UC Berkeley academi…
Apache Spark 4.2 is now available in Databricks Runtime 19 Beta, introducing governed metrics, vector and top-K primitives, an Arrow-first Python path, first-class change data capture, and stronger st…
VAST Data and Cloudera announced a strategic partnership to integrate Cloudera's data engineering, analytics, and AI services with VAST's AI Operating System, creating a combined AI factory architectu…
Researchers introduced Jailbreak, a system that uses large language models to regenerate database storage readers, bypassing traditional database drivers like JDBC and ODBC to read storage files direc…
Databricks co-founder Reynold Xin explains the limitations of traditional monolithic OLTP databases and introduces Lakebase, a serverless Postgres database that externalizes storage and compute. The a…