A developer argues that Snowflake-managed Iceberg tables let teams keep Parquet data files in their own cloud storage while Snowflake handles metadata management, compaction, and schema evolution, dec…
A developer built a single MCP server for Apache Iceberg tables that reads from seven different Iceberg REST catalogs, switching catalogs via environment variables while keeping the server code unchan…
Google announced the preview of cross-cloud caching for its borderless Lakehouse, a feature that transparently accelerates cross-cloud queries in BigQuery by caching frequently accessed data locally i…
A developer has outlined a serverless architecture that packages a quantized open-source model, Meta's Llama 3.2 3B, into AWS Lambda containers to generate 1 million personalized AI briefings for roug…
Panasonic Avionics Corporation, in collaboration with AWS and the AWS Generative AI Innovation Center, has built an agentic AI system on Amazon Bedrock, Amazon SageMaker, and AWS Glue to reduce aircra…
Google Cloud announced enhancements to its borderless Lakehouse at Next Tokyo, enabling AI agents to access and query data across AWS, Databricks, Snowflake, and on-premises systems without moving it.…
A developer abandoned plans to build a standalone AWS Glue MCP server after discovering the awslabs/mcp repository already handles authentication and resource mapping, making a focused extension more …
AWS published an architectural guide for building an explainable next-best-product recommendation system for banking using Amazon SageMaker AI and PyTorch. The system uses a multi-tower neural network…
Confluent Cloud launched Tableflow, a managed feature that materializes Apache Kafka topics as Apache Iceberg or Delta Lake tables, eliminating custom data pipelines by automatically handling schemati…
Google launched Conversational Analytics in BigQuery to general availability, enabling natural language queries, multi-step analyses, and visual reports directly on governed data. The feature uses Gem…
AWS announced AWS Context, a new service that automatically maps data relationships into a knowledge graph for AI agents, at the AWS Summit New York City. The service provides agentic search and gover…
AWS announced remote IDE access for Kiro, VS Code, and Cursor to Amazon SageMaker Unified Studio Spaces, enabling local editors to securely connect to managed compute and data services without SSH key…
Databricks announced Lakehouse Federation, a feature that connects Genie to external data sources like AWS Glue, Snowflake, and BigQuery without requiring data migration. The tool syncs metadata into …
Snowflake has introduced a Metadata Hub through its Horizon Catalog to unify fragmented data across multiple platforms like Snowflake, AWS Glue, Databricks Unity Catalog, and Microsoft OneLake without…
Amazon Quick and Snowflake Cortex AI now enable financial institutions to automate anti-money laundering (AML) alert triage, reducing investigation time from 30-90 minutes to under 5 minutes. The inte…
Data engineering involves designing systems for collecting, storing, transforming, and managing data to support analytics, machine learning, and business decisions. The field relies on two primary ing…