A developer argues that most agentic AI vocabulary maps directly to concepts DevOps teams already use, such as agent loops being reconciliation loops and guardrails being admission control. The post p…
Lajosdeme released Mole, an open-source deep research agent that runs from the terminal, combining large language models with a retrieval system to answer questions with up-to-date web or database inf…
A developer built Safaricom Intelligence, a data pipeline that converts 19 years of Safaricom's financial disclosures into a queryable BigQuery dataset. During the project, the pipeline generated a fa…
Interlace, a new open-source data engineering framework, unifies SQL and Python models, ingestion, and orchestration into a single graph abstraction, eliminating the seams between separate tools. The …
Artefact, a global data and AI consulting company, is hiring a Forward Deployed Engineer for its Utrecht office to build production-grade data pipelines and deploy LLM-based solutions such as RAG syst…
Maxime Beauchemin, creator of Airflow and Superset and CEO of Preset, is building Agor, an open-source platform he calls 'Figma for agents' to coordinate AI agents in shared, secure workspaces. In an …
A production AI infrastructure engineer reports that six months of operating an on-prem RAG pipeline for internal document search over 2M legal documents with a Llama-3.1-70B model revealed critical p…
A developer argues that ML pipelines should be modeled as graphs of assets rather than DAGs of tasks, because task-based orchestration like Airflow tracks execution success but not data freshness or d…
LangGraph can be deployed as a composable service within an existing data stack, integrating with schedulers like Airflow and Prefect, APIs, and warehouses such as Snowflake, Redshift, and BigQuery. T…
A developer building LLM workflows argues that choosing between chaining libraries and general orchestrators depends on whether the problem is LLM glue or reliable execution. The developer built Promp…
A data engineer outlines a practical roadmap for breaking into the field in 2026, emphasizing SQL fluency, Python scripting, cloud cost optimization, and data modeling over outdated tools like Hadoop.…
Verihubs, an Indonesian AI company, rebuilt its data warehouse on ClickHouse, achieving up to 98% faster queries and 50% lower cloud costs. The new architecture replaced daily Postgres batch pulls wit…
A developer introduces agentic data engineering, a practice where autonomous AI agents design, build, and maintain data pipelines from natural-language intent, shifting from manual coding to specifyin…
Loop Engineering introduces a governance architecture for AI agents that prevents costly errors by adding structured control layers, including task definitions, state separation, tool guards, observat…
A data engineer created Ghost Skills, a collection of methodology instructions for AI coding agents, to address the gap between model capability and the contextual knowledge needed for real-world data…
Two blog posts from DBOS and Obelisk sparked a debate on using Postgres versus SQLite for durable workflow execution, with both arguing their preferred database can replace external orchestrators like…
A 2026 career guide breaks down the distinct roles of data engineers, who build and maintain data infrastructure and pipelines, and data scientists, who analyze data and build machine learning models.…
Data Workers, an open-source autonomous agent swarm for data engineering, bet on the Model Context Protocol (MCP) to connect its AI agents to dozens of tools in the modern data stack, rather than buil…
Nearly 40% of active Data Engineer job postings now mention AI, with 17.4% explicitly requiring generative AI skills like LLMs, RAG, and AI agents, according to an analysis of 6,736 listings on Interv…
A developer demonstrated that MCP (Model Context Protocol) servers are essentially REST APIs with a polite wrapper, showing how to access the Helium MCP server's underlying HTTP endpoints directly usi…