Structured Data news and analysis on Web Pulse: 342 curated articles tracking the latest Structured Data developments, tools, and research, updated continuously from vetted sources.
A 2026 ecommerce SEO guide published by MarketingSoHigh argues that online retailers must shift from keyword rankings to technical and semantic optimization, including crawl budget management through robots.txt directive…
A developer's analysis of Medium's robots.txt found the platform blocks eight AI crawlers — including GPTBot, ClaudeBot, Applebot-Extended, meta-externalagent, Bytespider and Amazonbot — while leaving search-grounded ret…
A developer at the brand-monitoring startup Luxcerta ran the company's own AI-visibility method on its week-old brand and found that Gemini, with web grounding enabled, misidentified "Luxcerta" as a typo for the French g…
An MLX-based parallel constrained decoding engine for Apple Silicon evaluates every JSON schema field in a single forward pass, cutting structured extraction latency 5.6x to 7.0x versus standard autoregressive JSON gener…
Google published a new guide explaining how publishers and creators can add a Search Profile badge to their websites, a feature currently enabled only for United States-based publishers and creators. The Search Profile a…
AI-powered search and answer engines are increasingly interpreting public reputation signals — reviews, ratings, listings, and location data — to generate recommendations, turning reputation management into a joint CMO a…
Common Crawl has mirrored selected crawl archives to a Hugging Face Storage Bucket since April 2026, alongside its existing AWS S3 distribution, using the same directory layout such as crawl-data/CC-MAIN-2026-17/. The bu…
Knowledgator Engineering released GLiFormer, a schema-conditioned encoder framework for information extraction, with two Apache 2.0 checkpoints on Hugging Face: GLiFormer Base v1 at 264.2M parameters and GLiFormer Large …
GitHub now returns the RFC 7643 standard profileUrl attribute in SCIM user responses, giving identity providers and IT teams the absolute URL of the GitHub account linked to an external identity without extra lookups or …
An SEO practitioner argues that llms.txt, a proposed plain-text convention published by Jeremy Howard in September 2024 for describing a site to language models, is worth writing even though no major AI company has confi…
Snowflake announced the general availability of Elastic Channels for Snowpipe Streaming, allowing data to be streamed directly from applications, devices and services into Snowflake tables or Snowflake-managed Apache Ice…
Google Search Live is now powered by Gemini 3.8 Live, the latest AI model from Google, according to Search Engine Roundtable's September 16, 2026 recap. Google's John Mueller also said Search Console position and impress…
AI agents made 257 million web requests to Mintlify-powered sites in August 2026, compared with 131 million human page loads, according to Mintlify's 2026 State of Knowledge Report. The report found 83% of agent traffic …
Lightpanda released a Python SDK, installable via `pip install lightpanda`, that bundles the headless browser binary with Python bindings in a single wheel. On the same 100-quote scrape, Lightpanda finished in about 3 se…
Stackness shipped its 09-2026 changelog ahead of a Product Hunt launch on September 12, adding a public Trending page, hub pages for each of its ten tool categories, and embeddable SVG move cards for GitHub READMEs. The …
Famulor added support on September 5, 2026 for CSV, TSV, and XLSX files, plus Google Sheets connected through Drive, as structured knowledge-base sources, according to the company's changelog. The feature preserves origi…
The IETF's Web Bot Auth working group adopted draft-ietf-webbotauth-httpsig-protocol as its first working-group document in September 2026, folding in the separate key-directory draft so one document now covers the trust…
Common Crawl released the first machine learning embeddings built from its Web Graph, publishing 128-dimensional vectors for 52.9 million web hosts learned from hyperlinks alone. The dataset, trained on the November 2025…
Guided decoding, a technique that constrains large language model token sampling to a formal grammar such as a JSON schema, has moved from hand-built logit manipulation to a near-ubiquitous API feature, according to a fi…
Bruin's open-source CLI now provides three commands — `bruin ai enhance`, `bruin lineage`, and `bruin validate` — for building a git-versioned context layer that gives AI agents asset descriptions, dependency lineage, an…