cd /news/artificial-intelligence/stem-image-text-based-pdf-textbooks-… · home topics artificial-intelligence article
[ARTICLE · art-116518] src=discuss.huggingface.co ↗ pub= topic=artificial-intelligence verified=true sentiment=· neutral

STEM image/text based PDF textbooks for extraction, indexing and embeddings

A developer is seeking a pipeline to convert STEM PDF textbooks into searchable embeddings, with stages for OCR-to-Markdown conversion, figure extraction, JSON schema structuring, and vector embeddings for Firestore Vector Search, and is asking for model suggestions that can run locally on a laptop with cloud storage for specific stages.

read1 min views1 publishedAug 31, 2026

I am looking for the pipeline where the STEM (Science, Technology, Engineering and Math) textbooks which are in PDF format (images in pdf or text in pdf) to generate embeddings. the pipeline should achieve as below (or a better sub-stages)

  • stage1 - Converts scanned/image STEM PDFs into clean Markdown. It natively handles LaTeX equations (\sum, \int, powers x^2), multi-column reading orders, and tables without hallucinating. Run locally via GPU/CPU.
  • stage2 - isolates figure boxes and diagrams to save them separately in Cloud Storage for visual questions.
  • stage3 - Extracted Markdown is sent to build the canonical JSON schema ( Subject

\rightarrow Chapter

\rightarrow Topic

\rightarrow Concepts

).

  • stage4 - Generates vector embeddings for Firestore Vector Search to retrieve specific topics when building tests.

any suggestions for the models.. where we performs a few stages in local laptop and maintain in cloud for only requried stages..

── more in #artificial-intelligence 4 stories · sorted by recency
── more on @firestore 3 stories trending now
sponsored brought to you by zahid.host 4,200+ EU-deployed projects
reading about agents? ship yours in a single git push.

Run your AI side-project on zahid.host

EU-based hosting, git-push deploys, automatic HTTPS, no cold starts. Free tier with a custom domain — perfect for shipping the agent you just read about.

$git push zahid main
Live at https://your-agent.zahid.host
Get free account → Pricing
from €0/mo · no card required
LIVE [news/stem-image-text-base…] indexed:0 read:1min 2026-08-31 ·