I am looking for the pipeline where the STEM (Science, Technology, Engineering and Math) textbooks which are in PDF format (images in pdf or text in pdf) to generate embeddings. the pipeline should achieve as below (or a better sub-stages)
- stage1 - Converts scanned/image STEM PDFs into clean Markdown. It natively handles LaTeX equations (\sum, \int, powers x^2), multi-column reading orders, and tables without hallucinating. Run locally via GPU/CPU.
- stage2 - isolates figure boxes and diagrams to save them separately in Cloud Storage for visual questions.
- stage3 - Extracted Markdown is sent to build the canonical JSON schema (
Subject
\rightarrow Chapter
\rightarrow Topic
\rightarrow Concepts
).
- stage4 - Generates vector embeddings for Firestore Vector Search to retrieve specific topics when building tests.
any suggestions for the models.. where we performs a few stages in local laptop and maintain in cloud for only requried stages..