# ResumeForge: A Privacy-First AI Resume Analyzer Built with Local Open-Weight Models

> Source: <https://dev.to/devnegi/resumeforge-a-privacy-first-ai-resume-analyzer-built-with-local-open-weight-models-9k9>
> Published: 2026-10-17 18:29:30+00:00

*This is a submission for the [Hacktoberfest Open-Source AI Challenge Week 2: Side Hustle](https://dev.to/challenges/hacktoberfest-week2-2026-10-12)*

Every time someone applies for a job today, they are handed the same advice: *"Tailor your resume to the job description."* But behind that simple advice is a frustrating dilemma. 

Existing commercial resume optimization tools charge $20 to $40 a month. Worse, they demand that you upload your entire professional life—phone numbers, employment history, company names, side projects, references, and education—onto their remote servers. Once uploaded, your career data is fed through third-party proprietary APIs, stored in external databases, and often retained for downstream model training.

For developers, privacy-conscious professionals, freelancers, and students on tight budgets, this is an unacceptable trade-off.

I built **ResumeForge** to solve this.

ResumeForge is an AI-powered resume analysis and tailoring platform that runs **100% locally on your machine using open-weight models**. No cloud AI inference. No subscriptions. Zero data leaving your computer.

`.pdf` or `.docx`) and paste any target Job Description (JD).
As a side-hustle product, ResumeForge can be delivered as a packaged local-first desktop app, a self-hosted workspace for recruiting agencies, or a freemium desktop utility with premium local workflow templates.

Check out the project demo:

| Landing & Auth | Analysis Engine | Full Audit Results | 
|---|---|---|

The entire codebase is open-source and ready to clone:

*A privacy-first, open-weight AI tool that matches your resume to any job description — no cloud, no data sharing, no subscription.*

**Demo Screenshots**

GitHub Repository: [https://github.com/NegiSushant/ResumeForge](https://github.com/NegiSushant/ResumeForge)

ResumeForge is architected around the premise that **commodity consumer hardware is now capable of running production-grade AI analysis** if prompt design, parsing pipelines, and local inference orchestration are done right.

```
┌────────────────────────────────────────────────────────┐
│                      Next.js 16                        │
│             App Router + Tailwind CSS                  │
└───────────────▲────────────────────────▲───────────────┘
                │                        │
       Upload & Parse Stream      Session & History
                │                        │
┌───────────────▼──────────────┐ ┌───────▼───────────────┐
│ pdfjs-dist / mammoth         │ │ MongoDB Atlas / Local │
│ (Client / Server Extractors) │ │ (Mongoose + NextAuth) │
└───────────────┬──────────────┘ └───────────────────────┘
                │
         Extracted Text
                │
┌───────────────▼────────────────────────────────────────┐
│ OpenAI SDK (BaseURL: http://localhost:11434/v1)        │
└───────────────┬────────────────────────────────────────┘
                │
┌───────────────▼────────────────────────────────────────┐
│ Docker Model Runner (DMR)                              │
│ └── ai/gemma3:1b-q4_K_M (Open-Weight Gemma 3 1B)       │
└────────────────────────────────────────────────────────┘
```

Instead of piping text to remote proprietary endpoints, ResumeForge delegates inference to Google's open-weight **Gemma 3 (1B)** (`ai/gemma3:1b-q4_K_M`), quantized at 4-bit precision.

Inference is managed via **Docker Model Runner (DMR)**. This allowed me to:

`http://localhost:11434/v1` or native DMR port) with zero external setup friction.`openai` Node SDK inside Next.js route handlers simply by pointing `baseURL` to the local Docker daemon.
Working with a lightweight 1-billion parameter model taught me a huge amount about constraint-driven AI engineering.

A 1B model is lightning fast and runs with a negligible memory footprint (~1.2 GB RAM), but it can easily wander or drop structured fields if given ambiguous instructions. To get deterministic, publication-grade resume evaluations out of Gemma 3 1B:

`pdfjs-dist` for raw text and structure parsing from PDFs, and `mammoth` for parsing Open innovation is not just an alternative deployment model; for an application like ResumeForge, **it is the only model that aligns with user ethics and long-term viability.**

Career data is intimate. Resumes reveal your identity, residential address, compensation progression, side ventures, and clearances.

When you use proprietary SaaS resume checkers powered by closed APIs, you are forced to trust a chain of third parties not to log, leak, or train on your identity. Open innovation means the model weights live on *your* disk, the inference executes inside *your* memory, and the network cable could literally be unplugged while your resume is analyzed.

Building an AI side hustle on closed APIs creates an existential vulnerability: **variable marginal cost**. Every time a user uploads a 4-page resume and a long JD, you pay token costs. If a user tests 20 resumes, your margins evaporate.

With open-weight models like Gemma 3 running locally or self-hosted:

A student in an emerging market or an unemployed worker should not have to pay $30/month just to understand why their resume is failing ATS filters. Open-weight models level the playing field, making world-class career analysis accessible to anyone with a modest laptop.

During development, agentic pair programming helped scaffold the Next.js 16 App Router endpoints, optimize the Docker Model Runner configurations, and iterate through prompt calibrations for Gemma 3's output parsing.

I am entering ResumeForge into the following categories:

`ai/gemma3:1b-q4_K_M`), pushing the limits of what a compact 1B model can achieve through calibrated system prompts and structured JSON enforcement.
