I wanted a set of everyday tools — merge a PDF, compress an image, read text from a screenshot — that I could use without up my files to someone else's server. So I built Smart Online Tools: 80+ free tools where all the processing happens in the browser.
The PDF and image tools were the easy part. The interesting part was the AI tools: OCR, speech-to-text, translation, background removal, face blurring and alt-text writing, all running on the visitor's device. Here's how that works and what I learned.
| Tool | Model | First download |
|---|---|---|
| Image to text (OCR) | Tesseract | 2–15 MB per language |
| Speech to text | Whisper base | ≈ 80 MB |
| Translator | OPUS-MT (Helsinki-NLP) | ≈ 80–110 MB per direction |
| Background remover | MODNet | ≈ 26 MB |
| Blur faces | MediaPipe BlazeFace | < 1 MB |
| Alt-text generator | Florence-2 base | ≈ 250–450 MB |
Every model has a permissive licence (MIT, Apache-2.0 or CC BY 4.0). I deliberately skipped a few good models because of their licences. For example, one popular text-to-speech model depends on a GPL phonemizer. For text to speech I use the browser's built-in device voices instead.
Each model downloads only when someone actually clicks the tool. A single worker keeps loaded models in a cache, so the second run is instant:
import { env, pipeline } from "@huggingface/transformers";
env.allowLocalModels = false;
env.useBrowserCache = true; // the model is downloaded once, then reused
const cache = new Map<string, Promise<any>>();
function loadTranslator(pair: string) {
const key = `translate:${pair}`;
if (!cache.has(key)) {
const p = pipeline("translation", `Xenova/opus-mt-${pair}`, { dtype: "q8" })
.catch(() => pipeline("translation", `Xenova/opus-mt-${pair}`, { dtype: "fp32" }));
p.catch(() => cache.delete(key)); // allow a retry after a network error
cache.set(key, p);
}
return cache.get(key)!;
}
I try a quantized version first (smaller and faster), and fall back to full precision if a model doesn't ship one.
OPUS-MT models translate one direction each, for example en-de or de-en. Not every pair has a direct model, so the translator routes through English when it needs to:
const DIRECT = new Set(["de-es", "es-fr", "fr-de" /* … */]);
const route = (from: string, to: string) =>
from === "en" || to === "en" || DIRECT.has(`${from}-${to}`)
? [`${from}-${to}`]
: [`${from}-en`, `en-${to}`];
Long text is split into sentence groups of about 400 characters, so each call stays inside the model's limits and the progress bar actually moves.
All the AI tools are at smartonline.tools/ai-tools. They're free, need no account, and your files stay on your device.
I'd love feedback, especially on speed on your hardware, accuracy, and which tool you'd want next.