# How to use free AI inside AWFlow: Agents, Chat and Automation without an API key

> Source: <https://awflow.io/blog/free-ai-local-agents-chat-automation-awflow>
> Published: 2026-10-14 00:00:00+00:00

How to use free AI inside AWFlow: Agents, Chat and Automation without an API key

Install a local AI model once and it powers everything in AWFlow: the chat assistant, your agents and your automation workflows. A practical walkthrough, step by step.

Install a model once. Chat, agents and automations use it for free.

The hook. One install, three things.A 3-second opener before the first chapter.The hook. One install, three things.A 3-second opener before the first chapter.

Hook↻ ReplayText version

One install: Install a model once. Chat, agents and automations use it for free.

Most AI tools charge per message. Every automation run, every chat reply, every agent action ticks a meter. AWFlow includes a local AI layer that runs models inside your browser. Install a model once, and the three main features—Chat, Agents and Automation—all use it at zero per-use cost.

This is a walkthrough. By the end you will have a model installed, the chat assistant pointing at it, an agent using it, and a working automation that summarises the page you are on.

Step 1 — Install a model

Everything starts on the Local AI page. Open AWFlow, go to Settings, then Local AI. You will see models grouped by task: chat, embeddings, image classification, speech-to-text and more.

123

1Pick the task firstFor chat and agents: pick Chat.

2Read the cardSize and device fit before you download.

3Protect your storageTurn on Keep models installed.

Pick a model and install it.For most laptops: Llama 3.2 1B (q4f16_1), about 879 MB.Tasks first. Choose Chat for the assistant and agents.Models are grouped by task across WebLLM, TF.js and transformers.js.Each card shows size and whether it fits your device.Device fit is estimated from your browser's memory report; test after installing.Keep models installed tells the browser not to clear them.Browsers can evict stored data under storage pressure; this requests persistent storage.Pick a model and install it.For most laptops: Llama 3.2 1B (q4f16_1), about 879 MB.

Guided screenshot↻ ReplayText version

1. Pick the task first: For chat and agents: pick Chat.

2. Read the card: Size and device fit before you download.

3. Protect your storage: Turn on Keep models installed.

For most laptops, start with Llama 3.2 1B (q4f16_1) — about 879 MB. If answers feel weak after testing, go to the 3B variant.

12

1Choose a variantSmallest first: about 879 MB.

2InstallDownloads in the background while you work.

Once done, AWFlow sets it as the default for chat.No further configuration needed.Pick the smallest that fits your device.q4f16_1 is 4-bit weights, float-16 compute — the usual starting point.Install runs in the background. You can keep working.Progress shown in the model card; cancel any time.Once done, AWFlow sets it as the default for chat.No further configuration needed.

Guided screenshot↻ ReplayText version

1. Choose a variant: Smallest first: about 879 MB.

2. Install: Downloads in the background while you work.

Once the download finishes, AWFlow automatically sets the model as the default for chat.

Step 2 — Chat with free AI

Open the AWFlow side panel in any browser tab. The chat box is front and centre. The model picker at the bottom shows the model you just installed.

123

1Check the modelShows the installed model by default.

2Type a messageAsk anything, or ask about the page.

3Context meterShows how much of the window is used.

Nothing left the tab.Zero data sent to an external endpoint when using Web LLM.The model picker shows which model handles your message.Selects from installed Web LLM models on the Local AI page.Type anything. The reply comes from your device.The request never leaves the browser when using a local model.The context meter shows the model's memory filling up.Each message adds to the context window; older ones roll off when it fills.Nothing left the tab.Zero data sent to an external endpoint when using Web LLM.

Guided screenshot↻ ReplayText version

1. Check the model: Shows the installed model by default.

2. Type a message: Ask anything, or ask about the page.

3. Context meter: Shows how much of the window is used.

You can ask about the page you are reading. Type “Summarise this page” and AWFlow reads the visible text and passes it to the model.

Your browser

Local model

Chat panel

Web LLM modelrunning in your browser

page text + question

the summary

Network callnoneLeaves your deviceno

Same interface as a cloud model. Just a different destination.The chat box is identical; the difference is the model picker setting.Your text goes to the model. The model is also in your browser.The Web LLM engine runs on your GPU via WebGPU; no HTTP request to any server.The model is in the same browser. No round trip to a server.The inference is local; weights were downloaded once.The reply comes back. Nothing left the tab.Zero data sent to an external endpoint.Same interface as a cloud model. Just a different destination.The chat box is identical; the difference is the model picker setting.

Round trip↻ ReplayText version

Your browser: Chat panel · Local model: Web LLM model

Chat panel → Web LLM model: page text + question

Web LLM model → Chat panel: the summary

Network call: none · Leaves your device: no

Step 3 — Build an agent that uses no API

An agent is a chat-driven assistant that can act: read pages, fill forms, search notes. When the model behind the agent is local, every agent action is free.

123

1Start blankOr pick a template.

2Describe what you wantAria drafts the agent for you.

3Use a templatePre-built agents for common jobs.

Either way, the model is the one you installed.The agent uses the Local AI default unless you change the model picker.Start from scratch or pick a template.Templates are agent definitions pre-filled with a role, skills and a system prompt.Describe the agent in plain words.Aria reads the description and drafts the agent: role, skills, optional knowledge base.Templates give you a ready-made starting point.Each template sets the role, enables the relevant skills and includes a prompt.Either way, the model is the one you installed.The agent uses the Local AI default unless you change the model picker.

Guided screenshot↻ ReplayText version

1. Start blank: Or pick a template.

2. Describe what you want: Aria drafts the agent for you.

3. Use a template: Pre-built agents for common jobs.

In the agent builder, the Identity tab sets the role and name. The Skills tab controls what the agent is allowed to do. After saving, the agent uses the default local model. To override it for one agent, change the model picker inside that agent’s chat:

123

1Open an agentEach agent has its own thread.

2Model for this agentChange it here to override the default.

3ChatAll its actions use the chosen model.

Switch back to the default at any time.The picker resets to the Local AI default if you clear the override.Open an agent's chat. Each one has its own thread.Threads are per agent; memory and context are scoped to the agent.Change the model for this agent only.The model picker here overrides the default for this agent's session.Everything the agent does uses that model.Read page, search, recall from memory — all route through the same model.Switch back to the default at any time.The picker resets to the Local AI default if you clear the override.

Guided screenshot↻ ReplayText version

1. Open an agent: Each agent has its own thread.

2. Model for this agent: Change it here to override the default.

3. Chat: All its actions use the chosen model.

Step 4 — Add free AI to an automation workflow

Automations run on a schedule or on a trigger, without you being there. A local model works in automations too: add a Web LLM node, and every run is free.

The fastest way to see this is the Summarize This Page example. It reads the page you are on and returns a summary in the side panel.

Open the summary step. Change length and style to taste.Summarize node: max 120 words, a few bullet points. The model is the Local AI default.A real workflow. Copy it to your AWFlow in one click.The docs example: Get All Text → Summarize (Local AI) → Show Summary.Open the summary step. Change length and style to taste.Summarize node: max 120 words, a few bullet points. The model is the Local AI default.

Workflow embed↻ ReplayText version

summarize-this-page.awf

Max words: 120 · Style: a few bullet points

After copying, look at the Summarize step. Its model slot is pre-filled with the model you installed.

123

1The AI stepHolds the prompt.

2Model slotYour installed local model lives here.

3Test runRuns on the current page.

The model slot is the only thing that changes if you upgrade.The logic, the prompt and the rest of the workflow stay exactly the same.The AI step is a Basic LLM Chain.Applies a prompt template to the incoming text. Any model can sit in the slot below it.The model slot holds the local model.Web LLM node: uses the installed browser model. Change to a cloud model to upgrade.Test it on the current page.Test Workflow button runs the workflow once and shows outputs under each node.The model slot is the only thing that changes if you upgrade.The logic, the prompt and the rest of the workflow stay exactly the same.

Guided screenshot↻ ReplayText version

1. The AI step: Holds the prompt.

2. Model slot: Your installed local model lives here.

3. Test run: Runs on the current page.

The model slot is intentional. The workflow does not hardcode a model: it uses whichever model is in the slot. Swap to a cloud model for tougher jobs; the rest of the workflow stays the same.

Any web page

Get All Text

Summarize (Web LLM)

Show Summary

visible textraw page text120-word summaryside panel result

The result appears in the side panel.Show Summary node writes to the display panel.The page text goes in.Get All Text reads the visible DOM text.Get All Text extracts what is readable.All visible text nodes, no HTML, no markup.The local model summarises it.Web LLM node: prompt + text → summary. No API call.The result appears in the side panel.Show Summary node writes to the display panel.

Pipeline↻ ReplayText version

Any web page: visible text

Get All Text: raw page text

Summarize (Web LLM): 120-word summary

Show Summary: side panel result

What free AI covers, and what it does not

Local models handle a wide range of everyday AI jobs well. They miss on tasks that need large context windows, the most recent knowledge or very complex reasoning.

Good fits for local models

What a local model handles well in AWFlow

Summarising pages and articles (done)local AI

Extracting structured fields from text (done)local AI

Classifying and tagging items (done)local AI

Rewriting and reformatting text (done)local AI

Drafting short messages based on context (done)local AI

Answering questions about the current page (done)local AI

Q&A on the current page is the simplest workflow you can build.Pass the page text as context; ask the question.Summarising works well.Summarisation is a compression task; small models are competitive.Extracting fields from messy text is a strong use case.Structured extraction from page text: name, price, date, etc.Classifying items is fast and free at any scale.Labelling thousands of items costs the same as labelling one.Rewriting short text: subject lines, bullets, short replies.Small context window; keep the input short for best results.Drafting short messages from context saves minutes per day.Agent with page context + email draft prompt.Q&A on the current page is the simplest workflow you can build.Pass the page text as context; ask the question.

Checklist↻ ReplayText version

What a local model handles well in AWFlow

Summarising pages and articles

Extracting structured fields from text

Classifying and tagging items

Rewriting and reformatting text

Drafting short messages based on context

Answering questions about the current page

When a task regularly produces weak results, the upgrade path is one change: swap the model slot to a cloud provider. The rest of the workflow is unchanged, and only that step becomes a paid call.

Your turn

Try it: Summarize any page for free

Copy the workflow, install a local model, run it on the page you are reading.

Try it now. The workflow is one click away.Try it now. The workflow is one click away.

Try it↻ ReplayText version

Try it: Summarize any page for free · Copy the workflow, install a local model, run it on the page you are reading. · https://docs.awflow.io/examples/summarize-this-page.awf

What we covered

01Install once on Local AI: chat, agents and workflows share the model

02The chat assistant uses the local model by default

03Workflows use a model slot: free now, cloud model later, no rewrite

Workflows stay the same when you upgrade the model.The model slot is a dependency node; changing it does not change the logic.One install. Everything uses it.One model on Local AI, shared by the assistant, each agent and every workflow node.Chat is immediate. Open the side panel and start.Default model is pre-selected; change it from the model picker.Workflows stay the same when you upgrade the model.The model slot is a dependency node; changing it does not change the logic.

Recap↻ ReplayText version

What we covered

Install once on Local AI: chat, agents and workflows share the model

The chat assistant uses the local model by default

Workflows use a model slot: free now, cloud model later, no rewrite
