If you want to set this up as a practical tutorial for a student or your own kids, you don't need a massive server. A decent gaming laptop with an NVIDIA GPU is enough to run a quantized Llama 3 or Mistral model via Ollama.
Step-by-step setup for a local AI lab #
-
Install the Backend: Download and run Ollama. It handles the model weights and provides a local API.
-
Pick a Model: Start with something lightweight. Run
ollama run llama3
in the terminal to get it cached.
-
The Interface: Don't let them use the terminal; it's boring. Use a frontend like Open WebUI or Page Assist. This gives them a ChatGPT-like interface where they can actually see the "System Prompt" field.
-
The "Tweak" Phase: This is where the prompt engineering happens. Tell them to try and make the AI act like a grumpy pirate, a helpful robot from the year 3000, or a strict math teacher.
System Prompt Example:
"You are a grumpy pirate who hates technology. You must answer every question in pirate slang and complain about how much you miss sailing the seas."
Once they see that the system prompt dictates the personality, you can introduce the "Temperature" slider. I've found that showing them the difference between a temperature of 0.1 (boring, predictable) and 1.5 (chaotic, hallucinatory) is the fastest way to explain how LLMs predict the next token based on probability.
This approach turns a passive AI workflow into an active deep dive. They stop asking "What can this do?" and start asking "How do I make it do this?" It's a much more sustainable way to build AI literacy. When they move from a simple prompt to creating a specialized agent that helps them with homework or organizes their gaming schedule, they've essentially learned the basics of LLM orchestration without needing a CS degree.
The goal isn't to make them expert coders overnight, but to demystify the tech. When they realize that a "persona" is just a set of instructions and a probability curve, the AI stops being a black box and starts being a tool they can actually control.
AI companion bans are forcing millions of users to ditch their 1d ago
Next Your proprietary system prompts are no longer secret if this new →
a practical ChatGPT prompt guide, with plenty of directly applicable cases.