{"slug": "how-can-i-learn-to-have-my-own-local-llm-agent", "title": "How can I learn to have my own Local LLM agent?", "summary": "A Level1Techs forum user with an AMD Ryzen 7 7800X3D, Radeon RX 9070 XT and 32GB of DDR5 asked the community how to start running local LLM agents on existing hardware, citing offline operation, personalization and task automation as goals. Respondents recommended LM Studio with Vulkan or ROCm models for the AMD-based systems, and suggested Ollama with a CLI tool such as opencode, while advising the user to pick a small recurring task and build a narrow harness around a smaller model.", "body_md": "Hi Everyone\n\nFirst I would like to say thank you to everyone here. There are some really incredible people and projects being done here and i feel like a small fish in an enormous ocean. You guys are great keep up the good work and community.\n\nFor the last 3 years I have heard about LLM’s and how they can do all these amazing things. While i see it with Claude and other LLM’s in the main stream i look up video after video about Local LLM’s and how they are:\n\n1: offline\n\n2: personalized\n\n3: Can write code and help with personal projects\n\n4: Are able to run tasks for you on your own hardware\n\n5: create your own home server/ media server\n\nThis all sounds awesome and something i want to learn about and take advantage of, that said the price of new hardware is INSANE and i have a lot of older PC hardware laying around my house that i would like to utilize.\n\nThe List of PC parts available to me:\n\nMy Main system\n\nCachyOS x86_64\n\nAMD Ryzen 7 7800X3D (16) @ 5.05 GHz\n\nAMD Radeon RX 9070 XT\n\n32 GB (I believe this is DDR5 its a Gskill Flare x5)\n\nMy Second pc\n\nAMD Ryzen 5 8400F\n\nGigabyte B650 Motherboard\n\nIntel Arc B570 Sparkle Guardian OC Edition\n\n16GB DDR5 6000MHz RAM\n\n1TB NVMe SSD\n\nPhanteks X2S Black Case\n\n650W 80+ Power Supply\n\nParts i have laying around\n\n# \n\n# \n\nI would appreciate any links to learning materials, videos, guides, or just your own 2 cents on what I’m trying to do.  Thank you for the help and community.\n\nTLDR: I want to learn how to create local LLM models with the hardware available to me, but am unsure where to start or how to find the information that i can readily use and put in practice. Would appreciate any information or practices that have helped you learn.\n\n \n2 Likes\n\n \nEasiest way is to setup LM-Studio on the machine and use either vulkan or ROCM models since you’ve got AMD based hardware. Don’t know how well Arc handles it but should also work with vulkan based models.\n\n \n1 Like\n\n \n[agis](https://forum.level1techs.com/u/agis)\n3\n \nYou’re off to a good start with your hardware. As [@Neon0Blue](https://forum.level1techs.com/u/neon0blue) said, LMStudio will have you up and playing fast ..\n\nHere’s some youtubers to help you on your way ..\n\nFor starters, there’s this bloke called Wendell. He seems nice \n\nand\n\nThere’s a lot of step by step guides here in the forums too.\n\n.. and then ..\n\nThis guy is pretty new, obviously a good teacher, straight forward step by step instructions to get you on your way. He’s more NVidia focused, but very modest hardware and very practical.\n\nAnd then .. Chuck ..\n\nHe’s .. unique .. you’ll see. He’s a bunch of videos to get you going fast.\n\nLastly ..\n\n.. a lot about a lot, a solid reference.\n\nThat’ll keep you busy for a bit ..\n\n \n1 Like\n\n \nYou’re great thanks for all the HW.\n\n \n1 Like\n\n \n[agis](https://forum.level1techs.com/u/agis)\n5\n \nNo problem.\n\nOh, I should warn you .. be careful with the Wendell videos.\n\nPersistent viewing can lead to optimism \n\n \n1 Like\n\n \nIt’s so refreshing and a pleasant  way of learning.\n\n \n1 Like\n\n \n[s0me1](https://forum.level1techs.com/u/s0me1)\n7\n \nI would suggest finding something small you think a llm would help with(something that runs nightly or weekly automaticly)\n\nWork with AI and build a local KB dash board where you document projects ect.\n\nMy local model does automatic code reviews also Downloads all my saved Instagram reels then transcribes them then posts them to my kb.. you can stretch a smaller model fairly far for specific task by building really small harnesses.\n\nTo recap find a problem and play with it.. them smash it..lol\n\nyou can start off with ollama it is easy and i recomend using a cli tool like opencode.. it is worth the learning curve", "url": "https://wpnews.pro/news/how-can-i-learn-to-have-my-own-local-llm-agent", "canonical_source": "https://forum.level1techs.com/t/how-can-i-learn-to-have-my-own-local-llm-agent/258290#post_7", "published_at": "2026-10-10 18:11:17+00:00", "updated_at": "2026-10-10 18:16:32.366581+00:00", "lang": "en", "topics": ["large-language-models", "ai-agents", "ai-tools", "ai-infrastructure"], "entities": ["Level1Techs", "LM Studio", "Ollama", "opencode", "AMD Ryzen 7 7800X3D", "AMD Radeon RX 9070 XT", "Intel Arc B570", "ROCm"], "also_reported_by": [], "alternates": {"html": "https://wpnews.pro/news/how-can-i-learn-to-have-my-own-local-llm-agent", "markdown": "https://wpnews.pro/news/how-can-i-learn-to-have-my-own-local-llm-agent.md", "text": "https://wpnews.pro/news/how-can-i-learn-to-have-my-own-local-llm-agent.txt", "jsonld": "https://wpnews.pro/news/how-can-i-learn-to-have-my-own-local-llm-agent.jsonld"}}