{"slug": "how-to-use-website-search-functionality-with-my-llm", "title": "How to use website search functionality with my LLM", "summary": "A developer recommends building a structured knowledge base from website content using chunking, embeddings, and a vector database for retrieval-augmented generation (RAG) to improve LLM search functionality, suggesting a combination of semantic and keyword search for reliable results on conversational queries.", "body_md": "Hi! One approach that works well is to build a structured knowledge base from your website instead of relying only on raw page crawling. If your site already has FAQs, service pages, pricing information, and educational content, you can chunk that content, generate embeddings, and store it in a vector database for RAG.\n\nFor local business websites, users often ask the same question in different ways, such as:\n\nA combination of semantic search and keyword search usually returns more reliable results than using only one approach, especially for conversational queries.\n\nI’m also interested to know what tools others are using to crawl websites and keep the knowledge base updated automatically.", "url": "https://wpnews.pro/news/how-to-use-website-search-functionality-with-my-llm", "canonical_source": "https://discuss.huggingface.co/t/how-to-use-website-search-functionality-with-my-llm/135257#post_3", "published_at": "2026-07-24 11:42:01+00:00", "updated_at": "2026-07-24 12:07:15.930047+00:00", "lang": "en", "topics": ["artificial-intelligence", "large-language-models", "ai-tools", "ai-infrastructure", "natural-language-processing"], "entities": [], "alternates": {"html": "https://wpnews.pro/news/how-to-use-website-search-functionality-with-my-llm", "markdown": "https://wpnews.pro/news/how-to-use-website-search-functionality-with-my-llm.md", "text": "https://wpnews.pro/news/how-to-use-website-search-functionality-with-my-llm.txt", "jsonld": "https://wpnews.pro/news/how-to-use-website-search-functionality-with-my-llm.jsonld"}}