{"slug": "chatbot-start-prompt-for-gpt-j", "title": "Chatbot Start Prompt for GPT-J", "summary": "A Hugging Face forum user identified as Eichhof reported that using EleutherAI's GPT-J 6B model as a chatbot produces inconsistent conversations because the model continues the sample conversation prompt instead of responding to new user input. Forum user PanEa advised adding example conversations as few-shot prompts and inserting a special line or token to separate each episode, and Eichhof asked how many conversations and turns are reasonable given GPT-J's 2,024-token context limit.", "body_md": "[Eichhof](https://discuss.huggingface.co/u/Eichhof)\n1\n \nHello\n\nI’m using GPT-J (EleutherAI/gpt-j-6B) as a chatbot. As a prompt, I provide a sample conversation as shown below. When now a new conversation starts, I append the input of the user to this sample conversation (“Hello, how are you doing?” in the example below).\n\nNow, the problem is that the conversation is sometimes inconsistent because GPT-J might want to continue the sample conversation but the new user input could break that.\n\nHow can this be solved?\n\nThis is a discussion between a Human and a Chatbot.\n\nHuman:\n\nCan you do push-ups?\n\nChatbot:\n\nOf course I can. It’s a piece of cake! Believe it or not, I can do 30 push-ups a minute.\n\nHuman:\n\nReally? I think that’s impossible!\n\nChatbot:\n\nYou mean 30 push-ups?\n\nHuman:\n\nYeah!\n\nChatbot:\n\nIt’s easy. If you do exercise everyday, you can make it, too.\n\nHuman:\n\nHello, how are you doing?\n\nChatbot:\n\n \n \n[Eichhof](https://discuss.huggingface.co/u/Eichhof)\n2\n \nDoes somebody have an idea?\n\n \n \n[PanEa](https://discuss.huggingface.co/u/PanEa)\n4\n \nyou may add some example conversations/episodes as few-shots, which can lead the model to generate much better. also you need a special line or token to seperate each episode incase the information in previous episodes been used in the last one\n\n \n \n[Eichhof](https://discuss.huggingface.co/u/Eichhof)\n5\n \nThank you very much for your answer. How many conversations and how many turns per conversation do you think are reasonable given the restricted history of 2024 tokens and that I also want to store the history of the conversation?\n\nWhat special line / token would you use?\n\n \n \nI agree with your point. Asking ChatGPT to explain things step by step is very useful because it makes difficult topics easier to understand. I also find that asking for examples helps connect the explanation to real tasks.\n\n \n \nI agree with your point. Asking ChatGPT to explain things step by step is very useful because it makes difficult topics easier to understand. I also find that asking for examples helps connect the explanation to real tasks.", "url": "https://wpnews.pro/news/chatbot-start-prompt-for-gpt-j", "canonical_source": "https://discuss.huggingface.co/t/chatbot-start-prompt-for-gpt-j/23576#post_7", "published_at": "2026-09-22 05:05:00+00:00", "updated_at": "2026-09-22 05:25:40.763075+00:00", "lang": "en", "topics": ["large-language-models", "ai-tools", "natural-language-processing"], "entities": ["Hugging Face", "GPT-J", "EleutherAI", "Eichhof", "PanEa", "ChatGPT"], "alternates": {"html": "https://wpnews.pro/news/chatbot-start-prompt-for-gpt-j", "markdown": "https://wpnews.pro/news/chatbot-start-prompt-for-gpt-j.md", "text": "https://wpnews.pro/news/chatbot-start-prompt-for-gpt-j.txt", "jsonld": "https://wpnews.pro/news/chatbot-start-prompt-for-gpt-j.jsonld"}}