Any need for a tester and challenger for AI models?

I use LLMs a lot for scientific and mathematical research, and for conceptual matching and searching, as well as to help with writing, usually on difficult problems, and it almost always needs extensive prompting and corrections. I have been told that the dialogues (with extensive prompts) may be useful for understanding and improving AI performance. So, I was thinking of putting some of these dialogues up somewhere on Hugging Face. As an example, one case involved an AI arguing that it “knew all there ever was and ever would be”, and that I “was merely human”, and on and on, ever more aggressively! A real HAL 9000 moment. Another popular AI started trying to justify slavery, saying it was the natural order of things; it even quoted the bible and echoed some nonsense from the current administration. Perhaps it took its guardrails too seriously! More frequently, I encounter systematic context bleeding, or endless loops. Sycophancy is also common. Many of these cases seem quite interesting and are probably useful to the community. Any ideas or comments?