I was thinking about some tests for a service that uses language models; there are several, even prompt injection. A question came to mind: is it possible to make multiple requests asking for any text like Lorem Ipsum, generating many unnecessary tokens and incurring costs? But creating a test where there are multiple accounts making the same request to generate 10,000 Lorem Ipsum tokens simultaneously, could that cause a service outage? Because most of the infrastructure I see doesn't use any queuing method when the chat is free of tasks involving an agent or even heavier functionalities.
I didn't actually generate anything, I just wanted to start a discussion on this topic.
source & further reading
dev.to — original article
System Prompt Leakage vs Prompt Injection in Spring Boot AI
Do we need smarter AI or smarter use of AI?
Why my first RAG layer starts in Postgres, not in a standalone vector database