Ability to stop bot's answer
🥚 Idea
113 upvotes 🙌
When we detect a bot is hallucinating or provide erroneous information, we should be able to interrupt the bot's answer to save some tokens in case of long answers.
🥚 Idea
113 upvotes 🙌
Save
contact •
8 months ago
Also, have an API call so we can stop it as well!
info •
9 months ago
That's actually a great idea. There are times where the bot is typing a ton of irrelevant information wasting our tokens.