To Perchance's owner regarding the new AI Chat Generator

I am not sure if Perchance's owner will ever read my message, but the fact is that despite being a huge community, we have no way to communicate or speak directly to the person who gave us the chance to enjoy the wonders of AI for free.

I just want to thank you for finally updating the AI chatbot after 1.5 years of waiting, but now we are completely lost, so can you please publish an update on the site or post here and tell us about the new model? We are speculating that it may be Llama 3.3, DeepSeek, or Claude Sonnet 3.5. And for the love of god, can you increase the token context window? If we are really using models that can remember more than 100k tokens, having a tiny 6k token window is insane. Thanks.

5 comments

It could be deepseek, because Chloe (the ACC assistant) gets very scared and avoidant when topics like tiananmen square massacre, uyghur genocide and Taiwan get brought up, not to mention it functions similarly to chatgpt as many people have noticed, also claude and Llama 3.x/4 won't have a problem talking about the aforementioned topics, unlike deepseek. As for the token size, we still don't know, it really depends on the model and the hardware capabilities of the dev's setup, it could range from 8k-16k all the way up to 128k.
Where's the bot that's behaving bad? These 2 URLs look to be Anthropic API to me:
https://perchance.org/ai-story-generator
https://perchance.org/ai-chat
And for the love of god, can you increase the token context window? If we are really using models that can remember more than 100k token
This specification is an absolute lie, most of the time. Most '128K' LLMs fall apart after 24K tokens or so, even big API ones. There are only a few worth anything past 64K.
In addition, it's also very hardware intense and slow to host very long context windows (the way most folks host them without knowing any better). If they're hitting APIs instead, its usually very expensive that way too, as there's no caching and they get charged for submitting 100K tokens with every turn.
- I know, I don't need to prompt an entire book as lore, I am just asking for 15-20k.
  
  Yeah, that's doable. But the context is likely low for cost reasons.
  The writing UIs like that are pretty 'normal', formatted like Kobold or SillyTavern: https://lite.koboldai.net/
  So you might consider dropping a few pennies on a legit dungeonmaster/text RPG finetune via some API, like openrouter. Hosting Claude or Llama like Perchance does for free is pretty generous, TBH.
The old model was way better, honestly. This one makes more mistakes, and tends to have characters act more wild and hostile during certain situations. It needs to be switched back to what it used to have. What was before was pleasant.