Stubsack: weekly thread for sneers not worth an entire post, week ending 17th August 2025
Architeuthis @ Architeuthis @awful.systems Posts 18Comments 539Joined 2 yr. ago

Architeuthis @ Architeuthis @awful.systems
Posts
18
Comments
539
Joined
2 yr. ago
I think this hinges on the system prompt going after the user prompt, for some router-related non-obvious reason, meaning at each model change the input is always new and thus uncacheable.
Also going by the last Claude system prompt that leaked these things can be like 20.000 tokens long.