Skip to content

With Anthropic lowering token limits today, we will need to consider perf / tokens more than I have. #177

@notque

Description

@notque

I have been avoiding caring too much about tokens as I never reach my limit, but people with cheaper plans are getting squeezed by Anthropic, and I will need to do significantly more to manage tokens so other people can use it effectively.

Will be starting that process now (actually before the issue i started), I am going to systematically try to adjust everything to use progressive discovery as much as possible, and lower token usage aggressively.

First off, significantly extend our blind a/b testing to do mass tests to validate the skills work better than before, even with the progressive discovery and lower token usage.

Might be slow going. Unsure. Every change needs to validate great impact.

Metadata

Metadata

Assignees

Labels

No labels
No labels

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions