ext/new-api
2
0
Fork 0
mirror of https://github.com/QuantumNous/new-api.git synced 2026-09-03 04:43:01 +00:00
Code Activity
6,100 Commits 15 Branches 686 Tags
0918bdb49a5193a7e8cf03a0d17871ad0cdf9d24
Commit Graph
2 Commits
Author SHA1 Message Date
CaIon 2e4d27e001 feat(token_estimator): add concurrency support for multipliers retrieval 2025-12-02 21:38:58 +08:00
CaIon 1fededceb3 feat: refactor token estimation logic 
- Introduced new OpenAI text models in `common/model.go`.
- Added `IsOpenAITextModel` function to check for OpenAI text models.
- Refactored token estimation methods across various channels to use estimated prompt tokens instead of direct prompt token counts.
- Updated related functions and structures to accommodate the new token estimation approach, enhancing overall token management.
 2025-12-02 21:34:39 +08:00