AI models cost more when you don’t use English: Some languages require far more tokens for AI models to process, raising costs and reducing context for the people who use them.

eicker@lemmy.world · 2 days ago

AI models cost more when you don’t use English: Some languages require far more tokens for AI models to process, raising costs and reducing context for the people who use them.

Ardyssian@sh.itjust.works · 1 day ago

To add on, when using GitHub Copilot you can see a distinction between AI “Credits” and Tokens (in the context window for that conversation). One reason is that each Model architecturally has a different tokenizer, so one what one Model considers as one Token is different from another. To normalize the overall compute costs across different Models, the AI Credit unit is used as an abstraction.