implementation("ai.koog:prompt-tokenizer:0.7.3")
Facilitates text tokenization and token counting for large language models, offering interfaces and implementations with varying accuracy and performance.
