implementation("ai.koog:prompt-tokenizer:0.5.0")
Facilitates text tokenization and token counting for large language models, offering multiple implementations with varying accuracy and performance.
