implementation("ai.koog:prompt-tokenizer:0.5.2")
Facilitates text tokenization and token counting for large language models, offering various implementations for accuracy and performance.
