implementation("ai.koog:prompt-tokenizer:0.4.2")
Facilitates token counting and text tokenization for large language models, offering multiple implementations with varying accuracy and performance.
