implementation("com.xebia:xef-tokenizer:0.0.5-alpha.117")
Facilitates tokenization of text for natural language processing tasks, enabling efficient handling of large language models.
