implementation("com.xebia:xef-tokenizer:0.0.5-alpha.104")
Facilitates tokenization of text for large language models, enabling efficient processing and analysis.
