implementation("com.xebia:xef-tokenizer:0.0.4-alpha.55")
Facilitates text tokenization for large language models, enabling efficient processing and analysis of textual data.