CommonJSJVMNative

Ktoken

Ktoken: a BPE tokenizer for OpenAI's models, implemented in Kotlin.

Add to your project
implementation("com.aallam.ktoken:ktoken:0.3.0")
Parent project
ktoken
by Aallam
17

Kotlin multiplatform BPE tokenizer library for OpenAI models

v 0.4.0 (4 months ago)
CommonJSJVMNative
Version history
Package version Release date Platforms
0.4.0 4 months ago Common, JVM, Native, JS Details
0.3.0 12 months ago Common, JVM, Native, JS
0.2.0 12 months ago Common, JVM, Native, JS Details
0.1.0 12 months ago Common, JVM, Native, JS Details
More versions will be indexed soon
Metadata
Version 12 months ago

0.3.0

  • Kotlin 1.9.10
  • Gradle 8.4
Supported targets
JVM:
  • 17
Linux:
  • linux_x64
Windows:
  • mingw_x64
iOS:
  • ios_arm64
  • ios_simulator_arm64
  • ios_x64
macOS:
  • macos_arm64
  • macos_x64
tvOS:
  • tvos_arm64
  • tvos_simulator_arm64
  • tvos_x64
watchOS:
  • watchos_arm32
  • watchos_arm64
  • watchos_simulator_arm64
  • watchos_x64
Developers
License