8-29MB Automation Foundation Models For Tiny Devices
by cactus-compute
6.1k
Fast, lightweight inference framework for energy-efficient on-device AI: numerical computation graph API, OpenAI-compatible inference engine, INT8 optimizations and model/tooling for compact, low-power deployments.
#llm, #framework, #ai