Great job, this opens up a very promising path for small embedded systems!
on the same model class, there exists https://github.com/cactus-compute/needle which a tool calling only model with 26M parameters, I think if it would be supported it would enable native natural language control of real life actions totally offline! I find that idea really awesome!
Great job, this opens up a very promising path for small embedded systems!
on the same model class, there exists https://github.com/cactus-compute/needle which a tool calling only model with 26M parameters, I think if it would be supported it would enable native natural language control of real life actions totally offline! I find that idea really awesome!