Back to directory
Node Llama Cpp
Free2,079Run AI models locally on your machine with node.js bindings for llama.cpp. Enforce a JSON schema on the model output on
About
This tool runs AI models directly on your computer using Node.js bindings for llama.cpp. It's built for developers who want local model inference without cloud dependencies. You can enforce JSON schema validation during generation to get structured outputs.
Key Features
- ai
- bindings
- catai
- cmake
- cmake-js
Pricing
FreeOpen source. You supply your own LLM API keys.
Categories
CodingDevOps