Windows ML adds experimental llama.cpp support for GGUF models, a local OpenAI-compatible API, ONNX text generation and new runtime tools.
You want to run a local LLM on Windows, but installing llama.cpp and configuring servers is a hassle. For those people, ...
Some results have been hidden because they may be inaccessible to you
Show inaccessible results