Description
💗 I love this tool 💗
I often use it to generate commit messages with local LLMs, so it’s really cheap.
As a core dependency of numerous AI tools, llama.cpp benefits from extensive real-world testing and tends to be highly stable.
It provides an OpenAI-compatible API. And host on http://localhost:8080/v1/chat/completions by default.
Suggested Solution
Hoping llama.cpp can be supported.
Alternatives
No response
Additional Context
No response
Description
💗 I love this tool 💗
I often use it to generate commit messages with local LLMs, so it’s really cheap.
As a core dependency of numerous AI tools, llama.cpp benefits from extensive real-world testing and tends to be highly stable.
It provides an OpenAI-compatible API. And host on http://localhost:8080/v1/chat/completions by default.
Suggested Solution
Hoping llama.cpp can be supported.
Alternatives
No response
Additional Context
No response