At a Glance
| Vendor | KoboldAI |
|---|---|
| Website | github.com/LostRuins/koboldcpp |
| Category | Local LLM |
| Default Risk Rating | Medium |
| Default Status for New Clients | Unapproved |
| Recognized By | Its installed app, found by the device inventory |
| Desktop App Inventoried | Web Only |
| Coverage | Inventory |
| Catalog Reviewed | October 28, 2026 |
The risk rating and default status are ProctoredAI's starting points for a new client. Each MSP sets the status per client. How apps are rated and verified.
What to Know About KoboldCpp
Local model runtime for chat and stories (port 5001 by default).
Why Local LLM Tools Need Governing
Local runtimes run models on the device, so nothing is inspected on the way out, and downloaded models can be anything.
Inventory the runtimes and models on every device and decide per client whether local models are allowed.
How ProctoredAI Governs KoboldCpp
- See it. The agent reports every device with KoboldCpp installed.
- Decide it. Mark it Approved, Unapproved or Blocked for each client. Unapproved use can ask the person for a business reason first.
- Protect what is sent. ProctoredAI finds the installed app; set it Blocked or Unapproved per client until a use case is approved.
- Prove it. Usage, decisions and blocked events land in the client's monthly report as evidence.
Policy Packs That Fit
- Credentials & Secrets. Block API keys, private keys, passwords and connection strings everywhere.
- Sensitive Documents. Contracts, financial statements, HR and medical records, customer lists and credential files may only go to approved AI apps.