KV cache capacity budget (new)
Offline single-GPU MHA/GQA memory planner. Enter your own measured or estimated model-weight and runtime reservations. Accounts for KV block rounding.
Open developer tools
Small, inspectable Python utilities accompanying our technical guides. Download the source, review it, and run it in your own environment. Every tool has explicit assumptions and boundaries. These are not claims of physical GPU testing or independent performance benchmarks.
Before use: inspect any downloaded script and its dependencies. Some tools execute local synthetic tests or create temporary files; others only parse input. The new KV planner models a declared memory budget, not measured serving performance. Python sources are supplied as examples without warranties.
GPU and local LLM serving
Inspect memory assumptions and debug runtime signals without running GPU workloads.
NCCL error-log triage
Classifies common NCCL failure signals in existing logs without executing GPU commands.
CUDA header path check
Inspects local path candidates for CUDA Toolkit header files. Does not install dependencies.
Linux containers and MCP
Bounded diagnostics and synthetic checks for common engineering failures.
Docker exit-code 137 triage
Reads previously captured Docker state JSON from standard input; does not invoke Docker.
Docker GPU flag reviewer
Inspects a Docker command as plain text for port exposure and privileged options. Does not execute it.
MCP subprocess timeout smoke test
Uses fixed synthetic child processes to test local timeout cleanup behavior.
Bounded local MCP server
Sample MCP server for inspected local development. Review source and dependencies before use.
MCP stdio client smoke test
Example local MCP stdio client check. Review command and environment requirements before use.
SQLite vector memory smoke test
Creates a disposable local fixture database using synthetic vectors.
Offline research comparisons
Compare previously collected evidence, not fabricated benchmarks.
Search-provider response comparison
Compares supplied, previously saved JSON responses from search providers; makes no API calls.
Found an outdated API, incorrect assumption, or broken tool? Report it here. For testing methodology and AI-assisted editorial review, see our standards.