From 6bfe824eb453b9f25b447d9335e9dd51e94e45ed Mon Sep 17 00:00:00 2001 From: red person Date: Tue, 2 Jun 2026 16:37:10 +0300 Subject: [PATCH] Document self-host system requirements (#945) --- README.md | 6 ++++-- 1 file changed, 4 insertions(+), 2 deletions(-) diff --git a/README.md b/README.md index 1eea7da..e02e26b 100644 --- a/README.md +++ b/README.md @@ -77,8 +77,10 @@ python setup.py python -m uvicorn app:app --host 127.0.0.1 --port 7000 ``` Requirements: Python 3.11+. Cookbook also needs `tmux` for background model -downloads and serves. Use `--host 0.0.0.0` only when you intentionally want -LAN/reverse-proxy access. +downloads and serves. The app itself is lightweight; local model serving is the +heavy part and depends on the model, runtime, GPU, and VRAM, so small hosts can +connect to API or remote model servers instead. Use `--host 0.0.0.0` only when +you intentionally want LAN/reverse-proxy access. ### Apple Silicon Docker on macOS cannot use the Metal GPU. For GPU-accelerated Cookbook on an