MrSphay/odysseus
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

Gate Cookbook quick run on downloaded models

Browse Source 
Gate Cookbook "Run" on the model being downloaded
The What-Fits tab's quick "Run" button launched a serve task even when
the model was not downloaded. It POSTed directly to /api/model/serve and switched to the Running tab, so vLLM/SGLang would background-pull at launch (and llama.cpp just errors "No GGUF found") while the task showed as "running" without actually serving anything.
The Configure button and the Serve tab already gate on the cached-model
list; quick-Run did not. Mirror that gate: when the model isn't cached,
honor the button's "Download" half by kicking off the download instead of spawning a phantom serve task, and toast the user to Run again once it finishes.
This commit is contained in:
Nico Panu
2026-06-01 09:46:24 +02:00
committed by GitHub
parent b175acd827
commit 8874a11baf
1 changed files with 24 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

25
static/js/cookbook-hwfit.js
View File

@@ -887,7 +887,30 @@ export function _expandModelRow(row, modelData) {
const quickRunBtn = panel.querySelector('.hwfit-quickrun-btn');
if (quickRunBtn) {
quickRunBtn.addEventListener('click', async () => {
_syncHostFromScanDropdown();
const _qrHost = _syncHostFromScanDropdown();
// Don't serve a model that isn't downloaded yet. vLLM/SGLang would
// background-pull at launch, so the serve task shows up as "running" in
// the Running tab while nothing is actually served (and llama.cpp just
// errors "No GGUF found"). The Configure button and the Serve tab already
// gate on the cached-model list — mirror that here. When the model isn't
// present, honor the button's "Download" half by kicking off the download
// instead, then the user can Run again to serve once it finishes.
const _short = modelData.name.split('/').pop();
const _downloaded = _cachedModelIds && (
_cachedModelIds.has(modelData.name)
|| [..._cachedModelIds].some(id => id === modelData.name || id.endsWith('/' + _short))
);
if (_cachedModelIds && !_downloaded) {
uiModule.showToast('Model not downloaded yet — starting download. Run again to serve once it finishes.');
if (backend === 'ollama') {
_runPanelCmd(panel, _buildDownloadCmd(modelData, backend), { timeout: 0 });
} else {
_runModelDownload(panel, modelData, backend, _qrHost);
}
return;
}
quickRunBtn.disabled = true;
quickRunBtn.textContent = 'Starting...';