Show HN: Deepswapp Browser: browser the browser with another browser
A "deepswapp" of a website has data from one website in a layout of another website. Deepswapp Browser allows users to seamlessly browse this alternative version of the…
I run local models on two mismatched GPUs and got tired of hand-editing llama.cpp's models.ini and re-reading --help after every release. LlamaForge is a browser panel over llama.cpp's own llama-server router. It runs no inference itself.A few choices people here may care about:- The backend is pure Python stdlib (ThreadingHTTPServer, no pip install). The frontend is vanilla JS with no build step.- The settings UI is generated from llama-server --help at runtime, so a flag added upstream shows up without a LlamaForge release (200+ on current builds).- Auto-Forge measures instead of guessing: it tries layer placements, KV cache types and speculative drafters in a sandboxed router, checks that a drafter gives the same answers, and writes the winner to models.ini with an undo. On my 5080 + 5060 Ti it took Qwen3.8-27B from 26.8 tok/s on code to 126. (The old setup sat mostly on the slower card; the 5080 alone without a drafter does 52.)- It can't track usage per client, because clients talk to llama.cpp directly. That's on purpose.Early preview. Windows + NVIDIA is the well-trodden path. Linux and macOS pass CI but have had little real-hardware use. It's heavily AI-assisted, and…
Discussion (0)
No comments yet. Start the conversation!