Decision models need their own inference engine.So we developed Flide, a high-performance and exact inference engine for Jev-like decision models.Flide achieves up to a 9.5x speedup over vLLM and SGLang.It now supports 30+ popular local Jev-like decision models.Start to make your decision immediately:pip install flide
Comments URL: https://news.ycombinator.com/item?id=50421155
Points: 2
# Comments: 0
tsv is a set of performance-focused language tools for the Web. Today it ships formatters and parsers for TypeScript/JS, CSS, and Svelte, including a vscode/openvsx…
Where Jev and other Jev-style models like OpenAI's Decisions and Cloudflare's Clef are multimodal, supporting text or images in, decision out, SPEV natively supports…
Hi HN, I'm Juho from Upright. I think we may have stumbled upon an interesting approach to AI alignment.The idea is as follows: 1. train a decision model to be really…
Discussion (0)
No comments yet. Start the conversation!