Independent publisher
Adrian Ciprian Iancu
adriandj3
dLLM's and Optimizers
Models
A one-token decision model you can switch on per request, on the MiniCPM5-2B server you already run. Kailune-AI/pjev-2b is a strong typed-decision model: give it a state, a question and lettered options, and it returns a calibrated probability for every option in a single forward pass. It ships as a full merged model (about 2.7 GB in Q80). If your agent already serves openbmb/MiniCPM5-2B for chat, a second full model costs VRAM you probably do not have. This repository re-expresses pjev-2b as a rank-64 LoRA over the stock MiniCPM5-2B weights. Load it once next to the chat model, turn it on only for decision requests, and pay about 200 MB of VRAM instead of 2.7 GB. Measured on a private…