Skip to page content
SAVRN
Search Plan a project

Independent publisher

Hallford

Ehraim

Machine Learning, LLMs

Models in Library1
Datasets in Library0
Models on Hugging Face17
Followers—

Compare the published evidence

This profile connects the 1 model and dataset record shown below to their upstream cards and sources. The library counts describe SAVRN's coverage, rather than this publisher's entire output.

Published tasks: Text generation.

Reported licenses: other. Open a record to review its specific license and conditions.

Compare model specifications, source dates, and hardware estimates on the individual records. Publisher identity verification is separate from a model's quality, deployment readiness, or suitability for your work.

Models

Model · Text generation

mixture-of-tiny-sliding-experts

Hallford

One frozen public checkpoint is loaded at a time on a 24 GB GPU. A hash router picks it. Optional chains pass text from one expert to the next. A bag of those chains votes on the final string. A separate 128-dimensional cache, shared only by the routers, can slide along the chain. This repository is an assembly of published methods. It does not introduce a new routing, memory, or decoding algorithm. The bibliography at the bottom is the full set of ideas used in the code. Upstream weight files keep their own licenses and are not redistributed here. A request is hashed into a bag of word ids. A small classifier scores 138 expert ids. Confidence under 0.45 selects the int4 14B coder. An image…

Open weights other mote