Status: exported, not yet verified on a GPU. This checkpoint is in the AutoAWQ GEMM layout (4 bits, group size 64, asymmetric with integer zero points) so that vLLM's awq / awqmarlin kernels can load it. The weights come from the recipe in github.com/dfed25/mlx-gptq run with --zero-point int: error-feedback rounding (GPTQ), an alternating grid fit, coordinate-descent refinement and a weighted refit, with every group's offset constrained to a whole number of steps from the start, so that conversion to this format changes the weights by 0.05% (mean relative), against about 10% when a free-offset model is converted afterwards. Measured on the MLX version of the same weights (MacBook Pro M4…
Independent publisher
Domenic Federico
dfed24
Models in Library1
Datasets in Library0
Models on Hugging Face7
Followers—
Compare the published evidence
This profile connects the 1 model and dataset record shown below to their upstream cards and sources. The library counts describe SAVRN's coverage, rather than this publisher's entire output.
Published tasks: Text generation.
Reported licenses: apache-2.0. Open a record to review its specific license and conditions.
Compare model specifications, source dates, and hardware estimates on the individual records. Publisher identity verification is separate from a model's quality, deployment readiness, or suitability for your work.