SAVRN
Search Contact SAVRN

Open-weight model · Question answering

LlamaForecaster-8B-i1-GGUF

by Team Mradermacher mradermacher/LlamaForecaster-8B-i1-GGUF

weighted/imatrix quants of https://huggingface.co/nikhilchandak/LlamaForecaster-8B For a convenient overview and download list, visit our model page for this model.

Parameters
Context
Weights93.8 GB
Licensemit
AccessOpen weights
Monthly Downloads2.3k

Model Card

By Team Mradermacher, published under mit, revision 781c6cd51069.

weighted/imatrix quants of https://huggingface.co/nikhilchandak/LlamaForecaster-8B For a convenient overview and download list, visit our model page for this model. static quants are available at https://huggingface.co/mradermacher/LlamaForecaster-8B-GGUF If you are unsure how to use GGUF files, refer to one of TheBloke's READMEs for more details, including on how to concatenate multi-part files. (sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants) Here is a handy graph by ikawrakow comparing some lower-quality quant And here are Artefact2's thoughts on the matter: https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9 See…

Read Team Mradermacher's full model card

About

weighted/imatrix quants of https://huggingface.co/nikhilchandak/LlamaForecaster-8B

For a convenient overview and download list, visit our model page for this model.

static quants are available at https://huggingface.co/mradermacher/LlamaForecaster-8B-GGUF

Usage

If you are unsure how to use GGUF files, refer to one of TheBloke's READMEs for more details, including on how to concatenate multi-part files.

Provided Quants

(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)

Link Type Size/GB Notes
GGUF imatrix 0.1 imatrix file (for creating your own quants)
GGUF i1-IQ1_S 2.1 for the desperate
GGUF i1-IQ1_M 2.3 mostly desperate
GGUF i1-IQ2_XXS 2.5
GGUF i1-IQ2_XS 2.7
GGUF i1-IQ2_S 2.9
GGUF i1-IQ2_M 3.0
GGUF i1-Q2_K_S 3.1 very low quality
GGUF i1-Q2_K 3.3 IQ3_XXS probably better
GGUF i1-IQ3_XXS 3.4 lower quality
GGUF i1-IQ3_XS 3.6
GGUF i1-Q3_K_S 3.8 IQ3_XS probably better
GGUF i1-IQ3_S 3.8 beats Q3_K*
GGUF i1-IQ3_M 3.9
GGUF i1-Q3_K_M 4.1 IQ3_S probably better
GGUF i1-Q3_K_L 4.4 IQ3_M probably better
GGUF i1-IQ4_XS 4.5
GGUF i1-Q4_0 4.8 fast, low quality
GGUF i1-IQ4_NL 4.8 prefer IQ4_XS
GGUF i1-Q4_K_S 4.8 optimal size/speed/quality
GGUF i1-Q4_K_M 5.0 fast, recommended
GGUF i1-Q4_1 5.2
GGUF i1-Q5_K_S 5.7
GGUF i1-Q5_K_M 5.8
GGUF i1-Q6_K 6.7 practically like static Q6_K

Here is a handy graph by ikawrakow comparing some lower-quality quant types (lower is better):

And here are Artefact2's thoughts on the matter: https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9

FAQ / Model Request

See https://huggingface.co/mradermacher/model_requests for some answers to questions you might have and/or if you want some other model quantized.

Thanks

I thank my company, nethype GmbH, for letting me use its servers and providing upgrades to my workstation to enable this work in my free time. Additional thanks to @nicoboss for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.

Identity and Version

Repository
mradermacher/LlamaForecaster-8B-i1-GGUF
Publisher
Team Mradermacher
Task
Question answering
Modality
Text
Library
transformers
Parameters
Not stated by the source
Languages
en
Revision
781c6cd51069ed9b864989f8facca8b85b6a6cd1
First published
2026-01-10
Last updated
2026-01-10

Files and Weights

27 files, 93.8 GB in total. The weights are 25 files totalling 93.8 GB in gguf.

Weights25 files · 93.8 GB
Documentation1 file · 6.2 KB
Repository1 file · 3.3 KB
Every file
FileTypeSizeSHA-256
LlamaForecaster-8B.i1-IQ1_M.ggufWeights2.2 GB 807d4b437811
LlamaForecaster-8B.i1-IQ1_S.ggufWeights2.0 GB 567b89a30dd0
LlamaForecaster-8B.i1-IQ2_M.ggufWeights2.9 GB 8838c32632fc
LlamaForecaster-8B.i1-IQ2_S.ggufWeights2.8 GB 29bc6d830d55
LlamaForecaster-8B.i1-IQ2_XS.ggufWeights2.6 GB 2f69f52202db
LlamaForecaster-8B.i1-IQ2_XXS.ggufWeights2.4 GB 75996e68a9a6
LlamaForecaster-8B.i1-IQ3_M.ggufWeights3.8 GB b7541ba87753
LlamaForecaster-8B.i1-IQ3_S.ggufWeights3.7 GB bb7e505b06e9
LlamaForecaster-8B.i1-IQ3_XS.ggufWeights3.5 GB d47af605fb7a
LlamaForecaster-8B.i1-IQ3_XXS.ggufWeights3.3 GB a30e27c754ff
LlamaForecaster-8B.i1-IQ4_NL.ggufWeights4.7 GB bf49e96e8ee4
LlamaForecaster-8B.i1-IQ4_XS.ggufWeights4.4 GB 7a8efbfb3325
LlamaForecaster-8B.i1-Q2_K.ggufWeights3.2 GB dc32634f511e
LlamaForecaster-8B.i1-Q2_K_S.ggufWeights3.0 GB ec9ed46f9056
LlamaForecaster-8B.i1-Q3_K_L.ggufWeights4.3 GB 9d71c6602d1d
LlamaForecaster-8B.i1-Q3_K_M.ggufWeights4.0 GB 4facb2d4d653
LlamaForecaster-8B.i1-Q3_K_S.ggufWeights3.7 GB 24308dac83d9
LlamaForecaster-8B.i1-Q4_0.ggufWeights4.7 GB f233f9b4ac52
LlamaForecaster-8B.i1-Q4_1.ggufWeights5.1 GB 1d38c0acf8f3
LlamaForecaster-8B.i1-Q4_K_M.ggufWeights4.9 GB 21bebc02d77c
LlamaForecaster-8B.i1-Q4_K_S.ggufWeights4.7 GB cce78224b7fd
LlamaForecaster-8B.i1-Q5_K_M.ggufWeights5.7 GB c87b57d85aa5
LlamaForecaster-8B.i1-Q5_K_S.ggufWeights5.6 GB 444f149bd920
LlamaForecaster-8B.i1-Q6_K.ggufWeights6.6 GB e7f61b57d9c5
LlamaForecaster-8B.imatrix.ggufWeights5.0 MB 32163121185e
README.mdDocumentation6.2 KB
.gitattributesRepository3.3 KB

License and Download

License
mit
Access
Open weights, no gate
Download size
93.8 GB
Download from Team Mradermacher

Released by Team Mradermacher through its official repository on Hugging Face. Read the license.

Built From

  • Derived from nikhilchandak/LlamaForecaster-8B
  • Quantized from nikhilchandak/LlamaForecaster-8B
  • Trained on (disclosed) nikhilchandak/OpenForesight

Memory Requirements

PrecisionWeights in memory
As published93.8 GB

Weights only, from the published parameter count; the key-value cache and runtime add to this.

Questions About LlamaForecaster-8B-i1-GGUF

Can I use LlamaForecaster-8B-i1-GGUF commercially?

Yes. LlamaForecaster-8B-i1-GGUF is released under MIT License. The MIT License is a short permissive license. It permits commercial use, modification and redistribution, provided the copyright notice and permission notice are included.

Similar Models

Model · Question answering

splinter-base

Tel Aviv University

Splinter-base is the pretrained model discussed in the paper Few-Shot Question Answering by Pretraining Span Selection (at ACL 2021). Its original repository can be found here. The model is case-sensitive. Note: This model doesn't contain the pretrained weights for the QASS layer (see paper for details), and therefore the QASS layer is randomly initialized upon loading it. For the model with those weights, see tau/splinter-base-qass. Splinter is a model that is pretrained in a self-supervised fashion for few-shot question answering. This means it was pretrained on the raw texts only, with no humans labelling them in any way (which is why it can use lots of publicly available data) with an…

Open weights apache-2.0 512 tokens transformers

This model can be used for the task of question answering. The model should not be used to intentionally create hostile or alienating environments for people. Significant research has explored bias and fairness issues with language models (see, e.g., Sheng et al. (2021) and Bender et al. (2021)). Predictions generated by the model may include disturbing and harmful stereotypes across protected classes; identity characteristics; and sensitive, social, and occupational groups. Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. The model creators note in the associated paper: The model creators note in the associated paper: The model…

Open weights 512 tokens transformers

Model · Question answering

distilbert-onnx

Philipp Schmid

This model is a fine-tune checkpoint of DistilBERT-base-cased, fine-tuned using (a second step of) knowledge distillation on SQuAD v1.1. This model reaches a F1 score of 87.1 on the dev set (for comparison, BERT bert-base-cased version reaches a F1 score of 88.7).

Open weights apache-2.0 512 tokens transformers

Model · Question answering

roberta-base-on-cuad

Mohammed Rakib

This model can be used for the task of Question Answering on Legal Documents. Read: An Open Source Contractual Language Understanding Application Using Machine Learning for detailed information on training procedure, dataset preprocessing and evaluation. See CUAD dataset card for more information. See CUAD dataset card for more information. Used V100/P100 from Google Colab Pro Python, Transformers Mohammed Rakib in collaboration with Ezi Ozoani and the Hugging Face team Use the code below to get started with the model.

Open weights mit 514 tokens transformers