Skip to page content
SAVRN
Search Plan a project

Open-weight model · Text generation

arabic-gpt-small

by Tarig fdl Tegnh/arabic-gpt-small

arabic-gpt-small is an open-weight model for text generation from Tarig fdl, released under Apache License 2.0. Its published files total 86.0 GB.

wikimedia/wikipedia - epfml/FineWeb2-HQ pipelinetag: text-generation - arabic - gpt2 - pretraining

Parameters—
Context—
Weights82.1 GB
Licenseapache-2.0
AccessOpen weights
Monthly Downloads—

Model Card

By Tarig fdl, published under apache-2.0, revision 73cd43cb61bb.

wikimedia/wikipedia - epfml/FineWeb2-HQ pipelinetag: text-generation - arabic - gpt2 - pretraining

Read Tarig fdl's full model card

license: apache-2.0 datasets: - wikimedia/wikipedia - epfml/FineWeb2-HQ language: - ar pipeline_tag: text-generation tags: - arabic - gpt2 - pretraining


Identity and Version

Repository
Tegnh/arabic-gpt-small
Publisher
Tarig fdl
Task
Text generation
Modality
Text
Library
Not stated by the source
Parameters
Not stated by the source
Languages
ar
Revision
73cd43cb61bbad0c12c36105ec6c0b52e5bcf88b
First published
2026-08-23
Last updated
2026-09-21

Files and Weights

161 files, 86.0 GB in total. The weights are 92 files totalling 82.1 GB in bin, pt.

Weights92 files · 82.1 GB
Configuration16 files · 1.8 MB
Tokenizer8 files · 15.5 MB
Documentation8 files · 14.6 KB
Other36 files · 3.9 GB
Repository1 file · 1.8 KB
Every file
FileTypeSizeSHA-256
ar_gpt_corpus2_best.ptWeights1.3 GB beb79b0951ed
ar_gpt_corpus2_step0001000.ptWeights1.3 GB 1569c827c76e
ar_gpt_corpus2_step0002000.ptWeights1.3 GB 078d66ce20a7
ar_gpt_corpus2_step0003000.ptWeights1.3 GB 96faf340ad99
ar_gpt_corpus2_step0004000.ptWeights1.3 GB 476d83fcd85f
ar_gpt_corpus2_step0005000.ptWeights1.3 GB 1a6aaf190ebf
ar_gpt_corpus2_step0006000.ptWeights1.3 GB aae690300b61
ar_gpt_corpus2_step0007000.ptWeights1.3 GB 435de425158a
ar_gpt_corpus2_step0008000.ptWeights1.3 GB 6b8c9e7874bf
ar_gpt_corpus2_step0009000.ptWeights1.3 GB beb79b0951ed
ar_gpt_corpus2_step0010000.ptWeights1.3 GB c69ae58824d7
ar_gpt_corpus2_step0011000.ptWeights1.3 GB 39b3093e0ea2
ar_gpt_corpus2_step0011999.ptWeights1.3 GB 8425fd9e2559
ar_gpt_corpus3_best.ptWeights1.3 GB d8648a40dcc1
ar_gpt_corpus3_step0000500.ptWeights1.3 GB e2ea60944d52
ar_gpt_corpus3_step0001000.ptWeights1.3 GB 9de44fb72a5d
ar_gpt_corpus3_step0001500.ptWeights1.3 GB b238156ed4f5
ar_gpt_corpus3_step0002000.ptWeights1.3 GB f01d4ed523fd
ar_gpt_corpus3_step0002500.ptWeights1.3 GB d2cf0735b82b
ar_gpt_corpus3_step0003000.ptWeights1.3 GB cdfa29dc0615
ar_gpt_corpus3_step0003500.ptWeights1.3 GB 3a967876a3f5
ar_gpt_corpus3_step0004000.ptWeights1.3 GB fd484396f7a3
ar_gpt_corpus3_step0004500.ptWeights1.3 GB 07408a449187
ar_gpt_corpus3_step0005000.ptWeights1.3 GB 0cc6d4b16157
ar_gpt_corpus3_step0005500.ptWeights1.3 GB 8338f04c56e7
ar_gpt_corpus3_step0006000.ptWeights1.3 GB f2953c4a5dae
ar_gpt_corpus3_step0006500.ptWeights1.3 GB bee5eb29ec70
ar_gpt_corpus3_step0007000.ptWeights1.3 GB 39c58d841bc3
ar_gpt_corpus3_step0007500.ptWeights1.3 GB c3d0802216e3
ar_gpt_corpus3_step0008000.ptWeights1.3 GB d8648a40dcc1
ar_gpt_corpus3_step0008500.ptWeights1.3 GB a5fa6e7d17f2
ar_gpt_corpus3_step0008999.ptWeights1.3 GB 897e29e73944
ar_gpt_corpus4_best.ptWeights1.3 GB 4353ad401623
ar_gpt_corpus4_step0000500.ptWeights1.3 GB ba0196e81493
ar_gpt_corpus4_step0001000.ptWeights1.3 GB 5f8c8c9f4311
ar_gpt_corpus4_step0001500.ptWeights1.3 GB d6a085e9fc32
ar_gpt_corpus4_step0002000.ptWeights1.3 GB 950bcd727ac1
ar_gpt_corpus4_step0002500.ptWeights1.3 GB e1d652746aa1
ar_gpt_corpus4_step0003000.ptWeights1.3 GB 47910b325830
ar_gpt_corpus4_step0003500.ptWeights1.3 GB 4353ad401623
ar_gpt_corpus4_step0004000.ptWeights1.3 GB a3cbd59acc35
ar_gpt_corpus4_step0004500.ptWeights1.3 GB 6b0ccc765e9c
ar_gpt_corpus4_step0005000.ptWeights1.3 GB 612994a1be0a
ar_gpt_corpus4_step0005500.ptWeights1.3 GB 6b55abeb7bc2
data/c4_parts/101b_data_train-00468-of-00470.parquet_0-49.train.binWeights58.2 MB f28fbea1a5ea
data/c4_parts/101b_data_train-00468-of-00470.parquet_0-49.val.binWeights304.6 KB d35dc0220106
data/c4_parts/101b_data_train-00469-of-00470.parquet_0-49.train.binWeights93.0 MB 97b2851cc438
data/c4_parts/101b_data_train-00469-of-00470.parquet_0-49.val.binWeights454.3 KB 3ed965503334
data/c4_parts/101b_data_train-00469-of-00470.parquet_50-70.train.binWeights36.2 MB 9ad5a2a630e3
data/c4_parts/101b_data_train-00469-of-00470.parquet_50-70.val.binWeights164.7 KB 5b3fb3275f16
data/c4_parts/fineweb2_data_arb_Arab_train_000_00001.parquet_0-49.train.binWeights101.1 MB 3cc96e53ece4
data/c4_parts/fineweb2_data_arb_Arab_train_000_00001.parquet_0-49.val.binWeights429.0 KB e1258b7efd3d
data/c4_parts/fineweb2_data_arb_Arab_train_000_00001.parquet_100-149.train.binWeights80.4 MB 7eb0fb95f7cf
data/c4_parts/fineweb2_data_arb_Arab_train_000_00001.parquet_100-149.val.binWeights488.6 KB 747eaffaba1d
data/c4_parts/fineweb2_data_arb_Arab_train_000_00001.parquet_150-199.train.binWeights85.1 MB 9805ac62c776
data/c4_parts/fineweb2_data_arb_Arab_train_000_00001.parquet_150-199.val.binWeights399.0 KB 9978c5e33d7d
data/c4_parts/fineweb2_data_arb_Arab_train_000_00001.parquet_200-249.train.binWeights106.5 MB b08cf61d38c4
data/c4_parts/fineweb2_data_arb_Arab_train_000_00001.parquet_200-249.val.binWeights462.3 KB 71ebae17e49e
data/c4_parts/fineweb2_data_arb_Arab_train_000_00001.parquet_250-299.train.binWeights66.1 MB 85e82595b71e
data/c4_parts/fineweb2_data_arb_Arab_train_000_00001.parquet_250-299.val.binWeights343.1 KB f8831221f916
data/c4_parts/fineweb2_data_arb_Arab_train_000_00001.parquet_300-349.train.binWeights77.5 MB 27b487a8eeeb
data/c4_parts/fineweb2_data_arb_Arab_train_000_00001.parquet_300-349.val.binWeights453.8 KB 5045d067de2c
data/c4_parts/fineweb2_data_arb_Arab_train_000_00001.parquet_350-399.train.binWeights82.5 MB 43a8cc9408e6
data/c4_parts/fineweb2_data_arb_Arab_train_000_00001.parquet_350-399.val.binWeights430.2 KB 34a63ac76389
data/c4_parts/fineweb2_data_arb_Arab_train_000_00001.parquet_400-449.train.binWeights79.5 MB b426b0110845
data/c4_parts/fineweb2_data_arb_Arab_train_000_00001.parquet_400-449.val.binWeights369.7 KB 092d001a7228
data/c4_parts/fineweb2_data_arb_Arab_train_000_00001.parquet_50-99.train.binWeights71.0 MB d82b3ddd3798
data/c4_parts/fineweb2_data_arb_Arab_train_000_00001.parquet_50-99.val.binWeights463.9 KB 0fae8e4fea70
data/train.binWeights659.8 MB a08d1dcc117c
data/train2.binWeights903.1 MB a6dbfed653f6
data/train3.binWeights840.7 MB 6cb4e0e10e6b
data/train4.binWeights937.1 MB b6404f6bbdec
data/val.binWeights3.3 MB 5a37d20b0226
data/val2.binWeights4.5 MB e3189fc04908
data/val3.binWeights4.2 MB 1db2f4850329
data/val4.binWeights4.8 MB aa1a361b91c8
gpt_small_best.ptWeights1.3 GB 18328c81c4a0
gpt_small_step0001500.ptWeights1.3 GB 4c095e849f80
gpt_small_step0003000.ptWeights1.3 GB 34959021cf80
gpt_small_step0005000.ptWeights1.3 GB f2a13829e670
gpt_small_step0007000.ptWeights1.3 GB ae097b11570f
gpt_small_step0009000.ptWeights1.3 GB 29c8945df4fd
gpt_small_step0011000.ptWeights1.3 GB a32faee9a13c
gpt_small_step0013000.ptWeights1.3 GB c3a43babfb5a
gpt_small_step0015000.ptWeights1.3 GB 8f18dc81d2bc
gpt_small_step0017000.ptWeights1.3 GB 3b8ed16c45cf
gpt_small_step0019999.ptWeights1.3 GB 93eaaaf84cd0
sft/ar_gpt_corpus3_sft1/ar_gpt_corpus3_sft1_step000200.ptWeights1.3 GB 4c7afc035140
sft/ar_gpt_corpus3_sft1/pytorch_model_sft.ptWeights1.3 GB 84df6ea11ebe
sft/ar_gpt_corpus3_sft2/pytorch_model_sft.ptWeights1.3 GB 1b68d3174e14
sft/ar_gpt_corpus3_sft3/pytorch_model_sft.ptWeights539.6 MB 3f613b56ef65
sft/sft-v1-mine/pytorch_model_sft.ptWeights441.3 MB aea5e0573cb5
.config/.last_opt_in_prompt.yamlConfiguration3 B —
.config/.last_survey_prompt.yamlConfiguration37 B —
.config/.last_update_check.jsonConfiguration135 B —
data/c3_cross_round_progress.jsonConfiguration113 B —
data/c4_build_state.jsonConfiguration1.7 KB —
data/c4_cross_round_progress.jsonConfiguration125 B —
eval/stat_tests.jsonConfiguration431 B —
sample_data/anscombe.jsonConfiguration1.7 KB —
sft/ar_gpt_corpus3_sft1/results.jsonConfiguration323 B —
sft/ar_gpt_corpus3_sft2/results.jsonConfiguration12.9 KB —
sft/ar_gpt_corpus3_sft3/results.jsonConfiguration6.7 KB —
sft/sft-v1-mine/compare_before_after.jsonConfiguration21.0 KB —
sft/sft-v1-mine/diagnostic.jsonConfiguration406 B —
sft/sft-v1-mine/eval_shared.jsonConfiguration448.2 KB —
sft/sft-v1-mine/results.jsonConfiguration10.7 KB —
sft/sft-v1-mine/train_data.jsonConfiguration1.3 MB —
README.mdDocumentation160 B —
eval/MASTER_REPORT.mdDocumentation4.4 KB —
eval/eval_report_2000_4000.mdDocumentation1.2 KB —
sample_data/README.mdDocumentation962 B —
sft/ar_gpt_corpus3_sft1/README.mdDocumentation550 B —
sft/ar_gpt_corpus3_sft2/README.mdDocumentation2.3 KB —
sft/ar_gpt_corpus3_sft3/README.mdDocumentation2.5 KB —
sft/sft-v1-mine/README.mdDocumentation2.5 KB —
.config/active_configOther7 B —
.config/config_sentinelOther —
.config/configurations/config_defaultOther94 B —
.config/default_configs.dbOther12.3 KB —
.config/gceOther5 B —
.config/hidden_gcloud_config_universe_descriptor_data_cache_configs.dbOther12.3 KB —
.config/logs/2026.08.20/13.28.54.805602.logOther53.2 KB —
.config/logs/2026.08.20/13.29.20.653977.logOther465 B —
.config/logs/2026.08.20/13.29.32.576803.logOther12.7 KB —
.config/logs/2026.08.20/13.29.34.381367.logOther465 B —
.config/logs/2026.08.20/13.29.45.182906.logOther704 B —
.config/logs/2026.08.20/13.29.46.035673.logOther699 B —
ar_gpt_corpus2_log.jsonlOther61.9 KB —
ar_gpt_corpus3_log.jsonlOther46.0 KB —
ar_gpt_corpus4_log.jsonlOther28.2 KB —
data/c3_cross_round_lsh_checkpoint.pklOther900.0 MB a11d134a32d4
data/c4_build_lsh.pklOther1.6 GB fa14d36b95ad
data/c4_cross_round_lsh_checkpoint.pklOther1.3 GB 687f785d52b6
eval/eval_report_2000_4000.jsonlOther723 B —
eval/figs/training_curves.pngOther203.8 KB c51773054b8a
eval/master_eval.jsonlOther54.9 KB —
eval/model_specs.csvOther583 B —
eval/summary_by_step.csvOther783 B —
gpt_small_log.jsonlOther97.7 KB —
sample_data/california_housing_test.csvOther301.1 KB —
sample_data/california_housing_train.csvOther1.7 MB —
sample_data/mnist_test.csvOther18.3 MB 51c292478d94
sample_data/mnist_train_small.csvOther36.5 MB 1ef64781aa03
sft/ar_gpt_corpus3_sft1/ar_gpt_corpus3_sft1_log.jsonlOther3.1 KB —
sft/ar_gpt_corpus3_sft2/ar_gpt_corpus3_sft2_log.jsonlOther3.0 KB —
sft/ar_gpt_corpus3_sft2/loss_curve.pngOther89.7 KB —
sft/ar_gpt_corpus3_sft3/ar_gpt_corpus3_sft3_log.jsonlOther3.2 KB —
sft/ar_gpt_corpus3_sft3/loss_curve.pngOther115.0 KB 5c9bed93e52a
sft/sft-v1-mine/compare_before_after.pngOther62.8 KB —
sft/sft_train.jsonlOther1.5 MB —
sft/sft_val.jsonlOther248.2 KB —
.gitattributesRepository1.8 KB —
eval/figs/tokenizer_faceoff.pngTokenizer71.1 KB —
eval/tokenizer_compression.csvTokenizer1.0 KB —
eval/tokenizer_fertility.csvTokenizer1.1 KB —
sft/ar_gpt_corpus3_sft1/tokenizer.jsonTokenizer3.1 MB —
sft/ar_gpt_corpus3_sft2/tokenizer.jsonTokenizer3.1 MB —
sft/ar_gpt_corpus3_sft3/tokenizer.jsonTokenizer3.1 MB —
sft/sft-v1-mine/tokenizer.jsonTokenizer3.1 MB —
tokenizer.jsonTokenizer3.1 MB —

License and Download

License
apache-2.0
Access
Open weights, no gate
Download size
82.1 GB
Download from Tarig fdl

Released by Tarig fdl through its official repository on Hugging Face. Read the license.

Built From

Memory Requirements

PrecisionWeights in memory
As published82.1 GB

Weights only, from the published parameter count; the key-value cache and runtime add to this.

Questions About arabic-gpt-small

Can I use arabic-gpt-small commercially?

Yes. arabic-gpt-small is released under Apache License 2.0. The Apache License 2.0 is a permissive open-source license. It permits commercial use, modification and redistribution. It requires keeping the license and copyright notices and any NOTICE file, stating significant changes, and it includes an express patent grant from contributors.

Similar Models

Model · Text generation

opt-125m

AI at Meta

OPT was first introduced in Open Pre-trained Transformer Language Models and first released in metaseq's repository on May 3rd 2022 by Meta AI. Disclaimer: The team releasing OPT wrote an official model card, which is available in Appendix D of the paper. Content from this model card has been written by the Hugging Face team. To quote the first two paragraphs of the official paper OPT was predominantly pretrained with English text, but a small amount of non-English data is still present within the training corpus via CommonCrawl. The model was pretrained using a causal language modeling (CLM) objective. OPT belongs to the same family of decoder-only models like GPT-3. As such, it was…

Open weights other 2,048 tokens transformers

Model · Text generation

Ornith-1.5-9B-GGUF

Ornith

Chirp Chirp! We are introducing Ornith-1.5, a major step toward building foundation models through end-to-end self-improvement. Ornith-1.5 extends Ornith-1.0 (which was developed on top of Qwen3.5 and Gemma4 with additional continued pretraining, mid-training, and post-training) by expanding the self-improvement loop from scaffold and rollout optimization to jointly optimizing task generation, scaffold construction, and solution rollouts. Rather than relying on a fixed set of human-curated tasks and manually designed harnesses, Ornith-1.5 continuously generates new training tasks, discovers effective strategies for solving them, and improves the policy through reinforcement learning. For…

Open weights mit transformers

Model · Text generation

Ternary-Bonsai-2-27B-gguf

Prism ML

Full 27B-class reasoning in ternary transformer weights, for llama.cpp (CUDA, Metal, CPU) - \~5.9 GB language model (down from \~54 GB FP16) — full 27B-class reasoning on a standard laptop or a single GPU - 98.2% of FP16 intelligence retained: 84.78 average across 14 thinking-mode benchmarks — far above the conventional IQ2XXS build (72.59) at about 82% of its footprint, and within 0.4 points of UD-Q4KXL at three times the footprint - Retains thinking, reasoning, and agentic behavior deep in the sub-4-bit regime, where conventional low-bit representations collapse: math within half a point of full precision (96.57), coding level with the baseline (89.42), agentic tool calling at 74.92…

Open weights apache-2.0 llama.cpp

Model · Text generation

Ornith-1.5-35B-A3B-GGUF

Ornith

Chirp Chirp! We are introducing Ornith-1.5, a major step toward building foundation models through end-to-end self-improvement. Ornith-1.5 extends Ornith-1.0 (which was developed on top of Qwen3.5 and Gemma4 with additional continued pretraining, mid-training, and post-training) by expanding the self-improvement loop from scaffold and rollout optimization to jointly optimizing task generation, scaffold construction, and solution rollouts. Rather than relying on a fixed set of human-curated tasks and manually designed harnesses, Ornith-1.5 continuously generates new training tasks, discovers effective strategies for solving them, and improves the policy through reinforcement learning. For…

Open weights mit transformers

Uncensored Qwen3.8-27B, published as GGUF quantizations with the multi token prediction (MTP) head retained and verified. Refusal behaviour has been substantially reduced, not eliminated. See Measured behaviour for the numbers. Capabilities, training data, and architecture are otherwise unchanged. - Refusal directions removed with Heretic, which co minimizes refusal count against KL divergence from the base model. No handwritten refusal removal code, no finetuning, no additional training data. - Abliteration runs at bf16 (no 4 bit quantization). the resulting LoRA is merged into the bf16 base, so the published weights are not a quantized round trip. - mtp. tensors are copied verbatim from…

Open weights apache-2.0 llama.cpp

Model · Text generation

Ornith-1.0-9B-GGUF

Ornith

Aloha! Today, we are releasing Ornith-1.0, a self-improving family of open-source models for agentic coding. This model card documents Ornith-1.0-9B, the most lightweight member of the Ornith family, designed for efficient single-GPU deployment. Ornith-1.0-9B is a dense ~9B model (≈19 GB in bf16), so it serves comfortably on a single 80GB GPU. The recipes below stand up an OpenAI-compatible server; add --tensor-parallel-size / --tp if you want to shard across more GPUs. For a quick local test (or to script offline generation), load the model directly with Transformers. Make sure you have a recent release installed — see the Transformers installation guide; Ornith-1.0-9B requires…

Open weights mit transformers