Open-weight model
llama-3.1-8b-instruct-lora-clinical_iter2_epoch2
by Vaibhav Raj vab46/llama-3.1-8b-instruct-lora-clinical_iter2_epoch2
llama-3.1-8b-instruct-lora-clinical_iter2_epoch2 is an open-weight model from Vaibhav Raj. Its published files total 270.8 MB.
This model is a PEFT/LoRA adapter single epoch fine-tuned on top of Fine tuning has been done on related to clinical trials.
Model Card
This model is a PEFT/LoRA adapter single epoch fine-tuned on top of Fine tuning has been done on related to clinical trials. This fine tuned adapter on base LLM can be to address clinical trials related questions in general(macro/broad overview, patient eligiblity, operations etc related question). Further this can also be used for prompt engineering based on CT, or RAG generation(related to CT) based on retrieved chunks. You can load this model using bitsandbytes for 4-bit quantization and peft to apply the adapter weights. Tokenizer formatting utilizes the base model's official chat template to map query/question tokens alongside retrieved context blocks. The following configurations were…
Excerpt from the card by Vaibhav Raj.
Identity and Version
- Repository
- vab46/llama-3.1-8b-instruct-lora-clinical_iter2_epoch2
- Publisher
- Vaibhav Raj
- Task
- Not stated by the source
- Modality
- Other
- Library
- Not stated by the source
- Parameters
- Not stated by the source
- Languages
- Not stated by the source
- Revision
- 063b4a01143a36d3885ee539ab0f21f82debfd5f
- First published
- 2026-09-15
- Last updated
- 2026-09-24
Files and Weights
14 files, 270.8 MB in total. The weights are 6 files totalling 253.6 MB in bin, pt, pth, safetensors.
Every file
| File | Type | Size | SHA-256 |
|---|---|---|---|
| adapter_model.safetensors | Weights | 167.8 MB | 25961494cd37 |
| optimizer.pt | Weights | 85.7 MB | 025658b47d92 |
| rng_state.pth | Weights | 14.6 KB | 5c4b41bdf0a2 |
| scaler.pt | Weights | 1.4 KB | 9e183f508eef |
| scheduler.pt | Weights | 1.5 KB | 0eaabee658a8 |
| training_args.bin | Weights | 5.2 KB | 5ad178907d9b |
| adapter_config.json | Configuration | 1.1 KB | — |
| trainer_state.json | Configuration | 2.4 KB | — |
| training_args.json | Configuration | 3.4 KB | — |
| README.md | Documentation | 35.7 KB | — |
| chat_template.jinja | Other | 4.6 KB | — |
| .gitattributes | Repository | 1.6 KB | — |
| tokenizer.json | Tokenizer | 17.2 MB | f2f90a0ee1b4 |
| tokenizer_config.json | Tokenizer | 325 B | — |
License and Download
- License
- Not stated by the source
- Access
- Open weights, no gate
- Download size
- 253.6 MB
Released by Vaibhav Raj through its official repository on Hugging Face.
Memory Requirements
| Precision | Weights in memory |
|---|---|
| As published | 253.6 MB |
Weights only, from the published parameter count; the key-value cache and runtime add to this.