LEE, HYEOKSEUNG

This is an NVFP4 quantized version of Qwen3-VL-8B-Instruct, a powerful vision-language model for multimodal understanding and generation tasks. The following modules were excluded from quantization to maintain model quality: - lmhead (language model head) - Visual encoder modules (model.visual.) - MLP gate projections (.mlp.gate$) For faster inference, you can use this model with vLLM: This quantized model maintains high quality for vision-language tasks while significantly reducing memory usage. The SmoothQuant technique helps preserve model accuracy during quantization. Typical quality degradation is 2-5% compared to the full-precision model. 1. Calibration: Used 512 samples from the…