SAVRN
Search Contact SAVRN

Open-weight model

openPangu-VL-7B-x-platform

by openRFM hk-eai/openPangu-VL-7B-x-platform

openPangu-VL-7B-x-platform is an open-weight model from openRFM. It has 8.8B parameters and a 131,072-token context. At 16-bit it needs about 21.1 GB of GPU memory, which fits on 1x MI300X from $1.85 an hour, at the lowest prices in the SAVRN Index. It draws 30 downloads a month.

openPangu-VL-7B 是基于昇腾 NPU ,基于openPangu-Embedded-7B-V1.1语言基模和openPangu-ViT-600M视觉编码器训练的高效多模态模型。openPangu-VL-7B 训练了约 3T tokens,具备通用视觉对话、文档理解、目标定位与计数、视频理解、视觉高阶推理等能力。该模型为快思考模型。 注:…

Parameters8.8B
Context131,072
Weights17.6 GB
License—
AccessOpen weights
Monthly Downloads30

Runs On

What it takes to serve openPangu-VL-7B-x-platform (8.8B parameters): the memory its weights need at each precision, and the cheapest way to rent enough data-center GPUs to hold them.

PrecisionWeightsMemory neededCheapest setupPer hourAlso fits
16-bit 17.6 GB 21.1 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00
8-bit 8.8 GB 10.5 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00
4-bit 4.4 GB 5.3 GB 1x MI300X (192 GB)
Vultr
$1.85 1x H100 $1.99 · 1x MI325X $2.00

Memory is the weights at that precision plus 20% for the runtime and a short context; a long context needs more. Prices are the lowest on-demand hourly rates in the SAVRN Index, read Oct 7, 2026.

openPangu-VL-7B-x-platform on every accelerator the SAVRN Index prices, at every precision

Model Card

openPangu-VL-7B 是基于昇腾 NPU ,基于openPangu-Embedded-7B-V1.1语言基模和openPangu-ViT-600M视觉编码器训练的高效多模态模型。openPangu-VL-7B 训练了约 3T tokens,具备通用视觉对话、文档理解、目标定位与计数、视频理解、视觉高阶推理等能力。该模型为快思考模型。 注: 评测使用vllm-ascend部署推理,系统prompt为空。一般而言,图片最小分辨率设置为2304\28\28能获得最优的测评效果。(OCRBench中的极小图OCR除外,建议设置为不大于64\28\28。)具体prompt和分辨率设置参见技术报告附录。 - 使用vllm-ascend推理框架,参考[vllmascendforopenpanguvl7b]进行服务部署。 - python==3.10 - CANN==8.1.RC1 - 更多推理样例和能力展示,请参见cookbooks。 除文件中对开源许可证另有约定外,openPangu-VL-7B 模型根据 OPENPANGU MODEL LICENSE AGREEMENT VERSION 1.0 授权,旨在允许使用并促进人工智能技术的进一步发展。有关详细信息,请参阅模型存储库根目录中的 LICENSE 文件。 由于 openPangu-VL-7B (“模型”)所依赖的技术固有的限制,以及人工智能生成的内容是由盘古自动生成的,华为无法对以下事项做出任何保证: 如果有任何意见和建议,请提交issue或联系[email protected]。

Excerpt from the card by openRFM.

Configuration

Architecture
OpenPanguVLForConditionalGeneration
Context length (tokens)
131,072
Layers
34
Hidden size
4,096
Feed-forward size
12,800
Attention heads
32
Key/value heads
8
Vocabulary size
153,376
RoPE base
6.4e+07
Stored precision
bfloat16
Model type
openpangu_vl

Identity and Version

Repository
hk-eai/openPangu-VL-7B-x-platform
Publisher
openRFM
Task
Not stated by the source
Modality
Other
Library
Not stated by the source
Parameters
8.8B parameters
Languages
Not stated by the source
Revision
53d33a90156b8e9093e5d62676487b9cb3ab114b
First published
2026-04-01
Last updated
2026-10-07

Files and Weights

191 files, 17.7 GB in total. The weights are 1 file totalling 17.6 GB in safetensors.

Weights1 file · 17.6 GB
Configuration139 files · 1.1 MB
Tokenizer3 files · 2.5 MB
Documentation6 files · 64.6 KB
Other39 files · 176.9 MB
Repository3 files · 2.2 KB
Every file
FileTypeSizeSHA-256
model.safetensorsWeights17.6 GB c3cd349fcf26
config.jsonConfiguration1.6 KB —
configuration_openpangu_vl.pyConfiguration259 B —
generation_config.jsonConfiguration177 B —
imageprocessor_openpangu_vl.pyConfiguration186 B —
inference/generate.pyConfiguration1.8 KB —
inference/vllm_ascend/examples/quick_start.pyConfiguration2.6 KB —
inference/vllm_ascend/pangu_infer/launcher.pyConfiguration13.7 KB —
inference/vllm_ascend/pangu_infer/models/vllm_ascend/__init__.pyConfiguration1.5 KB —
inference/vllm_ascend/pangu_infer/models/vllm_ascend/imageprocessor_openpangu_vl.pyConfiguration16.1 KB —
inference/vllm_ascend/pangu_infer/models/vllm_ascend/modeling_openpangu_embedded.pyConfiguration28.8 KB —
inference/vllm_ascend/pangu_infer/models/vllm_ascend/modeling_openpangu_vl.pyConfiguration54.4 KB —
inference/vllm_ascend/pangu_infer/models/vllm_ascend/processor_openpangu_vl.pyConfiguration10.2 KB —
inference/vllm_ascend/pangu_infer/models/vllm_ascend/rotary_embedding.pyConfiguration8.2 KB —
inference/vllm_ascend/pangu_infer/pangu/accelerators/kvcache/kvcache_manager.pyConfiguration20.5 KB —
inference/vllm_ascend/pangu_infer/pangu/accelerators/kvcache/swa.pyConfiguration7.0 KB —
inference/vllm_ascend/pangu_infer/pangu/accelerators/reasoning_compression/config.pyConfiguration551 B —
inference/vllm_ascend/pangu_infer/pangu/accelerators/reasoning_compression/generation_monitor.pyConfiguration33.6 KB —
inference/vllm_ascend/pangu_infer/pangu/accelerators/reasoning_compression/multiproc_executor.pyConfiguration1.2 KB —
inference/vllm_ascend/pangu_infer/pangu/accelerators/reasoning_compression/repetition_detector.pyConfiguration18.8 KB —
inference/vllm_ascend/pangu_infer/pangu/accelerators/reasoning_compression/sampler.pyConfiguration6.4 KB —
inference/vllm_ascend/pangu_infer/pangu/accelerators/reasoning_compression/sequence.pyConfiguration599 B —
inference/vllm_ascend/pangu_infer/pangu/accelerators/reasoning_compression/think_compressor.pyConfiguration12.9 KB —
inference/vllm_ascend/pangu_infer/pangu/accelerators/reasoning_compression/utils.pyConfiguration1.4 KB —
inference/vllm_ascend/pangu_infer/pangu/accelerators/schedule_policy/normalized_scorer.pyConfiguration3.2 KB —
inference/vllm_ascend/pangu_infer/pangu/accelerators/schedule_policy/request_queue.pyConfiguration13.4 KB —
inference/vllm_ascend/pangu_infer/pangu/accelerators/schedule_policy/schedule_policies.pyConfiguration11.8 KB —
inference/vllm_ascend/pangu_infer/pangu/accelerators/schedule_policy/weighted_score_softer.pyConfiguration1.3 KB —
inference/vllm_ascend/pangu_infer/pangu/accelerators/sparsekv/block_table.pyConfiguration613 B —
inference/vllm_ascend/pangu_infer/pangu/accelerators/sparsekv/kv_cache_utils.pyConfiguration1.7 KB —
inference/vllm_ascend/pangu_infer/pangu/accelerators/sparsekv/no_prefix_cache_coordinator.pyConfiguration2.6 KB —
inference/vllm_ascend/pangu_infer/pangu/accelerators/sparsekv/sparsekv.pyConfiguration14.3 KB —
inference/vllm_ascend/pangu_infer/pangu/accelerators/sparsekv/sparsekv_attention_manager.pyConfiguration1.2 KB —
inference/vllm_ascend/pangu_infer/pangu/accelerators/sparsekv/sparsekv_block_pool_utils.pyConfiguration1.2 KB —
inference/vllm_ascend/pangu_infer/pangu/accelerators/sparsekv/sparsekv_runner_utils.pyConfiguration11.3 KB —
inference/vllm_ascend/pangu_infer/pangu/accelerators/sparsekv/sparsekv_scheduler_utils.pyConfiguration2.0 KB —
inference/vllm_ascend/pangu_infer/pangu/adaptor_manager/adaptor_manager.pyConfiguration7.5 KB —
inference/vllm_ascend/pangu_infer/pangu/adaptor_manager/apply.pyConfiguration5.1 KB —
inference/vllm_ascend/pangu_infer/pangu/adaptor_manager/custom_ops_patcher.pyConfiguration7.5 KB —
inference/vllm_ascend/pangu_infer/pangu/adaptor_manager/router_patcher.pyConfiguration4.1 KB —
inference/vllm_ascend/pangu_infer/pangu/utils/pangu_config.pyConfiguration1.3 KB —
inference/vllm_ascend/pangu_infer/pangu/utils/utils.pyConfiguration1.3 KB —
inference/vllm_ascend/pangu_infer/patches/vllm/__init__.pyConfiguration427 B —
inference/vllm_ascend/pangu_infer/patches/vllm/attention/__init__.pyConfiguration —
inference/vllm_ascend/pangu_infer/patches/vllm/attention/layer.pyConfiguration5.5 KB —
inference/vllm_ascend/pangu_infer/patches/vllm/config.pyConfiguration15.2 KB —
inference/vllm_ascend/pangu_infer/patches/vllm/engine/__init__.pyConfiguration —
inference/vllm_ascend/pangu_infer/patches/vllm/engine/protocol.pyConfiguration538 B —
inference/vllm_ascend/pangu_infer/patches/vllm/entrypoints/__init__.pyConfiguration —
inference/vllm_ascend/pangu_infer/patches/vllm/entrypoints/chat_utils.pyConfiguration4.8 KB —
inference/vllm_ascend/pangu_infer/patches/vllm/entrypoints/openai/__init__.pyConfiguration —
inference/vllm_ascend/pangu_infer/patches/vllm/entrypoints/openai/api_server.pyConfiguration4.3 KB —
inference/vllm_ascend/pangu_infer/patches/vllm/entrypoints/openai/protocol.pyConfiguration12.5 KB —
inference/vllm_ascend/pangu_infer/patches/vllm/entrypoints/openai/reasoning_parsers/__init__.pyConfiguration93 B —
inference/vllm_ascend/pangu_infer/patches/vllm/entrypoints/openai/reasoning_parsers/pangu_reasoning_parser.pyConfiguration7.2 KB —
inference/vllm_ascend/pangu_infer/patches/vllm/entrypoints/openai/serving_chat.pyConfiguration8.9 KB —
inference/vllm_ascend/pangu_infer/patches/vllm/entrypoints/openai/serving_completion.pyConfiguration11.0 KB —
inference/vllm_ascend/pangu_infer/patches/vllm/entrypoints/openai/tool_parsers/__init__.pyConfiguration78 B —
inference/vllm_ascend/pangu_infer/patches/vllm/entrypoints/openai/tool_parsers/pangu_tool_parser.pyConfiguration13.4 KB —
inference/vllm_ascend/pangu_infer/patches/vllm/model_executor/__init__.pyConfiguration —
inference/vllm_ascend/pangu_infer/patches/vllm/model_executor/layers/__init__.pyConfiguration —
inference/vllm_ascend/pangu_infer/patches/vllm/model_executor/layers/fused_moe/__init__.pyConfiguration —
inference/vllm_ascend/pangu_infer/patches/vllm/model_executor/layers/fused_moe/layer.pyConfiguration13.0 KB —
inference/vllm_ascend/pangu_infer/patches/vllm/model_executor/layers/linear.pyConfiguration1.9 KB —
inference/vllm_ascend/pangu_infer/patches/vllm/model_executor/layers/rotary_embedding.pyConfiguration17.6 KB —
inference/vllm_ascend/pangu_infer/patches/vllm/multimodal/__init__.pyConfiguration —
inference/vllm_ascend/pangu_infer/patches/vllm/multimodal/utils.pyConfiguration1.1 KB —
inference/vllm_ascend/pangu_infer/patches/vllm/multimodal/video.pyConfiguration5.0 KB —
inference/vllm_ascend/pangu_infer/patches/vllm/sampling_params.pyConfiguration641 B —
inference/vllm_ascend/pangu_infer/patches/vllm/transformers_utils/__init__.pyConfiguration —
inference/vllm_ascend/pangu_infer/patches/vllm/v1/__init__.pyConfiguration —
inference/vllm_ascend/pangu_infer/patches/vllm/v1/core/__init__.pyConfiguration —
inference/vllm_ascend/pangu_infer/patches/vllm/v1/core/block_pool.pyConfiguration1.7 KB —
inference/vllm_ascend/pangu_infer/patches/vllm/v1/core/kv_cache_coordinator.pyConfiguration2.0 KB —
inference/vllm_ascend/pangu_infer/patches/vllm/v1/core/kv_cache_utils.pyConfiguration3.1 KB —
inference/vllm_ascend/pangu_infer/patches/vllm/v1/core/sched/__init__.pyConfiguration —
inference/vllm_ascend/pangu_infer/patches/vllm/v1/core/sched/scheduler.pyConfiguration38.0 KB —
inference/vllm_ascend/pangu_infer/patches/vllm/v1/core/single_type_kv_cache_manager.pyConfiguration1.2 KB —
inference/vllm_ascend/pangu_infer/patches/vllm/v1/engine/__init__.pyConfiguration1.8 KB —
inference/vllm_ascend/pangu_infer/patches/vllm/v1/engine/core.pyConfiguration1.2 KB —
inference/vllm_ascend/pangu_infer/patches/vllm/v1/engine/core_client.pyConfiguration5.1 KB —
inference/vllm_ascend/pangu_infer/patches/vllm/v1/engine/processor.pyConfiguration6.5 KB —
inference/vllm_ascend/pangu_infer/patches/vllm/v1/executor/__init__.pyConfiguration —
inference/vllm_ascend/pangu_infer/patches/vllm/v1/executor/abstract.pyConfiguration2.3 KB —
inference/vllm_ascend/pangu_infer/patches/vllm/v1/request.pyConfiguration5.2 KB —
inference/vllm_ascend/pangu_infer/patches/vllm/v1/sample/__init__.pyConfiguration —
inference/vllm_ascend/pangu_infer/patches/vllm/v1/sample/metadata.pyConfiguration987 B —
inference/vllm_ascend/pangu_infer/patches/vllm/v1/sample/ops/__init__.pyConfiguration —
inference/vllm_ascend/pangu_infer/patches/vllm/v1/sample/ops/topk_topp_sampler.pyConfiguration2.1 KB —
inference/vllm_ascend/pangu_infer/patches/vllm/v1/sample/rejection_sampler.pyConfiguration3.4 KB —
inference/vllm_ascend/pangu_infer/patches/vllm/v1/sample/sampler.pyConfiguration3.4 KB —
inference/vllm_ascend/pangu_infer/patches/vllm/worker/__init__.pyConfiguration —
inference/vllm_ascend/pangu_infer/patches/vllm/worker/gpu_input_batch.pyConfiguration33.0 KB —
inference/vllm_ascend/pangu_infer/patches/vllm/worker/worker_base.pyConfiguration4.0 KB —
inference/vllm_ascend/pangu_infer/patches/vllm_ascend/__init__.pyConfiguration427 B —
inference/vllm_ascend/pangu_infer/patches/vllm_ascend/ascend_config.pyConfiguration6.7 KB —
inference/vllm_ascend/pangu_infer/patches/vllm_ascend/attention/__init__.pyConfiguration —
inference/vllm_ascend/pangu_infer/patches/vllm_ascend/attention/attention_v1.pyConfiguration34.0 KB —
inference/vllm_ascend/pangu_infer/patches/vllm_ascend/attention/attention_v1_torchair.pyConfiguration35.5 KB —
inference/vllm_ascend/pangu_infer/patches/vllm_ascend/attention/mla_v1.pyConfiguration6.3 KB —
inference/vllm_ascend/pangu_infer/patches/vllm_ascend/distributed/__init__.pyConfiguration —
inference/vllm_ascend/pangu_infer/patches/vllm_ascend/distributed/llmdatadist_c_mgr_connector.pyConfiguration4.1 KB —
inference/vllm_ascend/pangu_infer/patches/vllm_ascend/distributed/parallel_state.pyConfiguration3.7 KB —
inference/vllm_ascend/pangu_infer/patches/vllm_ascend/ops/__init__.pyConfiguration —
inference/vllm_ascend/pangu_infer/patches/vllm_ascend/ops/attention.pyConfiguration6.6 KB —
inference/vllm_ascend/pangu_infer/patches/vllm_ascend/ops/common_fused_moe.pyConfiguration3.4 KB —
inference/vllm_ascend/pangu_infer/patches/vllm_ascend/ops/fused_moe.pyConfiguration25.6 KB —
inference/vllm_ascend/pangu_infer/patches/vllm_ascend/ops/rotary_embedding.pyConfiguration1.3 KB —
inference/vllm_ascend/pangu_infer/patches/vllm_ascend/platform.pyConfiguration10.5 KB —
inference/vllm_ascend/pangu_infer/patches/vllm_ascend/quantization/__init__.pyConfiguration —
inference/vllm_ascend/pangu_infer/patches/vllm_ascend/quantization/quant_config.pyConfiguration3.6 KB —
inference/vllm_ascend/pangu_infer/patches/vllm_ascend/quantization/w8a8.pyConfiguration1.8 KB —
inference/vllm_ascend/pangu_infer/patches/vllm_ascend/quantization/w8a8_dynamic.pyConfiguration23.6 KB —
inference/vllm_ascend/pangu_infer/patches/vllm_ascend/sample/__init__.pyConfiguration —
inference/vllm_ascend/pangu_infer/patches/vllm_ascend/sample/rejection_sampler.pyConfiguration9.5 KB —
inference/vllm_ascend/pangu_infer/patches/vllm_ascend/worker/__init__.pyConfiguration —
inference/vllm_ascend/pangu_infer/patches/vllm_ascend/worker/cache_engine.pyConfiguration3.5 KB —
inference/vllm_ascend/pangu_infer/patches/vllm_ascend/worker/model_runner.pyConfiguration3.6 KB —
inference/vllm_ascend/pangu_infer/patches/vllm_ascend/worker/model_runner_v1.pyConfiguration92.0 KB —
inference/vllm_ascend/pangu_infer/patches/vllm_ascend/worker/mtp_proposer_v1.pyConfiguration18.8 KB —
inference/vllm_ascend/pangu_infer/patches/vllm_ascend/worker/worker_v1.pyConfiguration6.1 KB —
inference/vllm_ascend/pangu_infer/sitecustomize.pyConfiguration2.8 KB —
main.pyConfiguration8.6 KB —
model.safetensors.index.jsonConfiguration46.4 KB —
modeling_openpangu_embedded.pyConfiguration261 B —
modeling_openpangu_vl.pyConfiguration249 B —
openpangu_vl/__init__.pyConfiguration355 B —
openpangu_vl/configuration_openpangu_vl.pyConfiguration5.7 KB —
openpangu_vl/imageprocessor_openpangu_vl.pyConfiguration16.8 KB —
openpangu_vl/modeling_openpangu_embedded.pyConfiguration31.1 KB —
openpangu_vl/modeling_openpangu_vl.pyConfiguration88.7 KB —
openpangu_vl/processor_openpangu_vl.pyConfiguration10.2 KB —
openpangu_vl/tokenization_openpangu.pyConfiguration10.5 KB —
openpangu_vl/videoprocessor_openpangu_vl.pyConfiguration8.1 KB —
preprocessor_config.jsonConfiguration823 B —
processor_openpangu_vl.pyConfiguration251 B —
special_tokens_map.jsonConfiguration414 B —
tokenization_openpangu.pyConfiguration181 B —
video_preprocessor_config.jsonConfiguration1.4 KB —
videoprocessor_openpangu_vl.pyConfiguration261 B —
LICENSEDocumentation4.5 KB —
OPEN SOURCE SOFTWARE NOTICEDocumentation35.5 KB —
README.mdDocumentation5.0 KB —
README_EN.mdDocumentation5.7 KB —
doc/vllm_ascend_for_openpangu_vl_7b.mdDocumentation6.7 KB —
doc/vllm_ascend_for_openpangu_vl_7b_EN.mdDocumentation7.2 KB —
chat_template.jinjaOther1.4 KB —
cookbooks/assets/grounding/depth_1.jpgOther109.2 KB 21ac7fa907d3
cookbooks/assets/grounding/depth_2.jpgOther131.4 KB ea6caad976a5
cookbooks/assets/grounding/dinner.jpgOther440.9 KB bd70e19ff10d
cookbooks/assets/grounding/macaron.jpgOther116.7 KB 9604a04be51e
cookbooks/assets/grounding/peoples.jpgOther101.1 KB 3d49bf9200e7
cookbooks/assets/grounding/test_example_point_01.pngOther1.1 MB 4a65d21bb6d0
cookbooks/assets/grounding/test_example_point_02.pngOther545.5 KB 7cbeff1c16bf
cookbooks/assets/grounding/tools.jpgOther69.5 KB d9843a273c47
cookbooks/assets/ocr/example1_1.pngOther536.3 KB a00ab06d34e0
cookbooks/assets/ocr/example1_2.pngOther317.5 KB 8a1e06f03f8c
cookbooks/assets/ocr/example2.pngOther594.1 KB 7d2e6ba81924
cookbooks/assets/ocr/example3.jpgOther74.8 KB —
cookbooks/assets/ocr/example4.pngOther111.3 KB 1b2c35cfff31
cookbooks/assets/ocr/example5.pngOther1.3 MB e8e6388d05d1
cookbooks/assets/ocr/example6.pngOther121.4 KB 079d2df93107
cookbooks/assets/ocr/example7.pngOther292.5 KB b514ab9dd987
cookbooks/assets/ocr/example7_2.pngOther233.4 KB 01ae75907ed4
cookbooks/assets/reasoning/biology.pngOther7.8 KB 03d5588406cc
cookbooks/assets/reasoning/chemistry.pngOther152.1 KB 73c330872e6c
cookbooks/assets/reasoning/geometry.pngOther264.9 KB d91e111372ff
cookbooks/assets/reasoning/logical.pngOther8.3 KB 009b3d7a457c
cookbooks/assets/video/example_video_1.mp4Other12.7 MB 7a39adc894b3
cookbooks/assets/video/example_video_2.mp4Other14.9 MB 2a90a370b6a7
cookbooks/assets/video/example_video_3.mp4Other26.4 MB a005fdc45c1e
cookbooks/assets/video/example_video_4.mp4Other8.1 MB cc2a87bf37fe
cookbooks/assets/video/example_video_5.mp4Other4.8 MB 0613a6189fb5
cookbooks/assets/video/example_video_6.mp4Other19.9 MB 2bd56ba8ef4d
cookbooks/assets/video/example_video_7.mp4Other23.5 MB f3020815b636
cookbooks/assets/video/example_video_8.mp4Other25.9 MB cf41e2c4a511
cookbooks/assets/video/example_video_9.mp4Other16.1 MB 121f77f79e28
cookbooks/grounding.ipynbOther10.7 MB 68a1d3e9b017
cookbooks/ocr.ipynbOther5.5 MB —
cookbooks/reasoning.ipynbOther605.2 KB —
cookbooks/video.ipynbOther12.2 KB —
doc/technical_report.pdfOther1.3 MB 3d9b7f7fd871
inference/requirements.txtOther71 B —
inference/vllm_ascend/examples/start_serving_openpangu_vl_7b.shOther3.5 KB —
pyproject.tomlOther736 B —
.gitattributesRepository2.1 KB —
.gitignoreRepository129 B —
.python-versionRepository5 B —
inference/vllm_ascend/pangu_infer/patches/vllm/transformers_utils/tokenizer_group.pyTokenizer1.3 KB —
tokenizer.modelTokenizer2.5 MB 6b16f1558c0c
tokenizer_config.jsonTokenizer10.6 KB —

License and Download

License
Not stated by the source
Access
Open weights, no gate
Download size
17.6 GB
Download from openRFM

Released by openRFM through its official repository on Hugging Face.

Memory Requirements

PrecisionWeights in memory
As published17.6 GB
16-bit17.6 GB
8-bit8.8 GB
4-bit4.4 GB

Weights only, from the published parameter count; the key-value cache and runtime add to this.

Questions About openPangu-VL-7B-x-platform

How much GPU memory does openPangu-VL-7B-x-platform need?

About 21.1 GB at 16-bit and 5.3 GB at 4-bit: the weights (8.8B parameters) plus a working margin. A long context needs more.

What is the cheapest GPU to run openPangu-VL-7B-x-platform on?

At 16-bit, 1x MI300X from $1.85 an hour; at 4-bit, 1x MI300X from $1.85 an hour, at the lowest on-demand prices the SAVRN Index lists.

What is openPangu-VL-7B-x-platform's context length?

131,072 tokens, from the maximum position embeddings in its published configuration.