SAVRN
Search Contact SAVRN

Independent publisher

Bae chang hyun

chbae624

Models in Library1
Datasets in Library0
Models on Hugging Face1
Followers2

Models

Model · Text generation

vllm-translategemma-12b-it

Bae chang hyun

This is a modified version of google/translategemma-12b-it optimized for deployment with vLLM. No retraining was performed. Only configuration files and the chat template were modified. Model weights are identical to the original. As of 2025-01-29, vLLM does not natively support TranslateGemma's custom structured input format. See vllm-project/vllm#32446 for the upstream tracking issue. Until that is merged, this repo provides a workaround by modifying configuration files to make TranslateGemma compatible with vLLM's standard chat API. This conversion is based entirely on the work done by Infomaniak-AI/vllm-translategemma-4b-it. The same conversion approach was applied to the 12B model.…

Open weights gemma 13.2B parameters 131,072 tokens transformers