fin-laya-multilingual

Fin-Laya-Multilingual — 3-rounds

Training release: 3-rounds (SFT → SFT → RLCD).

Fin-Laya Models collection

中文 | English

English

Financial decision model

Fin-Laya-Multilingual adapts Laya multilingual to financial behavior using observed survey answers. It supports structured choice tasks in Chinese and English. The model is a financial behavior component of the 1.4B Persona Social Model project, covering household consumption, borrowing, saving, and repayment choices.

Current version: PyTorch

Data and deployment

The dataset contains 2,455,152 real survey question–answer records across 119 question versions for training and evaluation. Sources: China Household Finance Survey (CHFS) and Chinese General Social Survey (CGSS).

With approximately 0.32B parameters and 644 MB of FP16 weights, the model is suitable for deployment on consumer GPUs. PyTorch and MLX versions are available. Fin-Laya-Multilingual-MLX supports MLX CUDA and has been verified on one NVIDIA A100.

Accuracy and performance

Matched held-out test set: 240,458 question–answer records. Macro F1 is computed within each question and then averaged across the 119 question versions.

Single-GPU inference speed

Laya runs on the same NVIDIA A100 40GB with one request at a time. The benchmark uses three identical Chinese financial cases, with three warmups and 20 timed calls per case. Jev is an API reference; its latency includes network and service time.

tokens/s measures input processing using a shared tokenizer. Laya returns structured choices.

Training: two SFT stages, one RLCD stage

1. SFT stage 1: start from Laya multilingual and learn observed respondent answers across 21 question versions.
2. SFT stage 2: expand to 119 question versions and continue supervised financial adaptation.
3. RLCD stage 3: start from the second SFT checkpoint and continue training with Laya’s native RLCD.

Training uses six A100 GPUs and BF16. The released checkpoint follows SFT → SFT → RLCD.

Model versions and reports

• PyTorch version
• MLX version (MLX CUDA supported)
• Training and evaluation report · Inference speed report
• GitHub

Reproduce the evaluation

Frozen test questions and observed answers: 240,458 records per language (zh). evaluation_report.json contains overall and per-question scores.

F1 first averages class F1 across every candidate class within each supported question version, with zero denominators assigned zero. It then averages equally across question versions with test records. Accuracy is total correct predictions divided by test records.

python evaluate.py --output evaluation_reproduced.json

See versions.json for historical versions, for example python evaluate.py --version rlcd-1.