code-search-net-tokenizer is an open-weight model from Yangjiaxuan. Its published files total 3.7 MB.
This is the model card of a transformers model that has been pushed on the Hub. Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. Use the code below to get started with the model.
Model Card
This is the model card of a transformers model that has been pushed on the Hub. Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. Use the code below to get started with the model. Carbon emissions can be estimated using the Machine Learning Impact calculator presented in Lacoste et al. (2019).
Excerpt from the card by Yangjiaxuan.
Identity and Version
- Repository
- yjxyjx/code-search-net-tokenizer
- Publisher
- Yangjiaxuan
- Task
- Not stated by the source
- Modality
- Other
- Library
- transformers
- Parameters
- Not stated by the source
- Languages
- Not stated by the source
- Revision
- bf00cdbfb9a836db6f4313eb733458e58762b672
- First published
- 2026-09-27
- Last updated
- 2026-09-27
Files and Weights
4 files, 3.7 MB in total.
Every file
| File | Type | Size | SHA-256 |
|---|---|---|---|
| README.md | Documentation | 5.2 KB | — |
| .gitattributes | Repository | 1.5 KB | — |
| tokenizer.json | Tokenizer | 3.7 MB | — |
| tokenizer_config.json | Tokenizer | 315 B | — |
License and Download
- License
- Not stated by the source
- Access
- Open weights, no gate
Released by Yangjiaxuan through its official repository on Hugging Face.
Built From
- Described by arXiv:1910.09700