SAVRN
Search Contact SAVRN

Organization

Language Technology Lab @University of Cambridge

cambridgeltl

Representation Learning, Multilingual NLP, Multimodal NLP, BioNLP, Self-Supervised Learning, Explainable AI

Models in Library1
Datasets in Library0
Models on Hugging Face158
Followers74

Models

[news] A cross-lingual extension of SapBERT will appear in the main onference of ACL 2021! [news] SapBERT will appear in the conference proceedings of NAACL 2021! SapBERT by Liu et al. (2020). Trained with UMLS 2020AA (English only), using microsoft/BiomedNLP-PubMedBERT-base-uncased-abstract-fulltext as the base model. The input should be a string of biomedical entity names, e.g., "covid infection" or "Hydroxychloroquine". The [CLS] embedding of the last layer is regarded as the output. The following script converts a list of strings (entity names) into embeddings. For more details about training and eval, see SapBERT github repo.

Open weights apache-2.0 109M parameters 512 tokens transformers