A RoBERTa [[Liu et al., 2019]](https://arxiv.org/pdf/1907.11692.pdf) model fine-tuned for de-identification of medical notes. A token can either be classified as non-PHI or as one of the 11 PHI types. Token predictions are aggregated to spans by making use of BILOU tagging. The PHI labels that were used for training and other details can be found here: Annotation Guidelines More details on how to use this model, the format of data and other useful information is present in the GitHub repo: Robust DeID. A demo on how the model works (using model predictions to de-identify a medical note) is on this space: Medical-Note-Deidentification. Steps on how this model can be used to run a forward…