Click on the RoBERTa models in the right sidebar for more examples of how to apply RoBERTa to different language tasks. The example below demonstrates how to predict the token with Pipeline, AutoModel, and from the command line. task= “fill-mask”, model= “FacebookAI/roberta-base”, device= 0 .