How to use transformersbook/xlm-roberta-base-finetuned-panx-en with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("token-classification", model="transformersbook/xlm-roberta-base-finetuned-panx-en")
# Load model directly from transformers import AutoTokenizer, AutoModelForTokenClassification tokenizer = AutoTokenizer.from_pretrained("transformersbook/xlm-roberta-base-finetuned-panx-en") model = AutoModelForTokenClassification.from_pretrained("transformersbook/xlm-roberta-base-finetuned-panx-en", device_map="auto")
