Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Tokenizer load error #23

Open
uab-fusion-lab opened this issue Jul 18, 2023 · 0 comments
Open

Tokenizer load error #23

uab-fusion-lab opened this issue Jul 18, 2023 · 0 comments

Comments

@uab-fusion-lab
Copy link

I got the error show:

Traceback (most recent call last):
File "train.py", line 94, in
student=config.create_student(nocrf=args.nocrf)
File "D:\KB-NER-main\flair\config_parser.py", line 240, in create_student
return self.create_model(self.config,pretrained=self.load_pretrained(self.config), is_student=True)
File "D:\KB-NER-main\flair\config_parser.py", line 193, in create_model
embeddings, word_map, char_map, lemma_map, postag_map=self.create_embeddings(config['embeddings'])
File "D:\KB-NER-main\flair\config_parser.py", line 168, in create_embeddings
embedding_list.append(getattr(Embeddings,embedding.split('-')[0])(**embeddings[embedding]))
File "D:\KB-NER-main\flair\embeddings.py", line 2951, in init
self.tokenizer = AutoTokenizer.from_pretrained(model)
File "C:\Users\RichardFan\anaconda3\envs\adaseq\lib\site-packages\transformers\models\auto\tokenization_auto.py", line 643, in from_pretrained
tokenizer_config = get_tokenizer_config(pretrained_model_name_or_path, **kwargs)
File "C:\Users\RichardFan\anaconda3\envs\adaseq\lib\site-packages\transformers\models\auto\tokenization_auto.py", line 487, in get_tokenizer_config
resolved_config_file = cached_file(
File "C:\Users\RichardFan\anaconda3\envs\adaseq\lib\site-packages\transformers\utils\hub.py", line 417, in cached_file
resolved_file = hf_hub_download(
File "C:\Users\RichardFan\anaconda3\envs\adaseq\lib\site-packages\huggingface_hub\utils_validators.py", line 110, in _inner_fn
validate_repo_id(arg_value)
File "C:\Users\RichardFan\anaconda3\envs\adaseq\lib\site-packages\huggingface_hub\utils_validators.py", line 158, in validate_repo_id
raise HFValidationError(
huggingface_hub.utils._validators.HFValidationError: Repo id must be in the form 'repo_name' or 'namespace/repo_name': 'resources/taggers/xlmr-large-pretuned-tuned-wiki-first_3epoch_1batch_4accumulate_0.000005lr_10000lrrate_multi_monolingual_crf_fast_norelearn_sentbatch_sentloss_withdev_finetune_saving_amz_doc_wiki_v3_10upsample_addmix_ner23/xlm-roberta-large'. Use repo_type argument if needed.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant