Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Can not load robotics dataset #5295

Closed
yepw opened this issue Mar 3, 2024 · 4 comments
Closed

Can not load robotics dataset #5295

yepw opened this issue Mar 3, 2024 · 4 comments
Labels
bug Something isn't working

Comments

@yepw
Copy link

yepw commented Mar 3, 2024

/!\ PLEASE INCLUDE THE FULL STACKTRACE AND CODE SNIPPET

Short description
Could not load robotics datasets such as berkeley_autolab_ur5

Environment information

  • Operating System: Ubuntu

  • Python version: 3.8

  • tensorflow-datasets/tfds-nightly version: nightly 4.9.2.dev202308090034

  • tensorflow/tf-nightly version: tensorflow 2.13.1

  • Does the issue still exists with the last tfds-nightly package (pip install --upgrade tfds-nightly) ? Yes

Reproduction instructions

import tensorflow_datasets as tfds
import tensorflow as tf

tfds = tfds.load('berkeley_autolab_ur5')

Expected behavior
It starts downloading the dataset.

Actual behavior

Traceback (most recent call last):
  File "dataset.py", line 11, in <module>
    tfds = tfds.load('berkeley_autolab_ur5')
  File "/home/yepw/.local/lib/python3.8/site-packages/tensorflow_datasets/core/logging/__init__.py", line 166, in __call__
    return function(*args, **kwargs)
  File "/home/yepw/.local/lib/python3.8/site-packages/tensorflow_datasets/core/load.py", line 633, in load
    dbuilder = _fetch_builder(
  File "/home/yepw/.local/lib/python3.8/site-packages/tensorflow_datasets/core/load.py", line 488, in _fetch_builder
    return builder(name, data_dir=data_dir, try_gcs=try_gcs, **builder_kwargs)
  File "/usr/lib/python3.8/contextlib.py", line 75, in inner
    return func(*args, **kwds)
  File "/home/yepw/.local/lib/python3.8/site-packages/tensorflow_datasets/core/logging/__init__.py", line 166, in __call__
    return function(*args, **kwargs)
  File "/home/yepw/.local/lib/python3.8/site-packages/tensorflow_datasets/core/load.py", line 215, in builder
    raise not_found_error
  File "/home/yepw/.local/lib/python3.8/site-packages/tensorflow_datasets/core/load.py", line 196, in builder
    cls = builder_cls(str(name))
  File "/usr/lib/python3.8/contextlib.py", line 75, in inner
    return func(*args, **kwds)
  File "/home/yepw/.local/lib/python3.8/site-packages/tensorflow_datasets/core/load.py", line 121, in builder_cls
    cls = registered.imported_builder_cls(str(ds_name))
  File "/home/yepw/.local/lib/python3.8/site-packages/tensorflow_datasets/core/registered.py", line 301, in imported_builder_cls
    raise DatasetNotFoundError(f'Dataset {name} not found.')
tensorflow_datasets.core.registered.DatasetNotFoundError: Dataset berkeley_autolab_ur5 not found.
Available datasets:
        - abstract_reasoning
        - accentdb
        - aeslc
        - aflw2k3d
        - ag_news_subset
        - ai2_arc
        ...
       - youtube_vis

Check that:
    - if dataset was added recently, it may only be available
      in `tfds-nightly`
    - the dataset name is spelled correctly
    - dataset class defines all base class abstract methods
    - the module defining the dataset class is imported

The builder directory /home/yepw/tensorflow_datasets/berkeley_autolab_ur5 doesn't contain any versions.
No builder could be found in the directory: /home/yepw/tensorflow_datasets for the builder: berkeley_autolab_ur5.
No registered data_dirs were found in:
        - /home/yepw/tensorflow_datasets
@yepw yepw added the bug Something isn't working label Mar 3, 2024
@marcenacp
Copy link
Collaborator

Hi @yepw, are you sure you use the latest version of TFDS? I could successfully start downloading the dataset with:

$ git clone git@github.com:tensorflow/datasets.git
$ cd datasets
$ pip install -e .
$ python -c "import tensorflow_datasets as tfds; tfds = tfds.load('berkeley_autolab_ur5')"
Downloading and preparing dataset Unknown size (download: Unknown size, generated: 76.39 GiB, total: 76.39 GiB) to /usr/local/google/home/pierremarcenac/tensorflow_datasets/berkeley_autolab_ur5/0.1.0...

@marcenacp
Copy link
Collaborator

Closing the PR, feel free to re-open if the problem persists. :)

@yepw
Copy link
Author

yepw commented Apr 10, 2024

Thanks, @marcenacp I was following the steps, but still having the same problem. I started everything from a new and clean conda environment.

This is strange, perhaps I am missing something. Other than import tensorflow_datasets as tfds;, do I need to import other libraries for robotics dataset?

Operating System: Ubuntu
Python version: 3.10.14
tensorflow-datasets/tfds-nightly version: 4.9.4+nightly

Entire error

python -c "import tensorflow_datasets as tfds; tfds = tfds.load('berkeley_autolab_ur5')"
Traceback (most recent call last):
  File "<string>", line 1, in <module>
  File "/home/yeping/motion_summarizer/datasets/tensorflow_datasets/core/logging/__init__.py", line 168, in __call__
    return function(*args, **kwargs)
  File "/home/yeping/motion_summarizer/datasets/tensorflow_datasets/core/load.py", line 643, in load
    dbuilder = _fetch_builder(
  File "/home/yeping/motion_summarizer/datasets/tensorflow_datasets/core/load.py", line 498, in _fetch_builder
    return builder(name, data_dir=data_dir, try_gcs=try_gcs, **builder_kwargs)
  File "/home/yeping/anaconda3/envs/py310/lib/python3.10/contextlib.py", line 79, in inner
    return func(*args, **kwds)
  File "/home/yeping/motion_summarizer/datasets/tensorflow_datasets/core/logging/__init__.py", line 168, in __call__
    return function(*args, **kwargs)
  File "/home/yeping/motion_summarizer/datasets/tensorflow_datasets/core/load.py", line 225, in builder
    raise not_found_error
  File "/home/yeping/motion_summarizer/datasets/tensorflow_datasets/core/load.py", line 202, in builder
    cls = builder_cls(str(name))
  File "/home/yeping/anaconda3/envs/py310/lib/python3.10/contextlib.py", line 79, in inner
    return func(*args, **kwds)
  File "/home/yeping/motion_summarizer/datasets/tensorflow_datasets/core/load.py", line 124, in builder_cls
    cls = registered.imported_builder_cls(str(ds_name))
  File "/home/yeping/motion_summarizer/datasets/tensorflow_datasets/core/registered.py", line 296, in imported_builder_cls
    raise DatasetNotFoundError(f'Dataset {name} not found.')
tensorflow_datasets.core.registered.DatasetNotFoundError: Dataset berkeley_autolab_ur5 not found.
Available datasets:
	- abstract_reasoning
	- accentdb
	- aeslc
	- aflw2k3d
	- ag_news_subset
	- ai2_arc
	- ai2_arc_with_ir
	- amazon_us_reviews
	- anli
	- answer_equivalence
	- arc
	- asqa
	- asset
	- assin2
	- bair_robot_pushing_small
	- bccd
	- beans
	- bee_dataset
	- beir
	- big_patent
	- bigearthnet
	- billsum
	- binarized_mnist
	- binary_alpha_digits
	- ble_wind_field
	- blimp
	- booksum
	- bool_q
	- bot_adversarial_dialogue
	- bucc
	- caltech101
	- caltech_birds2010
	- caltech_birds2011
	- cardiotox
	- cars196
	- cassava
	- cats_vs_dogs
	- celeb_a
	- celeb_a_hq
	- chexpert
	- cifar10
	- cifar100
	- cifar100_n
	- cifar10_1
	- cifar10_corrupted
	- cifar10_h
	- cifar10_n
	- citrus_leaves
	- cityscapes
	- clevr
	- clic
	- cmaterdb
	- coco
	- coco_captions
	- coil100
	- colorectal_histology
	- colorectal_histology_large
	- common_voice
	- controlled_noisy_web_labels
	- corr2cause
	- crema_d
	- curated_breast_imaging_ddsm
	- cycle_gan
	- databricks_dolly
	- deep_weeds
	- dementiabank
	- diabetic_retinopathy_detection
	- dices
	- div2k
	- dmlab
	- domainnet
	- downsampled_imagenet
	- dsprites
	- dtd
	- duke_ultrasound
	- e2e_cleaned
	- efron_morris75
	- emnist
	- eurosat
	- fashion_mnist
	- flic
	- food101
	- fuss
	- geirhos_conflict_stimuli
	- groove
	- gtzan
	- gtzan_music_speech
	- horses_or_humans
	- i_naturalist2017
	- i_naturalist2018
	- i_naturalist2021
	- imagenet2012
	- imagenet2012_corrupted
	- imagenet2012_fewshot
	- imagenet2012_multilabel
	- imagenet2012_real
	- imagenet2012_subset
	- imagenet_a
	- imagenet_lt
	- imagenet_pi
	- imagenet_r
	- imagenet_resized
	- imagenet_sketch
	- imagenet_v2
	- imagenette
	- imagewang
	- imdb_reviews
	- irc_disentanglement
	- kddcup99
	- kitti
	- kmnist
	- lambada
	- lfw
	- librispeech
	- librispeech_lm
	- libritts
	- ljspeech
	- lm1b
	- lost_and_found
	- lsun
	- lvis
	- malaria
	- math_dataset
	- math_qa
	- mctaco
	- media_sum
	- mlqa
	- mnist
	- mnist_corrupted
	- natural_instructions
	- natural_questions
	- natural_questions_open
	- newsroom
	- nsynth
	- nyu_depth_v2
	- ogbg_molpcba
	- omniglot
	- open_images_challenge2019_detection
	- open_images_v4
	- openbookqa
	- opinion_abstracts
	- opinosis
	- opus
	- oxford_flowers102
	- oxford_iiit_pet
	- para_crawl
	- pass
	- patch_camelyon
	- paws_wiki
	- paws_x_wiki
	- penguins
	- pet_finder
	- pg19
	- piqa
	- places365_small
	- placesfull
	- plant_leaves
	- plant_village
	- plantae_k
	- protein_net
	- qa4mre
	- qasc
	- qm9
	- quac
	- quality
	- quickdraw_bitmap
	- race
	- radon
	- real_toxicity_prompts
	- reddit
	- reddit_disentanglement
	- reddit_tifu
	- ref_coco
	- resisc45
	- robomimic_mg
	- robomimic_mh
	- robomimic_ph
	- robonet
	- rock_paper_scissors
	- rock_you
	- s3o4d
	- salient_span_wikipedia
	- samsum
	- savee
	- scan
	- scene_parse150
	- schema_guided_dialogue
	- sci_tail
	- scicite
	- scientific_papers
	- segment_anything
	- sentiment140
	- shapes3d
	- sift1m
	- simpte
	- siscore
	- smallnorb
	- smartwatch_gestures
	- snli
	- so2sat
	- speech_commands
	- spoken_digit
	- squad
	- stanford_dogs
	- stanford_online_products
	- star_cfq
	- starcraft_video
	- stl10
	- story_cloze
	- summscreen
	- sun397
	- svhn_cropped
	- symmetric_solids
	- tatoeba
	- ted_hrlr_translate
	- ted_multi_translate
	- tedlium
	- tf_flowers
	- the300w_lp
	- tiny_shakespeare
	- titanic
	- trec
	- trivia_qa
	- uc_merced
	- universal_dependencies
	- user_libri_audio
	- vctk
	- visual_domain_decathlon
	- voc
	- voxceleb
	- voxforge
	- waymo_open_dataset
	- webvid
	- wider_face
	- xtreme_pos
	- xtreme_s
	- yes_no

Check that:
    - if dataset was added recently, it may only be available
      in `tfds-nightly`
    - the dataset name is spelled correctly
    - dataset class defines all base class abstract methods
    - the module defining the dataset class is imported

The builder directory /home/yeping/tensorflow_datasets/berkeley_autolab_ur5 doesn't contain any versions.
No builder could be found in the directory: /home/yeping/tensorflow_datasets for the builder: berkeley_autolab_ur5.
No registered data_dirs were found in:
	- /home/yeping/tensorflow_datasets

@yepw
Copy link
Author

yepw commented Apr 10, 2024

After updating Tensorflow, the error was fixed, but I encountered another error: #5360

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

2 participants