Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Problem facing while extracting i3d feature for each individual video in Phoenix14T dataset #15

Open
rabeya-akter opened this issue Oct 14, 2023 · 1 comment

Comments

@rabeya-akter
Copy link

I am trying to extract I3D features for Phoenix14T dataset. I have downloaded the dataset and also ran this code to make the videos:
python misc/phoenix2014/gather_frames.py

Now, for extracting I3D features for the videos I ran this command in the command line:
python main.py --featurize_mode 1 --num-classes 1233 --include_embds 1 --datasetname phoenix2014 --checkpoint checkpoint/phoenix2014t_i3d_pbsl1k --pretrained checkpoint/phoenix2014/T_c1233_ctc_blank/checkpoint_006.pth.tar --test_set test --evaluate_video 1 --word_data_pkl misc/bsl1k/bsl1k_vocab.pkl --phoenix_path data/PHOENIX-2014-T-release-v3/PHOENIX-2014-T --num_in_frames 16 --feature_dim 1024 --inp_res 224 --resize_res 256 --workers 0 --save_features 1

As instructed --include_embs 1 is set, so features can be saved. A file named features.mat is created in the folder:
bsl1k-master/checkpoint/phoenix2014/T_c1233_ctc_blank/test_006/features.mat

and the features.mat has this keys:
dict_keys(['header', 'version', 'globals', 'preds', 'clip_gt', 'clip_ix', 'video_names'])

when I checked the preds, I found a shape of:
features['preds'].shape
-(7723, 1024)

But I want I3D feature for each individual videos in the train, test and val in the shape of (Frame Size, 1024). What should I change? Please guide me.

@Safaeid48
Copy link

facing the same issue

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants