Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Final feature validation #16

Open
codaich opened this issue Oct 5, 2016 · 1 comment
Open

Final feature validation #16

codaich opened this issue Oct 5, 2016 · 1 comment
Assignees

Comments

@codaich
Copy link
Collaborator

codaich commented Oct 5, 2016

  • Test on SLAC, Bodhidharma MIDI, MIDI_Malcolm and MEI test sets.
    • Do this for MEI and MIDI (and mixed) inputs.
    • Do this for ACE XML, ARFF and CSV outputs.
    • Do for all features as well as only for 1-D features.
    • Do this windowed and not windowed extraction.
  • Verify that all features in manual are being extracted (including the two MEI ones) once and only once.
    • Verify that there are the correct number of total features are being extracted.
    • Verify that features are being saved in the correct order.
    • Verify that feature values are actually being saved under correct feature labels.
  • Check feature values for general mathematical reasonableness
    • Verify that not getting feature values of NaN, infinity, null or -# (unless there is no better default alternative).
    • Verify that there is reasonable variance in the values of each feature.
    • Check for massive outliers.
    • Check instances with a Range value of 0 (could be OK if only contains unpitched instruments or no notes, but make sure).
    • Check a unpitched percussion-only track to make sure that it isn't getting any false pitches (e.g. MIDI_SLAC\Rap - Pop Rap\Run DMC - Sucka MCs.mid).
  • Verify that features are being extracted from all input files.
    • Check for error messages thrown by jSymbolic.
    • Check feature files have correct number of instances (i.e. no missed exceptions).
  • Verify that feature values are musicologically correct.
    • Make sure manual descriptions were correctly interpreted
    • Compare to old jSymbolic1 feature results to new jSymbolic2 values
    • Will need to hand cacluculate feature values from custom MIDI amd MEI files in order to verify them all
@codaich codaich self-assigned this Oct 5, 2016
@codaich
Copy link
Collaborator Author

codaich commented Oct 20, 2016

Also run unit tests.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant