Skip to content

Latest commit

 

History

History
 
 

CTC-TIMIT

Folders and files

NameName
Last commit message
Last commit date

parent directory

..
 
 
 
 
 
 
 
 

LSTM + CTC on TIMIT speech recognition dataset

Install Dependencies:

  • python binding for lmdb
    • pip install --user lmdb
  • bob.ap package for MFCC extraction
    • install blitz and openblas as dependencies of bob.ap
    • pip install --user bob.extension bob.blitz bob.core bob.sp bob.ap

Prepare Data:

We assume the following file structure:

TRAIN/
  DR1/
    FCJF0/
      *.WAV     # NIST WAV file
      *.TXT
      *.PHN
  ...

Convert NIST wav format to RIFF wav format:

cd /PATH/TO/TIMIT
find -name '*.WAV' | parallel -P20 sox {} '{.}.wav'

Extract MFCC features and phoneme labels, and save everything to LMDB database. The preprocessing follows the setup in

  • Connectionist Temporal Classification: Labelling Unsegmented Sequence Data with RNN - Alex Graves
./create-lmdb.py build --dataset /PATH/TO/TIMIT/TRAIN --db train.mdb
./create-lmdb.py build --dataset /PATH/TO/TIMIT/TEST --db test.mdb

Compute mean/std of the training set (and save to stats.data by default):

./create-lmdb.py stat --db train.mdb

Train:

./train-timit.py --train train.mdb --test test.mdb --stat stats.data

Results:

Get 0.28 LER (normalized edit distance) after about 40 epochs.