Skip to content

Commit

Permalink
PR 2: Implement schema and WER (#48)
Browse files Browse the repository at this point in the history 
* Squashed commit of the following:

commit 16a9aa88959f8af797346b8c95874d2a833e9e33
Merge: 597ac86 05211d0
Author: MikeSmithEU <[email protected]>
Date:   Tue Mar 12 11:48:59 2019 +0100

    Merge branch 'conferatur'

commit 05211d0246c713a184e6371387911dfa7f657dea
Merge: 35ed7c4 b168c9c
Author: MikeSmithEU <[email protected]>
Date:   Tue Mar 12 11:46:12 2019 +0100

    Merge remote-tracking branch 'ebu/master' into conferatur

commit 597ac86d5cff85bdbfc6ea3b31a224eefbc0fc62
Author: MikeSmithEU <[email protected]>
Date:   Tue Mar 12 11:14:59 2019 +0100

    update version

commit b2c335003fe8bf3d2b8c529890b882d977fe94e5
Author: MikeSmithEU <[email protected]>
Date:   Mon Mar 4 13:06:54 2019 +0100

    Added note that no contact has yet been decided.

commit de2033a3c27c44ee707497c426242292512e1d7d
Author: EyalLavi <[email protected]>
Date:   Mon Mar 4 13:05:02 2019 +0100

    Update docs/CONTRIBUTING.rst

    Co-Authored-By: MikeSmithEU <[email protected]>

commit 01cec370d9496bfac8452e994234f0c8617b1a6e
Author: MikeSmithEU <[email protected]>
Date:   Mon Mar 4 12:50:04 2019 +0100

    implement feedback from @danpope-bbc

commit 8707454331dfda257322ff2cc1efb3520d97aa08
Author: MikeSmithEU <[email protected]>
Date:   Fri Feb 22 17:10:12 2019 +0100

    Clarify status of JSON-RPC api explorer #35

commit 3e709b4561d815b9016f3bba1788891e4c03545b
Author: MikeSmithEU <[email protected]>
Date:   Fri Feb 22 11:04:44 2019 +0100

    add license badge

commit 6c06fce160bdf39a497b8b9cc7d2c6e3bbb3d90d
Author: MikeSmithEU <[email protected]>
Date:   Fri Feb 22 11:00:20 2019 +0100

    add MIT licence #18

commit e1368ff16a48a9248cdbf52299be46ec21f29dae
Author: MikeSmithEU <[email protected]>
Date:   Thu Feb 14 18:27:04 2019 +0100

    Improve styling of the logs in API explorer

commit 379d28a5c3b7014fd1190b8c2cd7a6d7f54b730a
Author: MikeSmithEU <[email protected]>
Date:   Tue Feb 12 18:55:03 2019 +0100

    Actually lets use Word instead of Lexeme (lexeme may be later used for language analysis classe), Word still bothers me a bit, but using Part or Token or Item isn't much better, really... Can be easily refactored once we decide on proper terminology

commit 4fb519f2b731a84e803db1fa0a863a03c4bdbe51
Author: MikeSmithEU <[email protected]>
Date:   Tue Feb 12 14:22:52 2019 +0100

    use proper vocab: Item -> Lexeme

commit 4b03dee4cb6fefb14a3836ace1f978c9d5343ec2
Author: MikeSmithEU <[email protected]>
Date:   Mon Feb 11 01:42:57 2019 +0100

    pad diffs

commit 950e404897b1251ee5e9356602d742a07e48a39b
Author: MikeSmithEU <[email protected]>
Date:   Mon Feb 11 01:33:53 2019 +0100

    fix logging expectation test

commit de19c6bb8ec4d8a51f14342f7dca973d2a1e5a45
Author: MikeSmithEU <[email protected]>
Date:   Mon Feb 11 01:29:36 2019 +0100

    Update docs

commit 3d46404e707225b920409bd39005949fbcb408f6
Author: MikeSmithEU <[email protected]>
Date:   Mon Feb 11 01:26:47 2019 +0100

    no more hacking of differ settings for logs, do it cleaner with custom handler and formatter

commit c04a97139bd88ce9ca133da55e77724bd9fd1de3
Author: MikeSmithEU <[email protected]>
Date:   Sun Feb 10 23:59:38 2019 +0100

    Postpone initialization of logger so root logger has time to setup

commit e2a96d5d13caf02896c81a808721aa06b6379270
Author: MikeSmithEU <[email protected]>
Date:   Sun Feb 10 23:19:16 2019 +0100

    correct indent

commit 2813eedd2b1e6d0f2b617f01aaad5a0c556e3e69
Author: MikeSmithEU <[email protected]>
Date:   Sun Feb 10 23:17:39 2019 +0100

    fix logging of normalizers in api call if global loglevel < notice

commit 8f9c732b9eff5e451fef372fcadbb6c740fbb320
Author: MikeSmithEU <[email protected]>
Date:   Sun Feb 10 20:34:08 2019 +0100

    add support for showing the normalizer logs through api

commit 5edacd2ec6ccb3aa3deb85bbdf2b4e9a014ee5fa
Author: MikeSmithEU <[email protected]>
Date:   Sun Feb 10 19:08:04 2019 +0100

    add logging to normalizers

commit ae3af937ae1afe1833d3c49e2635f10219556bb4
Author: MikeSmithEU <[email protected]>
Date:   Sat Feb 9 22:41:06 2019 +0100

    test conferatur branch

commit ca674d89a6ac9c999e8930ca810c4977ac57eb32
Author: MikeSmithEU <[email protected]>
Date:   Sun Feb 10 14:45:45 2019 +0100

    update docs

commit b8759c8e86047270dbf792c1a2184045ad3e8b0a
Author: MikeSmithEU <[email protected]>
Date:   Sun Feb 10 14:23:03 2019 +0100

    Add basic tokenization and input formats

commit ce726850adc096b5f68192dd5718d15e91916aef
Author: MikeSmithEU <[email protected]>
Date:   Sun Feb 10 13:20:39 2019 +0100

    make api deps part of main package

commit 69d1d067e81457fb26ef2837ad1482484ac977c0
Author: MikeSmithEU <[email protected]>
Date:   Sun Feb 10 13:17:30 2019 +0100

    fix test for python 3.5 (order of dicts don't matter but are somewhat consistent if using json.dumps)

commit 01ea913f21de86ee89772cbfff9a9409e6ec8c18
Author: MikeSmithEU <[email protected]>
Date:   Sun Feb 10 13:11:19 2019 +0100

    fix equality of schema

commit 7e0873690e53d4a5812efcc3f3dcedf04b1d9490
Author: MikeSmithEU <[email protected]>
Date:   Sat Feb 9 22:38:17 2019 +0100

    travis: test conferatur branch

commit 6c4fd1e404003c5e1e28614985e8deadb84bb517
Author: MikeSmithEU <[email protected]>
Date:   Sat Feb 9 22:20:38 2019 +0100

    Initial schema classes

commit f4e6b744af9116186ec82dcdf0da028efac618a9
Author: MikeSmithEU <[email protected]>
Date:   Sat Feb 9 15:49:35 2019 +0100

    be consistent with :example return vs result

commit a93e83085322559d6977bc62ffc656e74a7f7c60
Author: MikeSmithEU <[email protected]>
Date:   Sat Feb 9 15:37:22 2019 +0100

    Improve csv parser indication of wrong syntax locations, improve errors shown in jsonrpc api explorer, add documentation

commit d64e8f1312bf30c7e7d82b33cab245586286ff45
Author: MikeSmithEU <[email protected]>
Date:   Fri Feb 8 17:41:39 2019 +0100

    Add decent debug mode (probably should've done this before debugging myself :p )

commit 22a9e020e7c0063bd2c47cbd15d2ac4f476f561f
Author: MikeSmithEU <[email protected]>
Date:   Fri Feb 8 12:34:01 2019 +0100

    Add complete python package documentation with autodoc

commit e28fe366749f1dedb1f4650af4f92c107b06a3e4
Author: MikeSmithEU <[email protected]>
Date:   Fri Feb 8 11:25:24 2019 +0100

    fix test_core

commit 175ef9da0b69cfa6ff8d313125e4e9c041a653ff
Author: MikeSmithEU <[email protected]>
Date:   Fri Feb 8 11:23:39 2019 +0100

    Don't add NormalizationComposite to the core namespace

commit 76d4603002f8fa43fd2a1be2a974ac28d04e2e93
Author: MikeSmithEU <[email protected]>
Date:   Fri Feb 8 11:18:43 2019 +0100

    Small cleanup: move Composite normalizer outside core, removes the need for an ignored_normalizers...

commit 1ea76966e2ed5774a325b0fa9a0e2a1d14fa3764
Author: MikeSmithEU <[email protected]>
Date:   Fri Feb 8 10:53:15 2019 +0100

    Change to US spelling  #12

commit 75c7b26ee850d8c58ddffa2b41a149f996a447ab
Author: MikeSmithEU <[email protected]>
Date:   Thu Feb 7 14:09:29 2019 +0100

    not really necessary it turns out as long as it is text highlighting

commit a3851eb2590f11878b0902f7f9713fcc99301549
Author: MikeSmithEU <[email protected]>
Date:   Thu Feb 7 14:07:15 2019 +0100

    add Pygments as dependency for source code highlighting

commit 2d6b2376a6a187dd0db6f3b550ea9273c425489a
Author: MikeSmithEU <[email protected]>
Date:   Thu Feb 7 14:04:27 2019 +0100

    use text lexer for config highlight

commit 5bae2b021b3cc3b6001f40ab57e0dcbdf41f0c41
Author: MikeSmithEU <[email protected]>
Date:   Thu Feb 7 14:01:47 2019 +0100

    proper quote args

commit 9d3e9998b0cdad99a6fc3df459c720b1d0469c3e
Author: MikeSmithEU <[email protected]>
Date:   Thu Feb 7 13:54:24 2019 +0100

    updated documentation

commit 744352e5bf0605473c0084df0233ca9c375fda13
Author: MikeSmithEU <[email protected]>
Date:   Thu Feb 7 13:47:36 2019 +0100

    all normalisers an example

commit a6c6a9203893181808677343189c6aeaebeec6d5
Author: MikeSmithEU <[email protected]>
Date:   Thu Feb 7 13:32:41 2019 +0100

    custom doctest in sphinx no longer needed

commit 02eae5a6ad6d297a3220dd67add896e2f3953204
Author: MikeSmithEU <[email protected]>
Date:   Thu Feb 7 13:21:47 2019 +0100

    Fix removing of old resources of gh-pages

commit 2de5f15b5a3114d675c9c5a0d8d866bc7ed86605
Author: MikeSmithEU <[email protected]>
Date:   Thu Feb 7 13:16:40 2019 +0100

    only print rst body, take care of base formatting ourselves

commit a1035dbf7a2c402feb319c9b3e5e3658dd8498f4
Author: MikeSmithEU <[email protected]>
Date:   Thu Feb 7 12:33:44 2019 +0100

    highlight example config as bash (close enough)

commit db903363fe23273cae81ff728f09f1d99d83a927
Author: MikeSmithEU <[email protected]>
Date:   Thu Feb 7 12:20:20 2019 +0100

    Remove 'normalisation' global api method (just use config), format documentation in explorer, add dependency to docutils to api, allow multiple examples in docstring

commit 424812b3f4a8a7bf7072d7fac9df7d13693385ec
Author: MikeSmithEU <[email protected]>
Date:   Thu Feb 7 01:10:13 2019 +0100

    updated api-method docs

commit f552f67b75b7fe71d9b1ea1c203811d8f9874924
Author: MikeSmithEU <[email protected]>
Date:   Thu Feb 7 01:06:20 2019 +0100

    add log_call decorator, improve api-explorer styling, fix docblock regexes

commit 169474a1d6d5369a65e2d3f04cc55bdf20e20604
Author: MikeSmithEU <[email protected]>
Date:   Thu Feb 7 00:17:43 2019 +0100

    Oops, forgot to actually commit the fix, only commited the updated test :p

commit 6334b38bfce694acdc38938b3f82a326d8572285
Author: MikeSmithEU <[email protected]>
Date:   Thu Feb 7 00:07:39 2019 +0100

    And hopefully final bug in csv parser fixed

commit c2ae2d639a6165c3bb1284121d9691299c68e6e2
Author: MikeSmithEU <[email protected]>
Date:   Wed Feb 6 23:47:10 2019 +0100

    Fix csv bug and add test for whitespace dialect parser 'test   '

commit b401e1188f041694515d576342f4ee893de75dc2
Author: MikeSmithEU <[email protected]>
Date:   Wed Feb 6 16:43:09 2019 +0100

    proper include examples in jsonrpc explorer, styling fixes, add status label to response

commit ccf4c55997dc148dcf3415c5044a69fc48616df2
Author: MikeSmithEU <[email protected]>
Date:   Wed Feb 6 15:08:44 2019 +0100

    Support for examples, support custom tags in docblock

commit e869744d1d51bda732a8c4d54e6aed00edd10729
Author: MikeSmithEU <[email protected]>
Date:   Wed Feb 6 14:51:45 2019 +0100

    Change port to 8080 in Dockerfile

commit 786dae0cd78486935826c7bd8def58a4f87a538b
Author: MikeSmithEU <[email protected]>
Date:   Wed Feb 6 13:14:30 2019 +0100

    include templates in package distribution

commit 47589ec425e2132a2b41521579f457347290ea37
Author: MikeSmithEU <[email protected]>
Date:   Wed Feb 6 12:57:47 2019 +0100

    no chmod needed, start_gunicorn.sh no longer exists

commit 3dc3f33b8e2f2ec625e0089da3f24dddd1617f58
Author: MikeSmithEU <[email protected]>
Date:   Wed Feb 6 12:48:45 2019 +0100

    add jsonrpc api explorer by default to gunicorn

commit 44eafb9b8cd5522b3eb6240e7628756cbc1a2189
Author: MikeSmithEU <[email protected]>
Date:   Wed Feb 6 12:27:15 2019 +0100

    only allow files from cwd to be used in api

commit e6551a142b8630b4b9adea64dad3e00d00af8c55
Author: MikeSmithEU <[email protected]>
Date:   Tue Feb 5 18:00:32 2019 +0100

    working api explorer

commit 8fbca49543eb60f9c630db83cd60b0b54de820e4
Author: MikeSmithEU <[email protected]>
Date:   Tue Feb 5 16:42:23 2019 +0100

    execute jsonrpc call

commit 88848f2e0b5e4f9f89a6edbca6ea96a0f9b62ce2
Author: MikeSmithEU <[email protected]>
Date:   Tue Feb 5 04:08:52 2019 +0100

    update docs for normalisers api call

commit 4e4e21b4342c7425ca096ad00e470cc0d226c41e
Author: MikeSmithEU <[email protected]>
Date:   Tue Feb 5 04:06:11 2019 +0100

    add param comment to new signature

commit 0a142b18e9f93f6939d25ac3915fc25ceab8da20
Author: MikeSmithEU <[email protected]>
Date:   Tue Feb 5 03:59:43 2019 +0100

    The hard work for the frontend jsonrpc explorer done!

commit 2d602f4f48bdddc633706de63da9ea642841f799
Author: MikeSmithEU <[email protected]>
Date:   Mon Feb 4 22:45:48 2019 +0100

    preparation for jsonrpc explorer

commit 866832487552052f44148aca9355ec416040ea5b
Author: MikeSmithEU <[email protected]>
Date:   Mon Feb 4 17:13:15 2019 +0100

    allow fail on osx and 3.8-dev

commit 35ed7c4e5471bbd2edd39539cdfd793bae71289c
Author: MikeSmithEU <[email protected]>
Date:   Mon Mar 4 13:06:54 2019 +0100

    Added note that no contact has yet been decided.

commit fc6dc2f47226f213936c3f9665af72b4fed20e54
Author: EyalLavi <[email protected]>
Date:   Mon Mar 4 13:05:02 2019 +0100

    Update docs/CONTRIBUTING.rst

    Co-Authored-By: MikeSmithEU <[email protected]>

commit 3a2e08274ed1ce1279df924b22658081c445c967
Author: MikeSmithEU <[email protected]>
Date:   Mon Mar 4 12:50:04 2019 +0100

    implement feedback from @danpope-bbc

commit 7877a1f8d165b0abbeb15def1bcab26b387c2671
Author: MikeSmithEU <[email protected]>
Date:   Fri Feb 22 17:10:12 2019 +0100

    Clarify status of JSON-RPC api explorer #35

commit e74703af523b662a42c734d81fca3395c1d1e2cd
Author: MikeSmithEU <[email protected]>
Date:   Fri Feb 22 11:04:44 2019 +0100

    add license badge

commit bbdb0b9fe1103ecda2511a69da6e52edae0e01e0
Author: MikeSmithEU <[email protected]>
Date:   Fri Feb 22 11:00:20 2019 +0100

    add MIT licence #18

commit 6e842189c50d4b800a7511726d0c07c5b362bfdf
Author: MikeSmithEU <[email protected]>
Date:   Thu Feb 14 18:27:04 2019 +0100

    Improve styling of the logs in API explorer

commit 0f51ea2f35181cc6b01623b971bf3aace82eb1b7
Author: MikeSmithEU <[email protected]>
Date:   Mon Feb 11 01:42:57 2019 +0100

    pad diffs

commit 1f01efbf4068de560fc51b6873051966d089836a
Author: MikeSmithEU <[email protected]>
Date:   Mon Feb 11 01:33:53 2019 +0100

    fix logging expectation test

commit 73a42f1972d985d3496762fbc92531471a1d8ba4
Author: MikeSmithEU <[email protected]>
Date:   Mon Feb 11 01:26:47 2019 +0100

    no more hacking of differ settings for logs, do it cleaner with custom handler and formatter

commit e7ddae9606b8d9466e649088188ea926dbb72d4f
Author: MikeSmithEU <[email protected]>
Date:   Sun Feb 10 23:59:38 2019 +0100

    Postpone initialization of logger so root logger has time to setup

commit f1ad92151d970bac165902f1e001c15815ffd736
Author: MikeSmithEU <[email protected]>
Date:   Sun Feb 10 23:17:39 2019 +0100

    fix logging of normalizers in api call if global loglevel < notice

commit 8f4ba8689f3b3078d18a704cba86d6a77d858790
Author: MikeSmithEU <[email protected]>
Date:   Sun Feb 10 20:34:08 2019 +0100

    add support for showing the normalizer logs through api

commit 524ffac704304162f05d83fa9f59b42a5d0245c8
Author: MikeSmithEU <[email protected]>
Date:   Sun Feb 10 19:08:04 2019 +0100

    add logging to normalizers

commit d088d1b481b3033f12df12865460c63fa1e0e57f
Author: MikeSmithEU <[email protected]>
Date:   Sat Feb 9 22:41:06 2019 +0100

    test conferatur branch

commit 0bd792d45acf0a26982dfec056d8f024c39ce795
Author: MikeSmithEU <[email protected]>
Date:   Sat Feb 9 22:38:17 2019 +0100

    travis: test conferatur branch

commit 0fe05a3e24c80d8fd01a56cbfd4827585e9aea40
Author: MikeSmithEU <[email protected]>
Date:   Sat Feb 9 15:49:35 2019 +0100

    be consistent with :example return vs result

commit ccc71dba53e18379e4eda40e029bbd14757efbeb
Author: MikeSmithEU <[email protected]>
Date:   Sat Feb 9 15:37:22 2019 +0100

    Improve csv parser indication of wrong syntax locations, improve errors shown in jsonrpc api explorer, add documentation

commit b7220b7bd96f6410f4eaf07caa51106c0537532d
Author: MikeSmithEU <[email protected]>
Date:   Fri Feb 8 17:41:39 2019 +0100

    Add decent debug mode (probably should've done this before debugging myself :p )

commit ae9eb921ffe3c1dabff01802659695b9dc9faa92
Author: MikeSmithEU <[email protected]>
Date:   Fri Feb 8 12:34:01 2019 +0100

    Add complete python package documentation with autodoc

commit 139c495f8fe3426317b8ead1820f7b6c04bef089
Author: MikeSmithEU <[email protected]>
Date:   Fri Feb 8 11:25:24 2019 +0100

    fix test_core

commit bf2472ace7a34ede63d36b66ae25481d80343916
Author: MikeSmithEU <[email protected]>
Date:   Fri Feb 8 11:23:39 2019 +0100

    Don't add NormalizationComposite to the core namespace

commit f95c5a172f0b56e53c91449c9f64f8871632b19c
Author: MikeSmithEU <[email protected]>
Date:   Fri Feb 8 11:18:43 2019 +0100

    Small cleanup: move Composite normalizer outside core, removes the need for an ignored_normalizers...

commit 028b43d0189e58bad060a5ad8df43c3150983e05
Author: MikeSmithEU <[email protected]>
Date:   Fri Feb 8 10:53:15 2019 +0100

    Change to US spelling  #12

commit 0c6bdaa60f0a0a017570a2d5bd6dfe22a27133af
Author: MikeSmithEU <[email protected]>
Date:   Thu Feb 7 14:09:29 2019 +0100

    not really necessary it turns out as long as it is text highlighting

commit fe64d3b740dedfa493edb1b1983a879238a51997
Author: MikeSmithEU <[email protected]>
Date:   Thu Feb 7 14:07:15 2019 +0100

    add Pygments as dependency for source code highlighting

commit 2cc3e090707e39b958216d4bf4c47c38cab50a21
Author: MikeSmithEU <[email protected]>
Date:   Thu Feb 7 14:04:27 2019 +0100

    use text lexer for config highlight

commit 1236566f11bbab344c175d815bbf3f2370a8009e
Author: MikeSmithEU <[email protected]>
Date:   Thu Feb 7 14:01:47 2019 +0100

    proper quote args

commit ec91697767c7455b904089a355a0e9d7a3f3d2cb
Author: MikeSmithEU <[email protected]>
Date:   Thu Feb 7 13:54:24 2019 +0100

    updated documentation

commit 4ae15c37eecedd0c8d172be72622233e9c16dde5
Author: MikeSmithEU <[email protected]>
Date:   Thu Feb 7 13:47:36 2019 +0100

    all normalisers an example

commit 581407a50e74c6e0c9ff7c4fad0a4c8bfff8f999
Author: MikeSmithEU <[email protected]>
Date:   Thu Feb 7 13:32:41 2019 +0100

    custom doctest in sphinx no longer needed

commit c694e16d59c3a1550f443845a212e425a9982c76
Author: MikeSmithEU <[email protected]>
Date:   Thu Feb 7 13:21:47 2019 +0100

    Fix removing of old resources of gh-pages

commit 0e6ed8b67c606d0f60cf56ca829eb89f6bb08a4f
Author: MikeSmithEU <[email protected]>
Date:   Thu Feb 7 13:16:40 2019 +0100

    only print rst body, take care of base formatting ourselves

commit 3a9e4efcd9e8affca16f3d75146218a16a35b1f7
Author: MikeSmithEU <[email protected]>
Date:   Thu Feb 7 12:33:44 2019 +0100

    highlight example config as bash (close enough)

commit 74e6f66f0c4a9384b2ef5bf6f15e0101d06c81af
Author: MikeSmithEU <[email protected]>
Date:   Thu Feb 7 12:20:20 2019 +0100

    Remove 'normalisation' global api method (just use config), format documentation in explorer, add dependency to docutils to api, allow multiple examples in docstring

commit 5ae679a53b2edd6523f8cdd0dd89c2efd050a7c4
Author: MikeSmithEU <[email protected]>
Date:   Thu Feb 7 01:10:13 2019 +0100

    updated api-method docs

commit 7b199500ec760eaad4a5fedc909ff130c8b64481
Merge: 74d51fc 4a23809
Author: MikeSmithEU <[email protected]>
Date:   Thu Feb 7 01:09:55 2019 +0100

    Merge branch 'conferatur'

commit 4a238095939726f00a29bec68cd39024a782a892
Author: MikeSmithEU <[email protected]>
Date:   Thu Feb 7 01:07:27 2019 +0100

    Various fixes and slight improvements, also added some more examples to api explorer

    Squashed commit of the following:

    commit 74d51fccd4a40e94419fc3c190c315d0631b1c74
    Author: MikeSmithEU <[email protected]>
    Date:   Thu Feb 7 01:06:20 2019 +0100

        add log_call decorator, improve api-explorer styling, fix docblock regexes

    commit 53983e5df8bf66359851f9dc3423a93acb8bee11
    Author: MikeSmithEU <[email protected]>
    Date:   Thu Feb 7 00:17:43 2019 +0100

        Oops, forgot to actually commit the fix, only commited the updated test :p

    commit 64704afb4dee40c339824b188984dcb10fe08cfd
    Author: MikeSmithEU <[email protected]>
    Date:   Thu Feb 7 00:07:39 2019 +0100

        And hopefully final bug in csv parser fixed

    commit 338598184239dbc3bf26f8b4d80d6b9c9be30cc0
    Author: MikeSmithEU <[email protected]>
    Date:   Wed Feb 6 23:47:10 2019 +0100

        Fix csv bug and add test for whitespace dialect parser 'test   '

commit 74d51fccd4a40e94419fc3c190c315d0631b1c74
Author: MikeSmithEU <[email protected]>
Date:   Thu Feb 7 01:06:20 2019 +0100

    add log_call decorator, improve api-explorer styling, fix docblock regexes

commit 53983e5df8bf66359851f9dc3423a93acb8bee11
Author: MikeSmithEU <[email protected]>
Date:   Thu Feb 7 00:17:43 2019 +0100

    Oops, forgot to actually commit the fix, only commited the updated test :p

commit 64704afb4dee40c339824b188984dcb10fe08cfd
Author: MikeSmithEU <[email protected]>
Date:   Thu Feb 7 00:07:39 2019 +0100

    And hopefully final bug in csv parser fixed

commit 338598184239dbc3bf26f8b4d80d6b9c9be30cc0
Author: MikeSmithEU <[email protected]>
Date:   Wed Feb 6 23:47:10 2019 +0100

    Fix csv bug and add test for whitespace dialect parser 'test   '

commit 77d2abec3f60250f66ba7ea04017f436fe7e5cad
Author: MikeSmithEU <[email protected]>
Date:   Wed Feb 6 16:43:09 2019 +0100

    proper include examples in jsonrpc explorer, styling fixes, add status label to response

commit dddee06c350e09bdfaa4cdc0b0b25c562803703d
Author: MikeSmithEU <[email protected]>
Date:   Wed Feb 6 15:08:44 2019 +0100

    Support for examples, support custom tags in docblock

commit eda28ee138484d1b9cfe3f9781e49831748bc1be
Author: MikeSmithEU <[email protected]>
Date:   Wed Feb 6 14:51:45 2019 +0100

    Change port to 8080 in Dockerfile

commit 91f518549b270e6cf1f52ee3647af231a8b0deb2
Author: MikeSmithEU <[email protected]>
Date:   Wed Feb 6 13:14:30 2019 +0100

    include templates in package distribution

commit 89c63a053dcd737722cdfc0bd807ffd64b532e84
Author: MikeSmithEU <[email protected]>
Date:   Wed Feb 6 12:57:47 2019 +0100

    no chmod needed, start_gunicorn.sh no longer exists

commit 0251a097eaa415ae99febe0a36934b48ade54518
Author: MikeSmithEU <[email protected]>
Date:   Wed Feb 6 12:48:45 2019 +0100

    add jsonrpc api explorer by default to gunicorn

commit bbda35a632a780c1a43f63e5fdda75a1c1956d2b
Author: MikeSmithEU <[email protected]>
Date:   Wed Feb 6 12:27:15 2019 +0100

    only allow files from cwd to be used in api

commit 245d4284d6b01198fd4fbaa70e8990e17b8fa9c2
Author: MikeSmithEU <[email protected]>
Date:   Tue Feb 5 18:00:32 2019 +0100

    working api explorer

commit 64859ec5cc69576ee7b91eb5110ac1ca7bf7821c
Author: MikeSmithEU <[email protected]>
Date:   Tue Feb 5 16:42:23 2019 +0100

    execute jsonrpc call

commit 1e6e096ae44dedaae29f3f9a1c8652d9c8a3b627
Author: MikeSmithEU <[email protected]>
Date:   Tue Feb 5 04:08:52 2019 +0100

    update docs for normalisers api call

commit cee39640f6069787bd690d94bf45e1cab4d86d39
Author: MikeSmithEU <[email protected]>
Date:   Tue Feb 5 04:06:11 2019 +0100

    add param comment to new signature

commit f62ac1b773c13af298aa0e88935f0f807f0cd09f
Merge: fceb6c8 5a1c31f
Author: MikeSmithEU <[email protected]>
Date:   Tue Feb 5 04:00:34 2019 +0100

    Merge branch 'master' into conferatur

commit 5a1c31f4a6443173b53b473c0d6269bf7c0ad3f5
Author: MikeSmithEU <[email protected]>
Date:   Tue Feb 5 03:59:43 2019 +0100

    The hard work for the frontend jsonrpc explorer done!

commit e0a0e60024d7df03b5ab6bb6a5ee3e10c832072b
Author: MikeSmithEU <[email protected]>
Date:   Mon Feb 4 22:45:48 2019 +0100

    preparation for jsonrpc explorer

commit fceb6c85d811a21956f1d654eefa646abab952b2
Author: MikeSmithEU <[email protected]>
Date:   Mon Feb 4 17:22:05 2019 +0100

    Squashed commit of the following:

    commit e14c7d845bd3819ea7609bf4a8ecce9d6b4ece1f
    Author: MikeSmithEU <[email protected]>
    Date:   Mon Feb 4 17:19:32 2019 +0100

        TravisCI conf

    commit 5b85a7781588030c804ea175a44302d51b289efb
    Author: MikeSmithEU <[email protected]>
    Date:   Mon Feb 4 17:16:49 2019 +0100

        TravisCI: 3.7 on xenial

    commit 3e3a691bfbe33c3cc7d5af5c1d2bc20b86167572
    Author: MikeSmithEU <[email protected]>
    Date:   Mon Feb 4 17:13:15 2019 +0100

        allow fail on osx and 3.8-dev

commit e14c7d845bd3819ea7609bf4a8ecce9d6b4ece1f
Author: MikeSmithEU <[email protected]>
Date:   Mon Feb 4 17:19:32 2019 +0100

    TravisCI conf

commit 5b85a7781588030c804ea175a44302d51b289efb
Author: MikeSmithEU <[email protected]>
Date:   Mon Feb 4 17:16:49 2019 +0100

    TravisCI: 3.7 on xenial

commit 3e3a691bfbe33c3cc7d5af5c1d2bc20b86167572
Author: MikeSmithEU <[email protected]>
Date:   Mon Feb 4 17:13:15 2019 +0100

    allow fail on osx and 3.8-dev

commit b1c44541474642e8b765589af3efa1813f84250a
Author: MikeSmithEU <[email protected]>
Date:   Mon Feb 4 16:50:12 2019 +0100

    Also CI on windows (experimental travis feature, so allow_fail)

commit c7a7ca02dbd396b5a0592027774ff3bd6c43ce8d
Author: MikeSmithEU <[email protected]>
Date:   Mon Feb 4 16:38:52 2019 +0100

    Add travis-ci status image

commit f3e0058206d5188e4c6c44aebf32d7c470506f07
Author: MikeSmithEU <[email protected]>
Date:   Mon Feb 4 16:31:46 2019 +0100

    3.7 only avalabled as -dev in travis

commit 2b391029ab145750d8620330f15c0fac36ca009b
Author: MikeSmithEU <[email protected]>
Date:   Mon Feb 4 16:17:09 2019 +0100

    add travis-ci conf

commit 56d1f362d470eeff7849bd4ec5af70238c02d1d8
Author: MikeSmithEU <[email protected]>
Date:   Mon Feb 4 16:10:44 2019 +0100

    add support for tox

commit 05b182344b11f3a4d8ac45619f2335bac2910e8a
Author: MikeSmithEU <[email protected]>
Date:   Mon Feb 4 13:56:49 2019 +0100

    oops, forgot to negate escape sequences for some regexes

commit 08bedf9ce58b1b2023f17b21d86d6f272c6dbf5d
Author: MikeSmithEU <[email protected]>
Date:   Mon Feb 4 13:54:01 2019 +0100

    Using iter generator: no need for StopIteration

commit 75545e5b70190fa755cf66d0052d406e4db60595
Author: MikeSmithEU <[email protected]>
Date:   Mon Feb 4 13:36:22 2019 +0100

    cleanup comments

commit 88323389823a4ba0ff2f385a0ee3ea6e36fee1f6
Author: MikeSmithEU <[email protected]>
Date:   Mon Feb 4 13:24:05 2019 +0100

    cleanup

commit 5a11ae40d4b64d37ebad243d8129ba488e9341b9
Author: MikeSmithEU <[email protected]>
Date:   Mon Feb 4 13:09:40 2019 +0100

    Add own csv parser that deals with comments correctly + tests, add configfile again (`file config` was broken), set proper python version reqs, update man and api docs

commit eb52274dccc0f6a0fbdce085ae2a5572d6c9b38a
Author: MikeSmithEU <[email protected]>
Date:   Sun Feb 3 21:19:00 2019 +0100

    start_unicorn.sh no longer needed

commit b3e936dc70c9bd63073bf036b17f23fe044f9e30
Author: MikeSmithEU <[email protected]>
Date:   Sun Feb 3 21:17:31 2019 +0100

    update docs, integrate all relevant current docs into sphinx

commit aa78db05760665c78caaaa6bf980b8593c4437d9
Author: MikeSmithEU <[email protected]>
Date:   Sun Feb 3 20:10:07 2019 +0100

    update manpage, dont write date to api-method.rst (dont want a change commited if nothing changed)

commit b8bd3c4cbf85e002c2b3c1d2a3fc690ac55f2dba
Author: MikeSmithEU <[email protected]>
Date:   Sun Feb 3 20:06:29 2019 +0100

    add api documentation, add more api methods, add normaliser api methods automagically, add an api help method, fix some docs

commit e0f915e73279fc8e716c75bee9a04d77e1f2ea02
Author: MikeSmithEU <[email protected]>
Date:   Sun Feb 3 15:48:55 2019 +0100

    Add Dockerfile, gunicorn, and document

commit 23a3d7f34e2ca1945f5f372ae539a26e31338817
Author: MikeSmithEU <[email protected]>
Date:   Sun Feb 3 01:25:42 2019 +0100

    gh-pages auto build and publish script

commit 710670b380f90021c5bc795dde6fe20d0371aa99
Author: MikeSmithEU <[email protected]>
Date:   Sun Feb 3 00:19:00 2019 +0100

    update gh-pages

commit 7b9a004d81957b74707a888b107cf494c8d8490c
Author: MikeSmithEU <[email protected]>
Date:   Sat Feb 2 23:20:57 2019 +0100

    Things done in this version:

    setup basic structure
    created some normalisers
    created sphinx docs
    created a command line tool
    created proper pip setup for easy installation
    created manpage for command line tool
    created jsonrpc api
    added bash completion for command line tool
    added testing via pytest

* use ordereddict

* avoid basename duplication for pytest

* tmp commit

* reformat code (max. line len 80)

* get_available -> get_modules_dict

* conferatur -> BenchmarkSTT

* conferatur -> BenchmarkSTT

* update manpage

* Squashed commit of the following:

commit 16a9aa88959f8af797346b8c95874d2a833e9e33
Merge: 597ac86 05211d0
Author: MikeSmithEU <[email protected]>
Date:   Tue Mar 12 11:48:59 2019 +0100

    Merge branch 'conferatur'

commit 05211d0246c713a184e6371387911dfa7f657dea
Merge: 35ed7c4 b168c9c
Author: MikeSmithEU <[email protected]>
Date:   Tue Mar 12 11:46:12 2019 +0100

    Merge remote-tracking branch 'ebu/master' into conferatur

commit 597ac86d5cff85bdbfc6ea3b31a224eefbc0fc62
Author: MikeSmithEU <[email protected]>
Date:   Tue Mar 12 11:14:59 2019 +0100

    update version

commit b2c335003fe8bf3d2b8c529890b882d977fe94e5
Author: MikeSmithEU <[email protected]>
Date:   Mon Mar 4 13:06:54 2019 +0100

    Added note that no contact has yet been decided.

commit de2033a3c27c44ee707497c426242292512e1d7d
Author: EyalLavi <[email protected]>
Date:   Mon Mar 4 13:05:02 2019 +0100

    Update docs/CONTRIBUTING.rst

    Co-Authored-By: MikeSmithEU <[email protected]>

commit 01cec370d9496bfac8452e994234f0c8617b1a6e
Author: MikeSmithEU <[email protected]>
Date:   Mon Mar 4 12:50:04 2019 +0100

    implement feedback from @danpope-bbc

commit 8707454331dfda257322ff2cc1efb3520d97aa08
Author: MikeSmithEU <[email protected]>
Date:   Fri Feb 22 17:10:12 2019 +0100

    Clarify status of JSON-RPC api explorer #35

commit 3e709b4561d815b9016f3bba1788891e4c03545b
Author: MikeSmithEU <[email protected]>
Date:   Fri Feb 22 11:04:44 2019 +0100

    add license badge

commit 6c06fce160bdf39a497b8b9cc7d2c6e3bbb3d90d
Author: MikeSmithEU <[email protected]>
Date:   Fri Feb 22 11:00:20 2019 +0100

    add MIT licence #18

commit e1368ff16a48a9248cdbf52299be46ec21f29dae
Author: MikeSmithEU <[email protected]>
Date:   Thu Feb 14 18:27:04 2019 +0100

    Improve styling of the logs in API explorer

commit 379d28a5c3b7014fd1190b8c2cd7a6d7f54b730a
Author: MikeSmithEU <[email protected]>
Date:   Tue Feb 12 18:55:03 2019 +0100

    Actually lets use Word instead of Lexeme (lexeme may be later used for language analysis classe), Word still bothers me a bit, but using Part or Token or Item isn't much better, really... Can be easily refactored once we decide on proper terminology

commit 4fb519f2b731a84e803db1fa0a863a03c4bdbe51
Author: MikeSmithEU <[email protected]>
Date:   Tue Feb 12 14:22:52 2019 +0100

    use proper vocab: Item -> Lexeme

commit 4b03dee4cb6fefb14a3836ace1f978c9d5343ec2
Author: MikeSmithEU <[email protected]>
Date:   Mon Feb 11 01:42:57 2019 +0100

    pad diffs

commit 950e404897b1251ee5e9356602d742a07e48a39b
Author: MikeSmithEU <[email protected]>
Date:   Mon Feb 11 01:33:53 2019 +0100

    fix logging expectation test

commit de19c6bb8ec4d8a51f14342f7dca973d2a1e5a45
Author: MikeSmithEU <[email protected]>
Date:   Mon Feb 11 01:29:36 2019 +0100

    Update docs

commit 3d46404e707225b920409bd39005949fbcb408f6
Author: MikeSmithEU <[email protected]>
Date:   Mon Feb 11 01:26:47 2019 +0100

    no more hacking of differ settings for logs, do it cleaner with custom handler and formatter

commit c04a97139bd88ce9ca133da55e77724bd9fd1de3
Author: MikeSmithEU <[email protected]>
Date:   Sun Feb 10 23:59:38 2019 +0100

    Postpone initialization of logger so root logger has time to setup

commit e2a96d5d13caf02896c81a808721aa06b6379270
Author: MikeSmithEU <[email protected]>
Date:   Sun Feb 10 23:19:16 2019 +0100

    correct indent

commit 2813eedd2b1e6d0f2b617f01aaad5a0c556e3e69
Author: MikeSmithEU <[email protected]>
Date:   Sun Feb 10 23:17:39 2019 +0100

    fix logging of normalizers in api call if global loglevel < notice

commit 8f9c732b9eff5e451fef372fcadbb6c740fbb320
Author: MikeSmithEU <[email protected]>
Date:   Sun Feb 10 20:34:08 2019 +0100

    add support for showing the normalizer logs through api

commit 5edacd2ec6ccb3aa3deb85bbdf2b4e9a014ee5fa
Author: MikeSmithEU <[email protected]>
Date:   Sun Feb 10 19:08:04 2019 +0100

    add logging to normalizers

commit ae3af937ae1afe1833d3c49e2635f10219556bb4
Author: MikeSmithEU <[email protected]>
Date:   Sat Feb 9 22:41:06 2019 +0100

    test conferatur branch

commit ca674d89a6ac9c999e8930ca810c4977ac57eb32
Author: MikeSmithEU <[email protected]>
Date:   Sun Feb 10 14:45:45 2019 +0100

    update docs

commit b8759c8e86047270dbf792c1a2184045ad3e8b0a
Author: MikeSmithEU <[email protected]>
Date:   Sun Feb 10 14:23:03 2019 +0100

    Add basic tokenization and input formats

commit ce726850adc096b5f68192dd5718d15e91916aef
Author: MikeSmithEU <[email protected]>
Date:   Sun Feb 10 13:20:39 2019 +0100

    make api deps part of main package

commit 69d1d067e81457fb26ef2837ad1482484ac977c0
Author: MikeSmithEU <[email protected]>
Date:   Sun Feb 10 13:17:30 2019 +0100

    fix test for python 3.5 (order of dicts don't matter but are somewhat consistent if using json.dumps)

commit 01ea913f21de86ee89772cbfff9a9409e6ec8c18
Author: MikeSmithEU <[email protected]>
Date:   Sun Feb 10 13:11:19 2019 +0100

    fix equality of schema

commit 7e0873690e53d4a5812efcc3f3dcedf04b1d9490
Author: MikeSmithEU <[email protected]>
Date:   Sat Feb 9 22:38:17 2019 +0100

    travis: test conferatur branch

commit 6c4fd1e404003c5e1e28614985e8deadb84bb517
Author: MikeSmithEU <[email protected]>
Date:   Sat Feb 9 22:20:38 2019 +0100

    Initial schema classes

commit f4e6b744af9116186ec82dcdf0da028efac618a9
Author: MikeSmithEU <[email protected]>
Date:   Sat Feb 9 15:49:35 2019 +0100

    be consistent with :example return vs result

commit a93e83085322559d6977bc62ffc656e74a7f7c60
Author: MikeSmithEU <[email protected]>
Date:   Sat Feb 9 15:37:22 2019 +0100

    Improve csv parser indication of wrong syntax locations, improve errors shown in jsonrpc api explorer, add documentation

commit d64e8f1312bf30c7e7d82b33cab245586286ff45
Author: MikeSmithEU <[email protected]>
Date:   Fri Feb 8 17:41:39 2019 +0100

    Add decent debug mode (probably should've done this before debugging myself :p )

commit 22a9e020e7c0063bd2c47cbd15d2ac4f476f561f
Author: MikeSmithEU <[email protected]>
Date:   Fri Feb 8 12:34:01 2019 +0100

    Add complete python package documentation with autodoc

commit e28fe366749f1dedb1f4650af4f92c107b06a3e4
Author: MikeSmithEU <[email protected]>
Date:   Fri Feb 8 11:25:24 2019 +0100

    fix test_core

commit 175ef9da0b69cfa6ff8d313125e4e9c041a653ff
Author: MikeSmithEU <[email protected]>
Date:   Fri Feb 8 11:23:39 2019 +0100

    Don't add NormalizationComposite to the core namespace

commit 76d4603002f8fa43fd2a1be2a974ac28d04e2e93
Author: MikeSmithEU <[email protected]>
Date:   Fri Feb 8 11:18:43 2019 +0100

    Small cleanup: move Composite normalizer outside core, removes the need for an ignored_normalizers...

commit 1ea76966e2ed5774a325b0fa9a0e2a1d14fa3764
Author: MikeSmithEU <[email protected]>
Date:   Fri Feb 8 10:53:15 2019 +0100

    Change to US spelling  #12

commit 75c7b26ee850d8c58ddffa2b41a149f996a447ab
Author: MikeSmithEU <[email protected]>
Date:   Thu Feb 7 14:09:29 2019 +0100

    not really necessary it turns out as long as it is text highlighting

commit a3851eb2590f11878b0902f7f9713fcc99301549
Author: MikeSmithEU <[email protected]>
Date:   Thu Feb 7 14:07:15 2019 +0100

    add Pygments as dependency for source code highlighting

commit 2d6b2376a6a187dd0db6f3b550ea9273c425489a
Author: MikeSmithEU <[email protected]>
Date:   Thu Feb 7 14:04:27 2019 +0100

    use text lexer for config highlight

commit 5bae2b021b3cc3b6001f40ab57e0dcbdf41f0c41
Author: MikeSmithEU <[email protected]>
Date:   Thu Feb 7 14:01:47 2019 +0100

    proper quote args

commit 9d3e9998b0cdad99a6fc3df459c720b1d0469c3e
Author: MikeSmithEU <[email protected]>
Date:   Thu Feb 7 13:54:24 2019 +0100

    updated documentation

commit 744352e5bf0605473c0084df0233ca9c375fda13
Author: MikeSmithEU <[email protected]>
Date:   Thu Feb 7 13:47:36 2019 +0100

    all normalisers an example

commit a6c6a9203893181808677343189c6aeaebeec6d5
Author: MikeSmithEU <[email protected]>
Date:   Thu Feb 7 13:32:41 2019 +0100

    custom doctest in sphinx no longer needed

commit 02eae5a6ad6d297a3220dd67add896e2f3953204
Author: MikeSmithEU <[email protected]>
Date:   Thu Feb 7 13:21:47 2019 +0100

    Fix removing of old resources of gh-pages

commit 2de5f15b5a3114d675c9c5a0d8d866bc7ed86605
Author: MikeSmithEU <[email protected]>
Date:   Thu Feb 7 13:16:40 2019 +0100

    only print rst body, take care of base formatting ourselves

commit a1035dbf7a2c402feb319c9b3e5e3658dd8498f4
Author: MikeSmithEU <[email protected]>
Date:   Thu Feb 7 12:33:44 2019 +0100

    highlight example config as bash (close enough)

commit db903363fe23273cae81ff728f09f1d99d83a927
Author: MikeSmithEU <[email protected]>
Date:   Thu Feb 7 12:20:20 2019 +0100

    Remove 'normalisation' global api method (just use config), format documentation in explorer, add dependency to docutils to api, allow multiple examples in docstring

commit 424812b3f4a8a7bf7072d7fac9df7d13693385ec
Author: MikeSmithEU <[email protected]>
Date:   Thu Feb 7 01:10:13 2019 +0100

    updated api-method docs

commit f552f67b75b7fe71d9b1ea1c203811d8f9874924
Author: MikeSmithEU <[email protected]>
Date:   Thu Feb 7 01:06:20 2019 +0100

    add log_call decorator, improve api-explorer styling, fix docblock regexes

commit 169474a1d6d5369a65e2d3f04cc55bdf20e20604
Author: MikeSmithEU <[email protected]>
Date:   Thu Feb 7 00:17:43 2019 +0100

    Oops, forgot to actually commit the fix, only commited the updated test :p

commit 6334b38bfce694acdc38938b3f82a326d8572285
Author: MikeSmithEU <[email protected]>
Date:   Thu Feb 7 00:07:39 2019 +0100

    And hopefully final bug in csv parser fixed

commit c2ae2d639a6165c3bb1284121d9691299c68e6e2
Author: MikeSmithEU <[email protected]>
Date:   Wed Feb 6 23:47:10 2019 +0100

    Fix csv bug and add test for whitespace dialect parser 'test   '

commit b401e1188f041694515d576342f4ee893de75dc2
Author: MikeSmithEU <[email protected]>
Date:   Wed Feb 6 16:43:09 2019 +0100

    proper include examples in jsonrpc explorer, styling fixes, add status label to response

commit ccf4c55997dc148dcf3415c5044a69fc48616df2
Author: MikeSmithEU <[email protected]>
Date:   Wed Feb 6 15:08:44 2019 +0100

    Support for examples, support custom tags in docblock

commit e869744d1d51bda732a8c4d54e6aed00edd10729
Author: MikeSmithEU <[email protected]>
Date:   Wed Feb 6 14:51:45 2019 +0100

    Change port to 8080 in Dockerfile

commit 786dae0cd78486935826c7bd8def58a4f87a538b
Author: MikeSmithEU <[email protected]>
Date:   Wed Feb 6 13:14:30 2019 +0100

    include templates in package distribution

commit 47589ec425e2132a2b41521579f457347290ea37
Author: MikeSmithEU <[email protected]>
Date:   Wed Feb 6 12:57:47 2019 +0100

    no chmod needed, start_gunicorn.sh no longer exists

commit 3dc3f33b8e2f2ec625e0089da3f24dddd1617f58
Author: MikeSmithEU <[email protected]>
Date:   Wed Feb 6 12:48:45 2019 +0100

    add jsonrpc api explorer by default to gunicorn

commit 44eafb9b8cd5522b3eb6240e7628756cbc1a2189
Author: MikeSmithEU <[email protected]>
Date:   Wed Feb 6 12:27:15 2019 +0100

    only allow files from cwd to be used in api

commit e6551a142b8630b4b9adea64dad3e00d00af8c55
Author: MikeSmithEU <[email protected]>
Date:   Tue Feb 5 18:00:32 2019 +0100

    working api explorer

commit 8fbca49543eb60f9c630db83cd60b0b54de820e4
Author: MikeSmithEU <[email protected]>
Date:   Tue Feb 5 16:42:23 2019 +0100

    execute jsonrpc call

commit 88848f2e0b5e4f9f89a6edbca6ea96a0f9b62ce2
Author: MikeSmithEU <[email protected]>
Date:   Tue Feb 5 04:08:52 2019 +0100

    update docs for normalisers api call

commit 4e4e21b4342c7425ca096ad00e470cc0d226c41e
Author: MikeSmithEU <[email protected]>
Date:   Tue Feb 5 04:06:11 2019 +0100

    add param comment to new signature

commit 0a142b18e9f93f6939d25ac3915fc25ceab8da20
Author: MikeSmithEU <[email protected]>
Date:   Tue Feb 5 03:59:43 2019 +0100

    The hard work for the frontend jsonrpc explorer done!

commit 2d602f4f48bdddc633706de63da9ea642841f799
Author: MikeSmithEU <[email protected]>
Date:   Mon Feb 4 22:45:48 2019 +0100

    preparation for jsonrpc explorer

commit 866832487552052f44148aca9355ec416040ea5b
Author: MikeSmithEU <[email protected]>
Date:   Mon Feb 4 17:13:15 2019 +0100

    allow fail on osx and 3.8-dev

commit 35ed7c4e5471bbd2edd39539cdfd793bae71289c
Author: MikeSmithEU <[email protected]>
Date:   Mon Mar 4 13:06:54 2019 +0100

    Added note that no contact has yet been decided.

commit fc6dc2f47226f213936c3f9665af72b4fed20e54
Author: EyalLavi <[email protected]>
Date:   Mon Mar 4 13:05:02 2019 +0100

    Update docs/CONTRIBUTING.rst

    Co-Authored-By: MikeSmithEU <[email protected]>

commit 3a2e08274ed1ce1279df924b22658081c445c967
Author: MikeSmithEU <[email protected]>
Date:   Mon Mar 4 12:50:04 2019 +0100

    implement feedback from @danpope-bbc

commit 7877a1f8d165b0abbeb15def1bcab26b387c2671
Author: MikeSmithEU <[email protected]>
Date:   Fri Feb 22 17:10:12 2019 +0100

    Clarify status of JSON-RPC api explorer #35

commit e74703af523b662a42c734d81fca3395c1d1e2cd
Author: MikeSmithEU <[email protected]>
Date:   Fri Feb 22 11:04:44 2019 +0100

    add license badge

commit bbdb0b9fe1103ecda2511a69da6e52edae0e01e0
Author: MikeSmithEU <[email protected]>
Date:   Fri Feb 22 11:00:20 2019 +0100

    add MIT licence #18

commit 6e842189c50d4b800a7511726d0c07c5b362bfdf
Author: MikeSmithEU <[email protected]>
Date:   Thu Feb 14 18:27:04 2019 +0100

    Improve styling of the logs in API explorer

commit 0f51ea2f35181cc6b01623b971bf3aace82eb1b7
Author: MikeSmithEU <[email protected]>
Date:   Mon Feb 11 01:42:57 2019 +0100

    pad diffs

commit 1f01efbf4068de560fc51b6873051966d089836a
Author: MikeSmithEU <[email protected]>
Date:   Mon Feb 11 01:33:53 2019 +0100

    fix logging expectation test

commit 73a42f1972d985d3496762fbc92531471a1d8ba4
Author: MikeSmithEU <[email protected]>
Date:   Mon Feb 11 01:26:47 2019 +0100

    no more hacking of differ settings for logs, do it cleaner with custom handler and formatter

commit e7ddae9606b8d9466e649088188ea926dbb72d4f
Author: MikeSmithEU <[email protected]>
Date:   Sun Feb 10 23:59:38 2019 +0100

    Postpone initialization of logger so root logger has time to setup

commit f1ad92151d970bac165902f1e001c15815ffd736
Author: MikeSmithEU <[email protected]>
Date:   Sun Feb 10 23:17:39 2019 +0100

    fix logging of normalizers in api call if global loglevel < notice

commit 8f4ba8689f3b3078d18a704cba86d6a77d858790
Author: MikeSmithEU <[email protected]>
Date:   Sun Feb 10 20:34:08 2019 +0100

    add support for showing the normalizer logs through api

commit 524ffac704304162f05d83fa9f59b42a5d0245c8
Author: MikeSmithEU <[email protected]>
Date:   Sun Feb 10 19:08:04 2019 +0100

    add logging to normalizers

commit d088d1b481b3033f12df12865460c63fa1e0e57f
Author: MikeSmithEU <[email protected]>
Date:   Sat Feb 9 22:41:06 2019 +0100

    test conferatur branch

commit 0bd792d45acf0a26982dfec056d8f024c39ce795
Author: MikeSmithEU <[email protected]>
Date:   Sat Feb 9 22:38:17 2019 +0100

    travis: test conferatur branch

commit 0fe05a3e24c80d8fd01a56cbfd4827585e9aea40
Author: MikeSmithEU <[email protected]>
Date:   Sat Feb 9 15:49:35 2019 +0100

    be consistent with :example return vs result

commit ccc71dba53e18379e4eda40e029bbd14757efbeb
Author: MikeSmithEU <[email protected]>
Date:   Sat Feb 9 15:37:22 2019 +0100

    Improve csv parser indication of wrong syntax locations, improve errors shown in jsonrpc api explorer, add documentation

commit b7220b7bd96f6410f4eaf07caa51106c0537532d
Author: MikeSmithEU <[email protected]>
Date:   Fri Feb 8 17:41:39 2019 +0100

    Add decent debug mode (probably should've done this before debugging myself :p )

commit ae9eb921ffe3c1dabff01802659695b9dc9faa92
Author: MikeSmithEU <[email protected]>
Date:   Fri Feb 8 12:34:01 2019 +0100

    Add complete python package documentation with autodoc

commit 139c495f8fe3426317b8ead1820f7b6c04bef089
Author: MikeSmithEU <[email protected]>
Date:   Fri Feb 8 11:25:24 2019 +0100

    fix test_core

commit bf2472ace7a34ede63d36b66ae25481d80343916
Author: MikeSmithEU <[email protected]>
Date:   Fri Feb 8 11:23:39 2019 +0100

    Don't add NormalizationComposite to the core namespace

commit f95c5a172f0b56e53c91449c9f64f8871632b19c
Author: MikeSmithEU <[email protected]>
Date:   Fri Feb 8 11:18:43 2019 +0100

    Small cleanup: move Composite normalizer outside core, removes the need for an ignored_normalizers...

commit 028b43d0189e58bad060a5ad8df43c3150983e05
Author: MikeSmithEU <[email protected]>
Date:   Fri Feb 8 10:53:15 2019 +0100

    Change to US spelling  #12

commit 0c6bdaa60f0a0a017570a2d5bd6dfe22a27133af
Author: MikeSmithEU <[email protected]>
Date:   Thu Feb 7 14:09:29 2019 +0100

    not really necessary it turns out as long as it is text highlighting

commit fe64d3b740dedfa493edb1b1983a879238a51997
Author: MikeSmithEU <[email protected]>
Date:   Thu Feb 7 14:07:15 2019 +0100

    add Pygments as dependency for source code highlighting

commit 2cc3e090707e39b958216d4bf4c47c38cab50a21
Author: MikeSmithEU <[email protected]>
Date:   Thu Feb 7 14:04:27 2019 +0100

    use text lexer for config highlight

commit 1236566f11bbab344c175d815bbf3f2370a8009e
Author: MikeSmithEU <[email protected]>
Date:   Thu Feb 7 14:01:47 2019 +0100

    proper quote args

commit ec91697767c7455b904089a355a0e9d7a3f3d2cb
Author: MikeSmithEU <[email protected]>
Date:   Thu Feb 7 13:54:24 2019 +0100

    updated documentation

commit 4ae15c37eecedd0c8d172be72622233e9c16dde5
Author: MikeSmithEU <[email protected]>
Date:   Thu Feb 7 13:47:36 2019 +0100

    all normalisers an example

commit 581407a50e74c6e0c9ff7c4fad0a4c8bfff8f999
Author: MikeSmithEU <[email protected]>
Date:   Thu Feb 7 13:32:41 2019 +0100

    custom doctest in sphinx no longer needed

commit c694e16d59c3a1550f443845a212e425a9982c76
Author: MikeSmithEU <[email protected]>
Date:   Thu Feb 7 13:21:47 2019 +0100

    Fix removing of old resources of gh-pages

commit 0e6ed8b67c606d0f60cf56ca829eb89f6bb08a4f
Author: MikeSmithEU <[email protected]>
Date:   Thu Feb 7 13:16:40 2019 +0100

    only print rst body, take care of base formatting ourselves

commit 3a9e4efcd9e8affca16f3d75146218a16a35b1f7
Author: MikeSmithEU <[email protected]>
Date:   Thu Feb 7 12:33:44 2019 +0100

    highlight example config as bash (close enough)

commit 74e6f66f0c4a9384b2ef5bf6f15e0101d06c81af
Author: MikeSmithEU <[email protected]>
Date:   Thu Feb 7 12:20:20 2019 +0100

    Remove 'normalisation' global api method (just use config), format documentation in explorer, add dependency to docutils to api, allow multiple examples in docstring

commit 5ae679a53b2edd6523f8cdd0dd89c2efd050a7c4
Author: MikeSmithEU <[email protected]>
Date:   Thu Feb 7 01:10:13 2019 +0100

    updated api-method docs

commit 7b199500ec760eaad4a5fedc909ff130c8b64481
Merge: 74d51fc 4a23809
Author: MikeSmithEU <[email protected]>
Date:   Thu Feb 7 01:09:55 2019 +0100

    Merge branch 'conferatur'

commit 4a238095939726f00a29bec68cd39024a782a892
Author: MikeSmithEU <[email protected]>
Date:   Thu Feb 7 01:07:27 2019 +0100

    Various fixes and slight improvements, also added some more examples to api explorer

    Squashed commit of the following:

    commit 74d51fccd4a40e94419fc3c190c315d0631b1c74
    Author: MikeSmithEU <[email protected]>
    Date:   Thu Feb 7 01:06:20 2019 +0100

        add log_call decorator, improve api-explorer styling, fix docblock regexes

    commit 53983e5df8bf66359851f9dc3423a93acb8bee11
    Author: MikeSmithEU <[email protected]>
    Date:   Thu Feb 7 00:17:43 2019 +0100

        Oops, forgot to actually commit the fix, only commited the updated test :p

    commit 64704afb4dee40c339824b188984dcb10fe08cfd
    Author: MikeSmithEU <[email protected]>
    Date:   Thu Feb 7 00:07:39 2019 +0100

        And hopefully final bug in csv parser fixed

    commit 338598184239dbc3bf26f8b4d80d6b9c9be30cc0
    Author: MikeSmithEU <[email protected]>
    Date:   Wed Feb 6 23:47:10 2019 +0100

        Fix csv bug and add test for whitespace dialect parser 'test   '

commit 74d51fccd4a40e94419fc3c190c315d0631b1c74
Author: MikeSmithEU <[email protected]>
Date:   Thu Feb 7 01:06:20 2019 +0100

    add log_call decorator, improve api-explorer styling, fix docblock regexes

commit 53983e5df8bf66359851f9dc3423a93acb8bee11
Author: MikeSmithEU <[email protected]>
Date:   Thu Feb 7 00:17:43 2019 +0100

    Oops, forgot to actually commit the fix, only commited the updated test :p

commit 64704afb4dee40c339824b188984dcb10fe08cfd
Author: MikeSmithEU <[email protected]>
Date:   Thu Feb 7 00:07:39 2019 +0100

    And hopefully final bug in csv parser fixed

commit 338598184239dbc3bf26f8b4d80d6b9c9be30cc0
Author: MikeSmithEU <[email protected]>
Date:   Wed Feb 6 23:47:10 2019 +0100

    Fix csv bug and add test for whitespace dialect parser 'test   '

commit 77d2abec3f60250f66ba7ea04017f436fe7e5cad
Author: MikeSmithEU <[email protected]>
Date:   Wed Feb 6 16:43:09 2019 +0100

    proper include examples in jsonrpc explorer, styling fixes, add status label to response

commit dddee06c350e09bdfaa4cdc0b0b25c562803703d
Author: MikeSmithEU <[email protected]>
Date:   Wed Feb 6 15:08:44 2019 +0100

    Support for examples, support custom tags in docblock

commit eda28ee138484d1b9cfe3f9781e49831748bc1be
Author: MikeSmithEU <[email protected]>
Date:   Wed Feb 6 14:51:45 2019 +0100

    Change port to 8080 in Dockerfile

commit 91f518549b270e6cf1f52ee3647af231a8b0deb2
Author: MikeSmithEU <[email protected]>
Date:   Wed Feb 6 13:14:30 2019 +0100

    include templates in package distribution

commit 89c63a053dcd737722cdfc0bd807ffd64b532e84
Author: MikeSmithEU <[email protected]>
Date:   Wed Feb 6 12:57:47 2019 +0100

    no chmod needed, start_gunicorn.sh no longer exists

commit 0251a097eaa415ae99febe0a36934b48ade54518
Author: MikeSmithEU <[email protected]>
Date:   Wed Feb 6 12:48:45 2019 +0100

    add jsonrpc api explorer by default to gunicorn

commit bbda35a632a780c1a43f63e5fdda75a1c1956d2b
Author: MikeSmithEU <[email protected]>
Date:   Wed Feb 6 12:27:15 2019 +0100

    only allow files from cwd to be used in api

commit 245d4284d6b01198fd4fbaa70e8990e17b8fa9c2
Author: MikeSmithEU <[email protected]>
Date:   Tue Feb 5 18:00:32 2019 +0100

    working api explorer

commit 64859ec5cc69576ee7b91eb5110ac1ca7bf7821c
Author: MikeSmithEU <[email protected]>
Date:   Tue Feb 5 16:42:23 2019 +0100

    execute jsonrpc call

commit 1e6e096ae44dedaae29f3f9a1c8652d9c8a3b627
Author: MikeSmithEU <[email protected]>
Date:   Tue Feb 5 04:08:52 2019 +0100

    update docs for normalisers api call

commit cee39640f6069787bd690d94bf45e1cab4d86d39
Author: MikeSmithEU <[email protected]>
Date:   Tue Feb 5 04:06:11 2019 +0100

    add param comment to new signature

commit f62ac1b773c13af298aa0e88935f0f807f0cd09f
Merge: fceb6c8 5a1c31f
Author: MikeSmithEU <[email protected]>
Date:   Tue Feb 5 04:00:34 2019 +0100

    Merge branch 'master' into conferatur

commit 5a1c31f4a6443173b53b473c0d6269bf7c0ad3f5
Author: MikeSmithEU <[email protected]>
Date:   Tue Feb 5 03:59:43 2019 +0100

    The hard work for the frontend jsonrpc explorer done!

commit e0a0e60024d7df03b5ab6bb6a5ee3e10c832072b
Author: MikeSmithEU <[email protected]>
Date:   Mon Feb 4 22:45:48 2019 +0100

    preparation for jsonrpc explorer

commit fceb6c85d811a21956f1d654eefa646abab952b2
Author: MikeSmithEU <[email protected]>
Date:   Mon Feb 4 17:22:05 2019 +0100

    Squashed commit of the following:

    commit e14c7d845bd3819ea7609bf4a8ecce9d6b4ece1f
    Author: MikeSmithEU <[email protected]>
    Date:   Mon Feb 4 17:19:32 2019 +0100

        TravisCI conf

    commit 5b85a7781588030c804ea175a44302d51b289efb
    Author: MikeSmithEU <[email protected]>
    Date:   Mon Feb 4 17:16:49 2019 +0100

        TravisCI: 3.7 on xenial

    commit 3e3a691bfbe33c3cc7d5af5c1d2bc20b86167572
    Author: MikeSmithEU <[email protected]>
    Date:   Mon Feb 4 17:13:15 2019 +0100

        allow fail on osx and 3.8-dev

commit e14c7d845bd3819ea7609bf4a8ecce9d6b4ece1f
Author: MikeSmithEU <[email protected]>
Date:   Mon Feb 4 17:19:32 2019 +0100

    TravisCI conf

commit 5b85a7781588030c804ea175a44302d51b289efb
Author: MikeSmithEU <[email protected]>
Date:   Mon Feb 4 17:16:49 2019 +0100

    TravisCI: 3.7 on xenial

commit 3e3a691bfbe33c3cc7d5af5c1d2bc20b86167572
Author: MikeSmithEU <[email protected]>
Date:   Mon Feb 4 17:13:15 2019 +0100

    allow fail on osx and 3.8-dev

commit b1c44541474642e8b765589af3efa1813f84250a
Author: MikeSmithEU <[email protected]>
Date:   Mon Feb 4 16:50:12 2019 +0100

    Also CI on windows (experimental travis feature, so allow_fail)

commit c7a7ca02dbd396b5a0592027774ff3bd6c43ce8d
Author: MikeSmithEU <[email protected]>
Date:   Mon Feb 4 16:38:52 2019 +0100

    Add travis-ci status image

commit f3e0058206d5188e4c6c44aebf32d7c470506f07
Author: MikeSmithEU <[email protected]>
Date:   Mon Feb 4 16:31:46 2019 +0100

    3.7 only avalabled as -dev in travis

commit 2b391029ab145750d8620330f15c0fac36ca009b
Author: MikeSmithEU <[email protected]>
Date:   Mon Feb 4 16:17:09 2019 +0100

    add travis-ci conf

commit 56d1f362d470eeff7849bd4ec5af70238c02d1d8
Author: MikeSmithEU <[email protected]>
Date:   Mon Feb 4 16:10:44 2019 +0100

    add support for tox

commit 05b182344b11f3a4d8ac45619f2335bac2910e8a
Author: MikeSmithEU <[email protected]>
Date:   Mon Feb 4 13:56:49 2019 +0100

    oops, forgot to negate escape sequences for some regexes

commit 08bedf9ce58b1b2023f17b21d86d6f272c6dbf5d
Author: MikeSmithEU <[email protected]>
Date:   Mon Feb 4 13:54:01 2019 +0100

    Using iter generator: no need for StopIteration

commit 75545e5b70190fa755cf66d0052d406e4db60595
Author: MikeSmithEU <[email protected]>
Date:   Mon Feb 4 13:36:22 2019 +0100

    cleanup comments

commit 88323389823a4ba0ff2f385a0ee3ea6e36fee1f6
Author: MikeSmithEU <[email protected]>
Date:   Mon Feb 4 13:24:05 2019 +0100

    cleanup

commit 5a11ae40d4b64d37ebad243d8129ba488e9341b9
Author: MikeSmithEU <[email protected]>
Date:   Mon Feb 4 13:09:40 2019 +0100

    Add own csv parser that deals with comments correctly + tests, add configfile again (`file config` was broken), set proper python version reqs, update man and api docs

commit eb52274dccc0f6a0fbdce085ae2a5572d6c9b38a
Author: MikeSmithEU <[email protected]>
Date:   Sun Feb 3 21:19:00 2019 +0100

    start_unicorn.sh no longer needed

commit b3e936dc70c9bd63073bf036b17f23fe044f9e30
Author: MikeSmithEU <[email protected]>
Date:   Sun Feb 3 21:17:31 2019 +0100

    update docs, integrate all relevant current docs into sphinx

commit aa78db05760665c78caaaa6bf980b8593c4437d9
Author: MikeSmithEU <[email protected]>
Date:   Sun Feb 3 20:10:07 2019 +0100

    update manpage, dont write date to api-method.rst (dont want a change commited if nothing changed)

commit b8bd3c4cbf85e002c2b3c1d2a3fc690ac55f2dba
Author: MikeSmithEU <[email protected]>
Date:   Sun Feb 3 20:06:29 2019 +0100

    add api documentation, add more api methods, add normaliser api methods automagically, add an api help method, fix some docs

commit e0f915e73279fc8e716c75bee9a04d77e1f2ea02
Author: MikeSmithEU <[email protected]>
Date:   Sun Feb 3 15:48:55 2019 +0100

    Add Dockerfile, gunicorn, and document

commit 23a3d7f34e2ca1945f5f372ae539a26e31338817
Author: MikeSmithEU <[email protected]>
Date:   Sun Feb 3 01:25:42 2019 +0100

    gh-pages auto build and publish script

commit 710670b380f90021c5bc795dde6fe20d0371aa99
Author: MikeSmithEU <[email protected]>
Date:   Sun Feb 3 00:19:00 2019 +0100

    update gh-pages

commit 7b9a004d81957b74707a888b107cf494c8d8490c
Author: MikeSmithEU <[email protected]>
Date:   Sat Feb 2 23:20:57 2019 +0100

    Things done in this version:

    setup basic structure
    created some normalisers
    created sphinx docs
    created a command line tool
    created proper pip setup for easy installation
    created manpage for command line tool
    created jsonrpc api
    added bash completion for command line tool
    added testing via pytest

* use ordereddict

* avoid basename duplication for pytest

* tmp commit

* reformat code (max. line len 80)

* get_available -> get_modules_dict

* conferatur -> benchmarkstt

* remove old manpaget

* conferatur -> BenchmarkSTT

* conferatur -> BenchmarkSTT

* update manpage

* first version of word segmenter, preparations for comparison module and metrics (dirrrrrrrty atm)

* Add input file types infer, disable '-h' for help messages (gonna use it for hypothesis file), add prproper command line stuff

* implement 3 WER strategies (well, the difflib ratio is probably not considered WER, but you get the idea)

* remove debug data from docs

* cleanup a bit

* remove travis config #36

* Update Schema to use "item" and "type" fields (see #29)

* README.md -> README.rst and re-use in documentation.

* documentation: remove unnecessary title from index.rst

* simplify install procedure in documentation

* proper pip install command

* fix docker install instructions

* log_call decorator: fix doctest via pytest with custom log handler using stringio buffer, improve output (use repr and ignore arguments if not given)
add doctest to pytest

* optimization: defer arguments string formatting

* Rename Word class to Item (since it no longer is necessarily a unit of word) #29

* add proper docblock parsing (cleaner) + fixes small api explorer issue normally

* fix code style

* git ignore auto generated api module documentation

* git ignore auto generated api module documentation

* remove auto generated module docs from git

* some extra docblock tests

* make compatible with py3.5 (regex matches not subscriptable yet)

* Cleanup and reuse diff stuff, add 2 metrics: diffcounts and worddiffs

* fix pycodestyle

* Make pytest in azure verbose, remove api extra dep

* fix test for py3.5: use OrderedDicts

* remove docs/modules/benchmarkstt.rst: auto regenerated

* only ignore rst files in docs/modules, leave directory be

* placeholder file to make sure directory exists in git

* add codestyle tests to `make test`

* add coverage report to azure

* publish coverage report in azure #21

* check code coverage azure config

* fix schema unit test (final one?)

* coverage report locations in azure-pipeline

* separate code coverage from unit tests

* fix codecoverage azure check ?

* check another path for code coverage

* another change to check coverage

* PublishCodeCoverageResults@1

* another attempt at correct code coverage path

* re-check coverage?

* code coverage: re-order arguments? works locally...

* codecov still not working, xml generating 0% every time?! move back to test and check again *sigh*

* Revert "codecov still not working, xml generating 0% every time?! move back to test and check again *sigh*"

This reverts commit e92729ef4ca2cc33f356837ae782c63b8162a768.

* check with removed tox

* add pytest-cov to test dependencies

* fix pycodestyle azure pipeline, add __init__.py for tests (might fix code coverage stuff?)

* show raw code cov stats

* don't test kwargs for roundtrip atm as kwargs doesn't persist order in python<3.6

* attempt to debug the code coverage

* test for codecoverage

* re-add tox

* proper code coverage?

* code coverage cleanup

* add code coverage tab (?)

* remove additionalCodeCoverageFiles

* Refactor: cleanup dynamic module loading (+ make more re-usable across modules), step 1

* proper docstring formatting for diff.Base.get_opcodes()

* Refactor: cleanup dynamic module loading (+ make more re-usable across modules), step 2

* cleanup Factory.get_class() + add more documentation

* extra unit tests

* add unit test for decorators.log_call

* test base classes NotImplementedError exceptions

* extra tests for schema.Item

* 100% code coverage for Schema unit tests

* not jsonserializable message different across versions

* avoid test failure due to unordered dict keys

* avoid test failure due to unordered dict keys

* exclude gunicorn from code coverage

* exclude gunicorn from code coverage

* csv: test first char is separator

* improve code coverage for factory

* add extra diff formatter (+ support for callbacks for formatting)

* 100% code coverage, for csv reader (last edge case)

* add and unit test factory.create

* test skip normalize of NormalizationComposite

* check equality using dict and list for Schema and Item

* test if defaultdict can be abstracted away (__eq__ was possibly not doing performant equality check)

* Schema and Item equality checks seem fixed

* proper factory and base class for segmentation and input classe, add extra unit tests

* more unit tests, load core classes namespace by default in factory

* fix bug in diff formatter, add unit test

* add cli unit test

* some more tests + exclude some blocks from code coverage. Getting to a healthier 81% coverage now

* exclude jsonrpcserver from python 3.5

* exclude api from python 3.5

* add in documentation: api only supported for python >= 3.6

* Clarify status of JSON-RPC api explorer #35

* Make cli auto arguments from factory re-usable, add metrics params to cli, add unit test

* "Item" Error Rate -> Word Error Rate

* more verbose unittest results

* metrics results output: only output to 6 decimal places

* sort opcode counts by highest first

* make opcode counts a named tuple

* 100% code coverage for metrics/cli.py

* abstract away some of the magic api generation stuff (prepare to make metrics available through api as well)

* add metrics to jsonrpc api (todo: cleanup further)

* make jsonrpc api loading code modular

* more cleanup and avoiding code duplication: read extra arguments from callback instead of separate variable

* import from inspect: cleanup

* remove html codecov report (removes azure pipeline warning)

* cleanup useless try-catch block

* And even more cleanup in api magicmethods loading code

* remove docs/api-methods.rst from git since it is auto generated on docs build

* fix `make test`, add docblock test separately, update azure pipeline

* no doctest in azure pipeline for now (tries to use jsonrpcserver as well, which is unsupported)

* Makefile does not need to specify a --max-line-length since it's specified in tox.ini

* Use --help for benchmarkstt instead of -h (ref. https://github.com/ebu/ai-benchmarking-stt/pull/48#discussion_r275379761 )

* feedback/cleanup fro…
  • Loading branch information
@MikeSmithEU
MikeSmithEU authored Apr 17, 2019
1 parent 52cda57 commit a0142e1
Show file tree
Hide file tree
Showing 83 changed files with 2,276 additions and 1,083 deletions.
2 changes: 2 additions & 0 deletions .gitignore
View file
Original file line number Diff line number Diff line change
@@ -1,5 +1,7 @@
# sphinx documentation
docs/build/
docs/modules/*.rst
docs/api-methods.rst

# python caches and build
__pycache__
Expand Down
20 changes: 0 additions & 20 deletions .travis.yml
View file

This file was deleted.

2 changes: 1 addition & 1 deletion Dockerfile
View file
Original file line number Diff line number Diff line change
Expand Up @@ -8,7 +8,7 @@ RUN pip install --upgrade pip
WORKDIR /home/benchmarkstt
COPY . /home/benchmarkstt/

RUN pip install '.[api]'
RUN pip install '.[test]'

RUN chown -R benchmarkstt:benchmarkstt ./
USER benchmarkstt
Expand Down
8 changes: 6 additions & 2 deletions Makefile
View file
Original file line number Diff line number Diff line change
@@ -1,15 +1,18 @@
.PHONY: docs test clean gh-pages

test:
pytest --verbose
pytest src --doctest-modules --verbose
pytest tests --verbose
pycodestyle tests
pycodestyle src

docs: html

html: apidocs
echo ".. Note, this was autogenerated, all changes will vanish...\n" > docs/api-methods.rst
echo "Available JSON-RPC methods\n==========================\n\n" >> docs/api-methods.rst
benchmarkstt api --list-methods >> docs/api-methods.rst
cd docs/ && make clean html && touch build/html/.nojekyll
cd docs/ && make clean html

man: build-man
cp resources/manpage/*.1 /usr/local/share/man/man1
Expand All @@ -34,4 +37,5 @@ gh-pages: # docs
git add -A && git commit -a -m 'update docs' && git push --set-upstream origin gh-pages

apidocs:
ls docs/modules/|grep '.rst$$' && rm docs/modules/*.rst || echo "no .rst files to clean"
sphinx-apidoc -f -e -o docs/modules/ src/benchmarkstt/ && rm docs/modules/modules.rst
73 changes: 0 additions & 73 deletions README.md
View file

This file was deleted.

20 changes: 20 additions & 0 deletions README.rst
View file
Original file line number Diff line number Diff line change
@@ -0,0 +1,20 @@
AI Benchmarking STT
===================

.. image:: https://img.shields.io/github/license/ebu/ai-benchmarking-stt.svg
:target: https://github.com/ebu/ai-benchmarking-stt/blob/master/LICENCE.md

.. image:: https://img.shields.io/azure-devops/build/danielthepope/ai-benchmarking-stt/3.svg?logo=azure-devops
:target: https://dev.azure.com/danielthepope/ai-benchmarking-stt/_build/latest?definitionId=3&branchName=master

.. image:: https://img.shields.io/azure-devops/tests/danielthepope/ai-benchmarking-stt/3.svg?logo=azure-devops
:target: https://dev.azure.com/danielthepope/ai-benchmarking-stt/_build/latest?definitionId=3&branchName=master

.. image:: https://img.shields.io/azure-devops/coverage/danielthepope/ai-benchmarking-stt/3.svg?logo=azure-devops
:target: https://dev.azure.com/danielthepope/ai-benchmarking-stt/_build

This is a collaborative project to create a library for benchmarking AI/ML applications. It evolved out of conversations among broadcasters and providers of Access Services to media organisations, but anyone is welcome to contribute. The group behind this project is the EBU's `Media Information Management & AI group <https://tech.ebu.ch/groups/mim>`_. Currently the group is focussing on Speech-to-Text, but it will consider creating benchmarking tools for other AI/ML services.

For general information about this project, including the `motivations <https://github.com/ebu/ai-benchmarking-stt/wiki>`_ and `guiding principles <https://github.com/ebu/ai-benchmarking-stt/wiki/Principles>`_, please see the project `wiki <https://github.com/ebu/ai-benchmarking-stt/wiki>`_ and `documentation <https://benchmarkstt.mikesmith.eu>`_.


2 changes: 1 addition & 1 deletion VERSION
View file
Original file line number Diff line number Diff line change
@@ -1 +1 @@
0.0.1
0.0.2
34 changes: 29 additions & 5 deletions azure-pipelines.yml
View file
Original file line number Diff line number Diff line change
Expand Up @@ -36,20 +36,42 @@ jobs:
versionSpec: '$(python.version)'
architecture: 'x64'

- script: python -m pip install --upgrade pip && pip install ".[api,test]"
- script: python -m pip install --upgrade pip && pip install ".[test]"
displayName: 'Install dependencies'

- script: |
pip install pytest
pytest tests --doctest-modules --junitxml=junit/test-results.xml
pytest tests --junitxml=junit/test-results-unit.xml -vv
displayName: 'pytest'
- task: PublishTestResults@2
inputs:
testResultsFiles: '**/test-results.xml'
testResultsFiles: '**/test-results*.xml'
testRunTitle: 'Python $(python.version)'
condition: succeededOrFailed()


- job: 'CodeCoverage'
pool:
vmImage: 'Ubuntu-16.04'

steps:
- task: UsePythonVersion@0
inputs:
versionSpec: '3.7'
architecture: 'x64'

- script: |
python -m pip install --upgrade pip && pip install -e ".[test]"
pytest tests --cov=src --cov-report xml
displayName: 'Check code coverage'
- task: PublishCodeCoverageResults@1
displayName: 'Publish code coverage from $(System.DefaultWorkingDirectory)/**/coverage.xml'
inputs:
codeCoverageTool: Cobertura
summaryFileLocation: '$(System.DefaultWorkingDirectory)/**/coverage.xml'


- job: 'Lint'
pool:
vmImage: 'Ubuntu-16.04'
Expand All @@ -63,5 +85,7 @@ jobs:
- script: python -m pip install --upgrade pip && pip install pycodestyle
displayName: 'Install pycodestyle'

- script: pycodestyle
- script: |
pycodestyle tests
pycodestyle src
displayName: 'pycodestyle'
22 changes: 3 additions & 19 deletions docs/INSTALL.rst
View file
Original file line number Diff line number Diff line change
Expand Up @@ -23,29 +23,13 @@ From source
- `Installing Python 3 on Windows <https://docs.python-guide.org/starting/install3/win/>`_
- `Installing Python 3 on Linux <https://docs.python-guide.org/starting/install3/linux/>`_

2. Get the benchmarkstt source code from github (assumes :code:`git` is installed on the system)

.. git clone https://github.com/ebu/ai-benchmarking-stt.git
.. code-block:: bash
git clone https://github.com/MikeSmithEU/ai-benchmarking-stt.git
3. Install the package using :code:`pip`, this will also install all requirements

.. code-block:: bash
cd ai-benchmarking-stt
pip install '.[api]'
Once this is done you may remove the git repository (optional).
2. Install the package using :code:`pip`, this will also install all requirements

.. code-block:: bash
cd ..
rm -fr ai-benchmarking-stt
pip install https://github.com/ebu/ai-benchmarking-stt/archive/master.zip
4. Test and use
3. Test and use

BenchmarkSTT should now be installed and usable.

Expand Down
7 changes: 1 addition & 6 deletions docs/LICENSE.rst
View file
Original file line number Diff line number Diff line change
@@ -1,10 +1,5 @@
License
-------

Copyright 2019 EBU
.. include:: ../LICENCE.md

Permission is hereby granted, free of charge, to any person obtaining a copy of this software and associated documentation files (the "Software"), to deal in the Software without restriction, including without limitation the rights to use, copy, modify, merge, publish, distribute, sublicense, and/or sell copies of the Software, and to permit persons to whom the Software is furnished to do so, subject to the following conditions:

The above copyright notice and this permission notice shall be included in all copies or substantial portions of the Software.

THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM, OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE SOFTWARE.
Loading

0 comments on commit a0142e1

Please sign in to comment.