config: allow single annotations and labels to be removed

[cyphar]

At the moment the only way of removing an annotation is to use --clear to remove all annotations and then re-add all of the ones you want. It might make sense to make --annotation foo.bar= clear the annotation...