ChangeLog

Changelog

vmcatcher-0.6.0

 * Fixed crash when querying image from a fresh subscription. And improved the 
   associated logging code.
 * Removed arbitrary length of 1000 characters fro imagelists.
 * Changed the database schema so supporting JSON outside containing non
   8-bit bytestrings. Table imageListInstance field data changed from type 
   VARCHAR(1000) to BLOB
 * Added documentation on how to upgrade the database from the old to new schema.
 * SQLAlchemy dependency had to be upgraded to  >= 0.7.8 to support BLOB.
 * Support for EPEL's interesting egg based packaging of two versions of 
   SQLAlchemy, in the modules __init__.py of the module.
 * Removed unnecessary imports of sqlalchamy

vmcatcher-0.5.4

 * Fixed testing bugs.

vmcatcher-0.5.4

 * Fixed small logging error found by Esteban Freire.

vmcatcher-0.5.3

 * Fixed a lot of ooutput bugs for various output formats.
 * White space cleanup.

vmcatcher-0.5.2

 * New feature: Imagelists containing providing the attribute 'ad:vo' will now
   trigger give handlers the environment variable 'VMCATCHER_EVENT_VO' with the
   value of this field. This is useful to allow handlers to separate roles with
   a single database of subscribed Imagelists. Thanks - Marios Chatziangelou for
   putting this in the AppDb also.
 * Bug fix: Environment variable VMCATCHER_LOG_CONF now successfully sets the log
   config file, previously this failed. Thanks - Boris Parak for reporting this.

vmcatcher-0.5.1

 * Fixed bug subscribing to an imagelist at the same time as selecting 
   --imagelist-newimage-accept, or --imagelist-newimage-subscribe
 * When subscribing to an imagelist and selecting --imagelist-newimage-subscribe
   all images will be subscribed.
 * Documentation for migration process fixed.

vmcatcher-0.5.0

 * vmcatcher_subscribe: added command line option --imagelist-newimage-accept to
   allow an imagelist to add new images and accept them automatically.
 * vmcatcher_subscribe: added command line option --imagelist-newimage-subscribe
   to allow an imagelist to add new images and subscribe to them automatically.
 * vmcatcher_subscribe: added command line option --imagelist-newimage-refuse to
   prevent an imagelist adding new images.
 * Changed the database schema to support the above options.
 * README.md updated on how to migrate existing databases to the new database 
   format.
 * Added VMCATCHER_EVENT_AD_MPURI environment variable when available to show
   image "ad:mpuri" value for fedcloud project (thanks Salvatore Pinto)
 * Improved setup.py to allow installation in a python virtualenv.
 * Added unit tests. 
 * Internal code reorganisation making code more extensible.
 * Added new error code.
   - 39 Creation of ImageDefinition reference failed
 * Improved error messages when endorser is invalid.

vmcatcher-0.4.3

 * vmcatcher_cache: Added VMCATCHER_EVENT_HV_VERSION environment variable.
 * vmcatcher_subscribe: fixed --auto-endorse which was always enabled.
 * Fixed environment variable bleed between events.

vmcatcher-0.4.2

 * Fixed a critical bug in subscription.

vmcatcher-0.4.1

 * Subscriping to an image list now works.
 * Code restructuring.

vmcatcher-0.4.0

 * Added new options to command line.
    '--uri-trustanchor-set' Sets the trust anchor type, 'none', 'browser' or 'igtf'.
    '--uri-username-set'    Sets the user name for image list URI.
    '--uri-username-clear'  Clears previously set username.
    '--uri-password-set'    Sets the password for image list URI.
    '--uri-password-clear'  Clears the password.
 * Added username and password to the table 'subscription'. Note this will require database migration.
 * Display used trust anchor when listing subscriptions.
 * Better exception handling on missing files when image list does not exist.
 * Better logging when URI does not match expected URI.
 * New facade depending upon trust anchor model for https.
 
vmcatcher-0.3.8

 * Temporary removal of host authentication of host using igtf trust anchor.

vmcatcher-0.3.7

 * Catch exception thrown by smimeX509validation when certificate is not in the trust store.

vmcatcher-0.3.6

 * Added a facade class to retrieve imagelist updates.
 * With image list updates via https the host is authenticated.
 * Support got subscriptions including an user name and password using basic access authentication.

vmcatcher-0.3.5

 * Fixed bug in manged_directory which was failing to download images.

vmcatcher-0.3.4

 * Fixed bug in getting the SMIME and message level outputs.
 * Deleted unused code

vmcatcher-0.3.3

 * Bug fix on output of error code when vmcatcher_image finds the image.
 * vmcatcher_image now shows imagelist even when image has expired.
 * With commmand "vmcatcher_image -l -f lines" added line output 'subscription.dc:date:updated', 
 * With commmand "vmcatcher_image -l -f lines" added line output 'subscription.dc:description', 
 * With commmand "vmcatcher_image -l -f lines" added line output 'subscription.dc:identifier', 
 * With commmand "vmcatcher_image -l -f lines" added line output 'subscription.hv:uri', 
 * With commmand "vmcatcher_image -l -f lines" added line output 'subscription.sl:authorised'
 * With commmand "vmcatcher_image -l -f lines" added line output 'imagelist.vmcatcher.dc:date:expired'
    to replace the 'imagelist.expired' variable.

vmcatcher-0.3.2

 * Changed to new facard based output driver.
 * Added json as a standard output format. (Json format is not yet finalised)
 * Added VMCATCHER_OUTPUT_FORMAT as a output format selector.

vmcatcher-0.3.1

 * vmcatcher_image: fix imagelist.dc:identifier output with lines format.

vmcatcher-0.3.0

 * Large code structure changes removing duplicate code.
 * Added VMCATCHER_EVENT_UUID_SESSION with a UUID for vmcatcher_subscribe.
 * setup.py now supports virtual enviroments.

vmcatcher-0.2.1

 * Typo correction Event type now changed from "ExpirePosfix" to "ExpirePostfix".

vmcatcher-0.2.0

 * Changed the event handling to include "ProcessPrefix" which is always the first event.
 * Changed the event handling to include "ProcessPostfix" which is always the last event.
 * Added VMCATCHER_EVENT_UUID_SESSION with a UUID for all events from one vmcatcher session.
 * Dont reject imagelists with the same version number only issue a warning.
 * Better logging of certificate verify error.
 * Better logging of version number errors.
 * Endorser "identifier" now constrained in Database to be Unique
 * Random Endorser "identifier" created when Endorser is automatically added from subscription.
 * Catch exceptions parsing structure of image list and reject image list.

vmcatcher-0.1.31

 * New commands for managing images bound to an imagelist.
 * Added -v and -q short options for --verbose and --quiet.

vmcatcher-0.1.30

 * Many changes in the README.md which now benefits from the updated docbook.
 * vmcatcher_eventHndlExpl now include the new environment variables for handlers, VMCATCHER_EVENT_IL_DC_IDENTIFIER and VMCATCHER_EVENT_HV_FORMAT (if available).

vmcatcher-0.1.29

 * vmcatcher_cache: Force environment variables VMCATCHER_CACHE_DIR_CACHE, VMCATCHER_CACHE_DIR_DOWNLOAD and VMCATCHER_CACHE_DIR_EXPIRE to be set for handlers under all set ups and not just my setup.
 * vmcatcher_cache: Added environment variables for handlers, VMCATCHER_EVENT_IL_DC_IDENTIFIER and VMCATCHER_EVENT_HV_FORMAT (if available) and can now import variables easily from the image list.
 * vmcatcher_cache: Some code clean up.
 * vmcatcher_endorser: Added command line option '--dn' as its more consistent with modern naming than '--subject', which now issues and info level message.
 * Updated README.md to document the environment variables.

vmcatcher-0.1.28

 * vmcatcher_endorser: Better protection against endorsers being added twice.
 * vmcatcher_subscribe: Cleaning up old registered image UUID's when their imagelist is deleted.
 
vmcatcher-0.1.27

 * vmcatcher_subscribe and vmcatcher_cache: Better logging of handler events:
   # logging of stderr output of the handler.
   # debug level logging of handler stdout on success.
 * vmcatcher_image fix to command line help.

vmcatcher-0.1.26

 * We thought we had a bug with some undefined behaviour. This is hopefully now resolved
   as better error reporting.
 * Added two new error codes
   #  16 New version number is same as old version number.
   #  17 New version number is less than old version number.

vmcatcher-0.1.25

 * Improvements to the README.md 
 * Added options --log-sql-info to log all data base SQL operations.

vmcatcher-0.1.24

 * vmcatcher_image: Fixed crash on getting information on an image list, 
   when checking the imagelist signature before displaying the metadata.
 * vmcatcher_image: Only show the latest image when showing information 
   for an image, not iterate through all old version of the image and 
   displaying them in an undefined order (though in practice it seemed 
   to be chronological).

vmcatcher-0.1.23

 * A very big rename
 * s/hepixvmcatcher/vmcatcher/g
 * s/VMILS/VMCATCHER/g
 * s/vmilsubscriber/vmcatcher/g
 * s/vmlisub/vmcatcher/g
 * s/hepixvmcatcher/vmcatcher/g
 * s/hepixvmlis/vmcatcher/g
 * s/vmilsubscriber/vmcatcher/g
 * s/vmlisub_cache/vmcatcher_cache/g
 * s/vmlisub_endorser/vmcatcher_endorser/g
 * s/vmlisub_eventHndlExpl/vmcatcher_eventHndlExpl/g
 * s/vmlisub_image/vmcatcher_image/g
 * s/vmlisub_sub/vmcatcher_subscribe/g

vmcatcher-0.1.22
 
 * Improved command line processing of logging includine '--verbose','--quiet'

vmcatcher-0.1.21

 * Removed Exception being thrown when image list failed verification.

vmcatcher-0.1.20

 * Added a new column "version" to database table "ImageListInstance"
 * Removed column "ca_pubkey" to database table "ImageListInstance"
 * Added comments to the database tables "EndorserPrincible"
 * Added new function to order packages version number.
 * Wrap all calls to SMIME validation with str objects.
 * Change update model to always check previous version of image lists 
   version string and make sure newest version is a higher version.
 * Fixed Bug introduced in vmcatcher-0.1.19 (intermittent security 
   failures for example a CRL expires caused images to remain expired).
 * Fixed bug in handling update of already downloaded image list that caused
   verify failure.
 

vmcatcher-0.1.19

 * Error message for expired imagelists improved.
 * Check messages that have not been updated and not yet expired.

vmcatcher-0.1.18
 
 * Bugfix crash when no database exists with the command vmcatcher_image
 * converted README to README.md and format of README.md to Markdown.
 * Generate README.md from docbook.

vmcatcher-0.1.17

 * Bug fixing for crash getting info on image using UUID.

vmcatcher-0.1.16

 * Moved to new SmimeX509Validation API

vmcatcher-0.1.15

 * Reordered README.
 * Added some clarifications to README.
 * Added an example event handler.

vmcatcher-0.1.14

 * vmcatcher_cache: Now automatically expires images when downloading images.
 * vmcatcher_cache: Now testing the Event interface.
 * vmcatcher_subscribe: Added event interface.
 * vmcatcher_subscribe: Added event ImageNew when a new image is added to image list.
 * vmcatcher_subscribe: Added enviroment variable VMCATCHER_SUB_EVENT to set event action.
 * vmcatcher_subscribe: Changed event commadn line to '-x', '--execute' from 
     '-E', '--even-action'.

vmcatcher-0.1.13

* vmcatcher_image: Removed '-D', '--delete' unimplemented feature from 
    vmcatcher_image as is provided in vmcatcher_subscribe.
* vmcatcher_subscribe: Changed logging to display expected and downloaded values when 
    they differ.
* vmcatcher_endorser: Added ability to list endorser links to subscriptions.

vmcatcher-0.1.12

* Changed the recommended CA metapackage in the README to ca-policy-egi-core.
* Handle non JSON messages with a clear error.
* Handle JSON messages that do not match an image list with a clear error.
* Added Error return code 37 Message was not valid JSON.
* Added Error return code 38 Message JSON was not valid to build image list.

vmcatcher-0.1.11

* Corrected Typos in the README.
* Added Environment variable VMCATCHER_CACHE_EVENT
* Significant change to the organisation of the the README.
* Added details about the event interface to the README.

vmcatcher-0.1.10

* Corrected Typos in the README.
* Documented more event variables in the README.

vmcatcher-0.1.9

* Added support for a set of Environment Variables.
* Fixed spelling errors/typos in the README Changelog.

vmcatcher-0.1.8

* Added Event interface and documentation to README.
* Cleaned up the internal JSON cache.info files.
* Changed the code structure of vmcatcher_subscribe a little for clarity.

vmcatcher-0.1.7

* Added some extra documentation on fetch-crl.
* Improved documentation in setup.

vmcatcher-0.1.6

* Stability improvements.
* Authentication / verification error logging improvements.
* Invalid selection logging improvements.
* Removed duplicate method display_imagelist

vmcatcher-0.1.5

* vmcatcher_subscribe Fixed misleading error message.
* Corrected misleading text in Changelog.
* vmcatcher_endorser Changed format of list command to make parsing easier.
* vmcatcher_endorser fixed sqlalchamy import error on RHEL/SL 5
* vmcatcher_subscribe urllib2 with python 2.4 thows OSError rather than urllib2.URLError

vmcatcher-0.1.4

* vmcatcher_cache changed default behaviour to not check integrity of already downloaded 
    images. This is still possible using a command line option but no longer default.
* Added vmcatcher_endorser to main package, so endorsers can be managed directly. Please 
    see README for full details.
* vmcatcher_endorser now works with current database schema, and changed command line to 
    be moreconistent with other applications in this suite.
* vmcatcher_subscribe now has more error return codes to allow test suite to check for errors.
        10 failed to download image list.
        11 failed to validate image list.
        12 metadata and certificate dont match.
        13 Endorser not authorised on subscription.
        14 trust anchor missing
        15 Database integrity error.
        31 imagelist dc:identifier invalid.
        32 image dc:identifier invalid.
* vmcatcher_subscribe no longer by default adds endorser when subscribing to a imagelist. Old 
    behaviour can be restored with the --auto-endorse option.
* vmcatcher_subscribe Now handles cleanly the exception of imagelists being unavailable.
* vmcatcher_subscribe Errors with registering or failing to register endorsers has better logging.
* Spelling corrections on command line help.
* Updated README and Changlog.

vmcatcher-0.1.3

* README fixed for removing a subscription.
* Failing to remove a subscription now returns a non zero error code.
* Removing a subscription by URI now works as well as removing a subscription by
    UUID.
* Database integrity exceptions when subscribing to a database are now handled 
    better.

vmcatcher-0.1.2

* Added and Apache License, Version 2.0
* Added instructions about using fetch-crl
* Added commad line option to use python log file.
    Allows setting log levels for components of the code.
    Allows setting log file formatting.
    Allows sending messages direct to syslog.
* Added and example logfile coniguration file.
* Added this Changelog file.

vmcatcher-0.1.1

* Better documentation 
* Fix an uncaught exception for failing to verify messages.

vmcatcher-0.1.0

* Data base schema has changed adding a new table ImageDefinition and 
   renaming or tables and field for constancy reasons.
* Images are now selected to be cached. (reason 1 for new table)
    '-a', '--add' and '-r', '--remove' options added to vmcatcher_image.
* When subscribing to an image list the imagelists images UUID's are 
    registered to the subscription, all UUID's that clash in a later 
    added subscriptions will be ignored. All image UUID's that are not 
    registered for a subscription will be ignored, and an error message
    will be logged. (reason 2 for new table)
* New format of cache.index files. Allowing better tracking of images 
    without accessing DB. (old format had issues with expiring images)
* Made a class for each cache directory, inheriting from a base class.
    (easier maintenance)
* Clearly logging all defaulted command line values. 
    (hopefully easier to use/support.)
* Allowing cache management to do separate tasks of downloading, 
    check sum testing and expiring. 
    (You might want to check the check sums more frequently)
* Renamed the default database from "tutorial.db" to
    "vmcatcher.db" (To avoid people trying to use old DB with new
    code).
* Renamed "image.dc:identifier" field on image queries to 
    "imagedef.dc:identifier" as this is in my opinion more clear.
* Removed "imagelist.authorised" from image queries as it was
    misleading.
* Added 'imagedef.cache' to image queries so you know if image is
    cached.
* Added more information to image information including,
    'image.dc:description', 'image.dc:title', 'image.hv:hypervisor',
    'image.hv:size', 'image.hv:uri', 'image.hv:version', 'image.sl:arch',
    'image.sl:checksum', 'image.sl:comments', 'image.sl:os',
    'image.sl:osversion' This is to make image selection easier.
* Removed 'sha512' from general image listing as images may not be
    available so may not have a current hash, you can still find an image
    UUID by 'sha512'.
* Fixed bug about expiring images immediately rather than on second
    DB update.
* Changed 'imagelist.authorised' to 'imagelist.expired' for
    subscription queries, as previous title was misleading.
* Images listing now shows all images assigned to a subscription, 
    rather than available images, images now have a state number, this 
    is a bitmask in a way similar to directory permissions in UNIX.
    1 == should be cached. 2 == Available, hence images with status 3 
    will be cached.

vmcatcher-0.0.15

* Changes to handle differences in python 2.4 (SL5) and python 2.6
    (SL6) url parsing libraries.
* Cleaner error handling and spelling correction stating clearly if the
    file fails to verify, by size or sha512, rather than always stating size.

vmcatcher-0.0.14

* Improved error message when images pass disk space limit.
* Support https as a image download format (being used by CERN VM).
* Catch exception correctly for corrupted signed images lists.

vmcatcher-0.0.13

* More robust to image lists with data that does not pass
  validation. No new features have been added.