Write output even on exceptions

[chschrae]

Please provide us with the following information:

This issue is for a: (mark with an x)

- [ ] bug report -> please search issues before submitting
- [x ] feature request
- [ ] documentation issue or request
- [ ] regression (a behavior that used to work and stopped in a new release)

When running the test tool if an exception happens during the test, the summary file is empty. I would expect to see the results of tests run so far written to that file. Currently it seems the app just crashes.