Verify that the reload method works as expected

[JeremyRand]

The reload method should apply all changes from the config files; we should test it with all plugins to make sure that the new config file options actually take effect.

--- Want to back this issue? **[Post a bounty on it!](https://www.bountysource.com/issues/14411176-verify-that-the-reload-method-works-as-expected?utm_campaign=plugin&utm_content=tracker%2F435873&utm_medium=issues&utm_source=github)** We accept bounties via [Bountysource](https://www.bountysource.com/?utm_campaign=plugin&utm_content=tracker%2F435873&utm_medium=issues&utm_source=github).