Changing files that aren't go code results in affected thinking nothing has changed

[thebigjc]

For example, changing a .travis.yml that should require a full rebuild results in nothing being built.