Do not re-filter view if only highlighting changes?

[janwilmans]

If 32mb of logging is in the buffer changing a color takes quite some time (10 seconds?), it seems to be re-filtering everything...