Generalise the directory cleaning rules

[dazinator]

Read the note that there was hardcoded logic not to delete images.

Maybe this could work a bit like a gitignore file where you can put globs for files to ignore when cleaning

smol-ignore

**/*.jpg
**/*.png