Don't use use-ld.conf when Clang/LLD is used

[xbjfk]

This forces clang to use the bfd linker (through LLVMGold, which is not installed by default, which causes build failures), even though LLD can work fine for these packages