differentiate between different types of lib dirs

[Jan200101]

#15970 was elegant, but ended up breaking another setup (like every previous variant of it)

Relevant bug #16056

a bit ugly and only has code for the Elf linker, but that appears to be the only relevant part.