Consider automating more memory mode selections via global usage heuristics

[lukstafi]

Tensor nodes that are used in different routines must be materialized. Tensor nodes that are outputs/sinks, but not inputs in any routine, should be hosted; etc.

Actually, check first if there are sufficient gains on top of already existing logic, before implementing anythings.