[FEA] Support the cached and reusable `sparsity` mechanism

[rhdong]

Support the cached and reusable sparsity mechanism for benefiting the performance in some multiple calling scenario

• code is here