About the usage of `depth` in the class `MambaTransformerblock`, in `model.py`

[Liberatedwinner]

Dear @kyegomez,

First of all, excuse me for my awkward English. In forward(), I think using zip implies depth == transformer_depth == mamba_depth. Hence, instead of using transformer_depth and mamba_depth, how about to use depth? Would you mind if considering this idea?

Thank you very much.

[github-actions[bot]]

Hello there, thank you for opening an Issue ! 🙏🏻 The team was notified and they will get back to you asap.

[github-actions[bot]]

Stale issue message