torchtune icon indicating copy to clipboard operation
torchtune copied to clipboard

document integration with bitsandbytes?

Open Titus-von-Koeller opened this issue 1 year ago • 2 comments

Hey all,

I'm Titus, the lead maintainer of bitsandbytes. We saw your tweet about having an integration with BNB 🙌🏻 and were wondering if you'd be happy to be mentioned in our docs where we list all the known integrations with a short description.

We'd be happy to merge a PR from you to our docs page on integrations, which get's rendered here.

Let us know what you think :) Thanks on the work of the integration! Really cool.

Titus-von-Koeller avatar Apr 30 '24 16:04 Titus-von-Koeller

Thanks for reaching out @Titus-von-Koeller! We love how easily BnB unlocks our lowest memory use-cases. We'll definitely open a PR on your docs page featuring the integration.

Also, if there's anything you see in our code base related to our BnB integration that could be improved, don't hesitate to reach out or open a PR!

cc: @kartikayk

joecummings avatar Apr 30 '24 16:04 joecummings

Hi @Titus-von-Koeller, it's been some time so pinging this thread again to check if you're still open to us adding a torchtune integration to your docs page?

RdoubleA avatar Aug 05 '24 18:08 RdoubleA

@RdoubleA, sry this slipped my radar somehow. Lot's going on at the moment.

Yes, of course, you're welcome to contribute the PR in the bnb repo documenting the integration anytime you get around to it. Thanks and thanks as well for the great work on torchtune!

Titus-von-Koeller avatar Aug 26 '24 09:08 Titus-von-Koeller