nnsight icon indicating copy to clipboard operation
nnsight copied to clipboard

Lightweight base `nnsight` installation

Open AdamBelfki3 opened this issue 9 months ago • 1 comments

Possible fixes:

  • Leverage setup.py to only install required dependencies dynamically.
  • Create optional dependencies stages, e.g. nnsight[vllm], nnsight[remote], nnsight[dev]...etc

AdamBelfki3 avatar Mar 18 '25 16:03 AdamBelfki3

Were you thinking of having pip install nnsight still install all dependencies by default and just provide some alternative light installations? (nnsight[base], nnsight[lm], ...) Or just having pip install nnsight install the bare minimum for the base NNsight class and then provide ways of installing dependencies for different classes (LanguageModel, VLLM etc)

MichaelRipa avatar Mar 21 '25 13:03 MichaelRipa