dalai icon indicating copy to clipboard operation
dalai copied to clipboard

Published 20 hours ago • verified publisher icon cocktailpeanut

Document System Requirements

Open jcuenod opened this issue 1 year ago • 3 comments

Firstly, this looks super helpful, thank you :)

Given my limited compute (only a relatively dated CPU), could you document system requirements.

  • How much RAM is necessary? How much is recommended?
  • Is there a minimum CPU requirement (or architecture/GPU...)? (I assume this could work on x86, what about aarch64?)
  • At the minimum specs, what sort of speed token generation is to be expected?

Even a simple list of tokens per second on various metal configurations would be helpful. Thanks!

jcuenod avatar Mar 13 '23 19:03 jcuenod

Related, you also need the following requirements pre-installed

  • gcc
  • g++
  • pip
  • make
  • npm install node-gyp

lrvl avatar Mar 13 '23 20:03 lrvl

I have personally successfully tested this solution for Fedora : npm install -g node-gyp sudo dnf install make automake gcc gcc-c++ kernel-devel (= build-essential for ubuntu)

sylvain-reynaud avatar Mar 13 '23 20:03 sylvain-reynaud

Requirements would be great, maybe just put your token/sec speed with your reference system in the readme.

MentalGear avatar Mar 14 '23 09:03 MentalGear