Francesco Virga

Realized there was a Kubernetes config issue on my end, Im able to run mixtral properly now using 2 X A100 80GB GPUs, sorry about that!

I tried adding it because telepresence would stop resolving to cluster DNS every time I connected to my vpn. I agree it doesn’t really make sense to add since the...

@thallgren Do you have any idea how I'd do this? I dont see any obvious options in the Tailscale DNS settings  ![Screenshot 2024-02-15...

Ive been experimenting today and it seems to have fixed the problem, thanks! I will re-open this if the problem re-occurs

Im using this library to count tokens: https://github.com/dqbd/tiktoken#readme its a fork of the python version