Nick Dat Le

Can I download the original llama weights from here?

7

I would like to run the model in pytorch with the original weights if possible, thanks!

Original weights for LLAMA

2

Hey, I noticed the API is running on CPP, were the original weights in python or CPP? If in python, I would think they were in pytorch since that is...

Here is my simple code file: ``` from python import json with open('data.json', 'w') as f: json.dump([1, 2, 3], f) ``` And here is the error: :661:661: error: 'File' object...

Any future support for FastAPI?

4

Hi - I know this is the Django project, but is there any plans to support FastAPI? With the AI boom, a lot of companies are using FastAPI.

Is there any howto or instructions on how to get the player working on anroid with rtmp?

1

As stated in the title. I tried putting a RTMP URL into the network as a parameter, even with RTSP, no luck.

config.yml settings for OpenID Connect not working with nested hierarchy for roles

9

Hello, I can't seem to get roles working when the roles_key field is not a simple key-value pair. For example, this works: ```yaml authc: openid_auth_domain: http_enabled: true transport_enabled: true order:...

Exllama tutorials?

23

I'm new to exllama, are there any tutorials on how to use this? I'm trying this with the llama-2 70b model.

Do you think you can make an adapter for fastapi?

2

Do you think you can build one? How hard was it?