risedangel

### Feature request There are various serverless platforms that accepts dockerfiles as a start, maybe the ui can have a button to create a dockerfile. ### Motivation Serverless platforms are...

### 🚀 Feature one click installers for windows and linux ### Motivation As a newbie in LLM's i prefer focusing on my LLM rather than focusing on installations. As of...

Any planned support for unsloth ?

2

**Description** I have seen a new tool that promises nice benefits both for the speed and memory usage. Any chance for this to be added in? **Additional Context** https://github.com/unslothai/unsloth

Limit VRAM usage in serving the model

2

is it possible to limit "max_memory" while serving the model ?

How can i use this library with langchain or llama_index?

2

Hello, I have a RAG application that i want to use with fastgen. Is it possible to achieve such thing? Or ıs there any way i can "serve" the model...

Samsung DEX Two Seperate Cursors

1

First of all thank you for that amazing app. When i try to run the app with samsung dex, the app has its own cursor and i have my physical...

Add support for LISA ?

4

Hello any plans to support with LISA ? Arxiv: https://arxiv.org/pdf/2403.17919.pdf how it compares in the terms of VRAM usage ? standard 16 bit model fine tuning ?

Merhabalar Doğal dil işleme jargonuna pek hakim değilim hatam varsa bağışlayın. Mevcutta "yap" şeklindeki bir fiili State ve Transformation kullanarak gelecek zaman ("yapacak") gibi çekimlere dönüştürebiliyorum. Fakat "yapılması" formatına çevirmeyini...

FileNotFoundError: [Errno 2] No such file or directory: 'turkish_finite_state_machine.xml'

2

Merhaba ellerinize sağlık. Yukarıda bahsettiğim hatayı aldım. Githubınızda bulunan xml'i `site-packages\MorphologicalAnalysis\` ile aynı klasöre ekleyip, FiniteStateMachine.py dosyası 38. satırda `root = xml.etree.ElementTree.parse(fileName).getroot()` alanında fileName yerine direkt dosya yolu eklediğimde kod...

language as a parameter support

4

Can you add support so that we can add language as a parameter ? I am trying to use the diarization code given at the readme file and receiving the...