Austin Welch
Austin Welch
Hi, do you happen to know how the optimization performance for this TVM based solution might compare to https://github.com/hidet-org/hidet for NVIDIA edge devices (like NVIDIA Jetson Xavier)? I'm curious to...
### Description I know this is a big feature request, but the addition of fine-tuning support would be nice as a component of this package. TorchGeo could probably be used...
### Description Since this project requires GDAL so the requirements are fairly complex to install, it would be very helpful to include a Dockerfile
### Feature request Hi, I was able to deploy the base Falcon-40B model to SageMaker using the TGI DLC by following [this blog post](https://www.philschmid.de/sagemaker-falcon-llm) I also recently fine-tuned the Falcon-40B...
### System Info After v0.0.226, the RecursiveCharacterTextSplitter seems to no longer separate properly at the end of sentences and now cuts many sentences mid-word. ### Who can help? _No response_...
Every URL that attempts to be processed gives me the following error: > An error occurred while processing the url https://www.kiplinger.com/investing/amazon-stock-is-a-top-pick-for-2023-analysts-say: Message: Can not connect to the Service /Users/austinmw/.wdm/drivers/chromedriver/mac_arm64/114.0.5735.90/chromedriver Any...
When fine-tuning and using `query_instruction_for_retrieval` should document instruction be blank?
If I followed the fine-tuning instructions and added a `query_instruction_for_retrieval`, should I use the same, different, or blank (`""`) instruction for the document ingestion part?
Hi, what is the name of the loss function used for fine-tuning? And could you please point me to where it is defined? Edit: looks like CrossEntropyLoss with In-Batch Negative...
### Feature Description Hi, would it be possible to add a feature which generates docker images for specified Llama Packs and optionally deploys them locally (or the images could be...
Hi is there plans to update this repository to be compatible with MMEngine?