Chansung Park
Chansung Park
In the original concept, `range_config` should work for `{SPAN}` in `ExampleGen`. However there is a bug in TFX < `1.4.0`. As of writing this issue, the bug fix has been...
Did you simply use the same script from Alpaca? or do you have your own version?
from the README from `/scripts`. ```yaml datasets_mixer: dataset_1: 0.5 # Use 50% of the training examples dataset_2: 0.66 # Use 66% of the training examples dataset_3: 0.10 # Use 10%...
For QLoRA+FSDP support, the dependencies should be updated: - `bitsandbytes>=0.43.0` - `accelerate>=0.28.0` - `transformers>4.38.2` - `trl>0.7.11` - `peft>0.9.0` Also, it would be wonderful to have accelerate recipe for this too.
This issue is to discuss if it is worth trying to add an additional GitHub Action to evaluate the latest trained model when we have more fresh data. It assumes...
In-depth Detailed Comprehensive Thorough Analytical Insightful Nuanced Specific Focused Intensive General Overview Broad Wide-ranging Sweeping Expansive Global Universal All-encompassing Holistic Diverse Varied Eclectic Multifaceted Wide-ranging Divergent Heterogeneous Mixed Assorted Comprehensive...