ludwig
ludwig copied to clipboard
ludwig-ai
Low-code framework for building custom LLMs, neural networks, and other AI models
This PR tries to solve the dependency problems we have when going forward to modern Python version. Things currently done: - moved from outdated build system and requirements files to...
**Describe the bug** pip install fails on Collecting PyYAML!=5.4.*,=3.12 (from ludwig) Using cached PyYAML-6.0.tar.gz (124 kB) **To Reproduce** pip install ludwig **Expected behavior** A clear and concise description of what...
DO NOT MERGE testing CI/CD pipeline
The [BERTTokenizer](https://github.com/ludwig-ai/ludwig/blob/00c51e0a286c3fa399a07a550e48d0f3deadc57d/ludwig/utils/tokenizers.py#L1109) is using torchtext. We want to remove torchtext as a dependency so this Tokenizer has to be refactored not using it.
**Describe the bug** I get error when trying install ludwig from source. Even I try many python version still the same. I also try install numpy first then re-try, but...
``` (base) ➜ jupyter git:(master) ✗ ./train.sh PyTorch version 2.0.0+cpu available. generated new fontManager /usr/local/lib/python3.8/site-packages/bitsandbytes/libbitsandbytes_cpu.so: undefined symbol: cadam32bit_grad_fp32 ███████████████████████ █ █ █ █ ▜█ █ █ █ █ █ █...
**Description** I'm encountering an error when installing ludwig[distributed] in a Jupyter Notebook environment running on a Dataproc cluster. The installation seems to proceed normally until it attempts to install scikit-learn,...
Hey @mhabedank , Not to add to your workload - I just noticed you closing lots of tickets and PRs recently. Just one suggestion (which you are already probably aware...
The [NgramTokenizer](https://github.com/ludwig-ai/ludwig/blob/00c51e0a286c3fa399a07a550e48d0f3deadc57d/ludwig/utils/tokenizers.py#L135) is using torchtext. We want to remove torchtext as a dependency so this Tokenizer has to be refactored not using it.
**Describe the bug** Could not install Ludwig on Kaggle to use it **To Reproduce** Steps to reproduce the behavior: 1. Create Notebook 2. run `!pip install ludwig` **Expected behavior** Ludwig...