sycamore
sycamore copied to clipboard
aryn-ai
🍁 Sycamore is an LLM-powered search and analytics platform for unstructured data.
* Remove some unused generate_* functions * Adjust transforms to import the generate function from the original source rather than map since map no longer uses them. Ideally we'll remove...
Looks like the driver/worker process model ser/de incompatible, move model instantiation inside worker process to get rid of the ser/de. ``` RuntimeError: Attempting to deserialize object on a CUDA device...
now `runtests.sh` also builds images for a tag specified at runtime and pushes them to dockerhub, using a registry cache (also in dockerhub) also push test results to s3 (`s3://sycamore-ci//`)
**Describe the bug** Running `poetry run pytest sycamore/tests/unit/` from the project root folder throws: > ERROR: file or directory not found: sycamore/tests/unit/ **To Reproduce** Steps to reproduce the behavior: 1....
The ndd_example notebook relies on data being loaded, so it doesn't make sense to run every time. This change explicitly lists all the notebooks to test and omits that one.
[root@bl1 sycamore]# docker compose run sycamore_crawler_http https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5385863/pdf/cro-0010-0008.pdf WARN[0000] /home/chutian/sycamore/compose.yaml: `version` is obsolete [+] Running 18/18 ✔ sycamore_crawler_http 17 layers [⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿] 0B/0B Pulled 21.0s ✔ 71215d55680c Already exists 0.0s ✔ 3cb8f9c23302...
**Describe the bug** When using gpt-3.5 in the extract_properties transform, the resulting 'entity' object doesn't always have the same schema. In some cases the types of the fields within 'entity'...
