haystack-demos icon indicating copy to clipboard operation
haystack-demos copied to clipboard

Both demos broken

Open wochinge opened this issue 1 year ago • 1 comments

Seems both demos are currently broken:

  • explore_the_world: broken because ElasticSearch fails to come up
explore_the_world-elasticsearch-1  | {"type": "server", "timestamp": "2023-03-31T11:48:07,987Z", "level": "ERROR", "component": "o.e.i.g.GeoIpDownloader", "cluster.name": "docker-cluster", "node.name": "397ae3798dd8", "message": "exception during geoip databases update", "cluster.uuid": "5oCHsPiTRL2jIKWM9n1Ccg", "node.id": "1KZabzNUQC2r0Pwhu8Eaag" ,
explore_the_world-elasticsearch-1  | "stacktrace": ["org.elasticsearch.ElasticsearchException: not all primary shards of [.geoip_databases] index are active",
explore_the_world-elasticsearch-1  | "at org.elasticsearch.ingest.geoip.GeoIpDownloader.updateDatabases(GeoIpDownloader.java:137) ~[ingest-geoip-7.17.6.jar:7.17.6]",
explore_the_world-elasticsearch-1  | "at org.elasticsearch.ingest.geoip.GeoIpDownloader.runDownloader(GeoIpDownloader.java:284) [ingest-geoip-7.17.6.jar:7.17.6]",
explore_the_world-elasticsearch-1  | "at org.elasticsearch.ingest.geoip.GeoIpDownloaderTaskExecutor.nodeOperation(GeoIpDownloaderTaskExecutor.java:100) [ingest-geoip-7.17.6.jar:7.17.6]",
explore_the_world-elasticsearch-1  | "at org.elasticsearch.ingest.geoip.GeoIpDownloaderTaskExecutor.nodeOperation(GeoIpDownloaderTaskExecutor.java:46) [ingest-geoip-7.17.6.jar:7.17.6]",
explore_the_world-elasticsearch-1  | "at org.elasticsearch.persistent.NodePersistentTasksExecutor$1.doRun(NodePersistentTasksExecutor.java:42) [elasticsearch-7.17.6.jar:7.17.6]",
explore_the_world-elasticsearch-1  | "at org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingAbstractRunnable.doRun(ThreadContext.java:777) [elasticsearch-7.17.6.jar:7.17.6]",
explore_the_world-elasticsearch-1  | "at org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:26) [elasticsearch-7.17.6.jar:7.17.6]",
explore_the_world-elasticsearch-1  | "at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) [?:?]",
explore_the_world-elasticsearch-1  | "at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) [?:?]",
explore_the_world-elasticsearch-1  | "at java.lang.Thread.run(Thread.java:833) [?:?]"] }
  • airgapped-rest_api
❯ dc up
[+] Running 0/1
 ⠿ haystack-airgapped Warning                                                                                                                                                                                                                                                                                            1.9s
[+] Building 2.2s (7/8)
 => [internal] load build definition from Dockerfile                                                                                                                                                                                                                                                                     0.0s
 => => transferring dockerfile: 69B                                                                                                                                                                                                                                                                                      0.0s
 => [internal] load .dockerignore                                                                                                                                                                                                                                                                                        0.0s
 => => transferring context: 2B                                                                                                                                                                                                                                                                                          0.0s
 => [internal] load metadata for docker.io/deepset/haystack:cpu-v1.14.0                                                                                                                                                                                                                                                  2.1s
 => CANCELED [1/4] FROM docker.io/deepset/haystack:cpu-v1.14.0@sha256:e9a61db2d143303b8bf8409544e94dde0b59a2842a0471a9e19d6f3d31801a4a                                                                                                                                                                                   0.0s
 => => resolve docker.io/deepset/haystack:cpu-v1.14.0@sha256:e9a61db2d143303b8bf8409544e94dde0b59a2842a0471a9e19d6f3d31801a4a                                                                                                                                                                                            0.0s
 => => sha256:e9a61db2d143303b8bf8409544e94dde0b59a2842a0471a9e19d6f3d31801a4a 1.61kB / 1.61kB                                                                                                                                                                                                                           0.0s
 => => sha256:dc77f5a8317c824d70e98ace1604c962112a6d76178196a9e4370f800b3d89e4 2.59kB / 2.59kB                                                                                                                                                                                                                           0.0s
 => [internal] load build context                                                                                                                                                                                                                                                                                        0.0s
 => => transferring context: 173B                                                                                                                                                                                                                                                                                        0.0s
 => CACHED [2/4] RUN python3 -c "from haystack.utils.docker import cache_models;cache_models(['sentence-transformers/all-MiniLM-L6-v2'])"                                                                                                                                                                                0.0s
 => ERROR [3/4] COPY local_farm_minilm /opt/models/fine-tuned-reader                                                                                                                                                                                                                                                     0.0s
------
 > [3/4] COPY local_farm_minilm /opt/models/fine-tuned-reader:
------
failed to solve: failed to compute cache key: "/local_farm_minilm" not found: not found

wochinge avatar Mar 31 '23 11:03 wochinge

@wochinge The airgapped demo is supposed to throw the error: Because it's for education purposes and not for anyone just to use it directly. I agree this should be documented better but the Dockerfile mentions this limitation already.

The following lines will copy the models we downloaded previously into the Docker image. We need to specify both the local path containing the model (local_model_path) and the path inside the Docker image where we want to copy it (container_model_path). NOTE: make sure to use the same value you passed to container_model_path for the model_path field inside the pipeline definition file (in this case, retriever_reader.yml)

mayankjobanputra avatar Mar 31 '23 12:03 mayankjobanputra