ISLE icon indicating copy to clipboard operation
ISLE copied to clipboard

Helper Scripts for Fedora / Solr reindex give failures but tasks succeed.

Open g7morris opened this issue 6 years ago • 0 comments

Issue description

A) When attempting to call the two utility scripts from the host i.e. outside of the running container, the scripts cannot be found. Yet running them from inside the container work just fine.

B) When attempting to run the two utility scripts found on the fedora container, both ultimately succeed within their tasks but the SOLR script gives errors.

Steps to reproduce the issue

Issue A

  1. Follow steps from quick start guide to ensure a working and running isle.localdomain
  2. Ingest a few test objects
  3. Within a cli, run docker exec -it isle-fedora-ld bash /utility-scripts/rebuildFedora.sh

Issue B

  1. Follow steps from quick start guide to ensure a working and running isle.localdomain
  2. Ingest a few test objects
  3. Within a cli, run docker exec -it isle-fedora-ld bash
  4. cd /utility_scripts/
  5. ./updateSolrIndex.sh

What's the expected result?

Issue A

  • Output that indicates the commands are being run within the fedora container.

Issue B

  • After a brief delay (3 - 10 seconds) output confirming that the process has started and running.

  • Additionally being able to run these utility scripts out of the container.

What's the actual result?

Issue A

bash: /utility-scripts/rebuildFedora.sh: No such file or directory bash: /utility-scripts/updateSolrIndex.sh: No such file or directory

Issue B

Solr script output

1st attempt

./updateSolrIndex.sh

FedoraGenericSearch (FGS) update Solr index from Fedora helper script.
Starting to reindex your Fedora repository. This process runs in the background and may take some time.

FAILURE: Operation did not start or is not running as expected. Please contact the Islandora ISLE Google Group @ https://groups.google.com/forum/#!forum/islandora-isle

2nd attempt

root@6d3774b490c1:/utility_scripts# ./updateSolrIndex.sh

FedoraGenericSearch (FGS) update Solr index from Fedora helper script.
Starting to reindex your Fedora repository. This process runs in the background and may take some time.

Checked and this operation is still running. You may disconnect and the process will continue to run.
Find logs at /usr/local/tomcat/logs/fgs-update-foxml.out and /usr/local/tomcat/logs/fgs-update-foxml.err.
You can watch log file 'tail -f /usr/local/tomcat/logs/fedoragsearch.daily.log' as the process runs.

Result of tailing suggested log:

tail -f $CATALINA_HOME/logs/fedoragsearch.daily.log

            resultPageXslt=""
            dateTime="Thu Oct 11 18:37:08 GMT 2018">
   <updateIndex xmlns:dc="http://purl.org/dc/elements/1.1/"
                xmlns:foxml="info:fedora/fedora-system:def/foxml#"
                xmlns:zs="http://www.loc.gov/zing/srw/"
                warnCount="0"
                docCount="84"

Additional details / screenshot

  • I'm running isle.localdomain with volumes on a MacBook Pro with Docker for Mac.

Recommendation

  • A Readme.md should be placed at the base of this directory and git repo indicating how to use these tools.

  • The rebuildFedora.sh script should have more pauses as the output is confusing in terms of sequence. It shouldn't necessarily be running the MySQL Reindex in parallel until the initial set of reindex processes complete. It could be that the echo output gives an erroneous sequence of events confusing at least this user.

g7morris avatar Oct 11 '18 19:10 g7morris