grub-2.0
grub-2.0 copied to clipboard
Grub is an AI powered Web crawler.
Grub-2.0
Grub is a system for crawling and indexing documents and then running machine learning models to them. This is a work in progress.
Deploy a Solr "Neural" Indexer.
These scripts deploy a single Solr instance (9.1.0) running on Google Cloud.
There is also a Docker version of Solr available, if you don't use Google Cloud.
Option #1 - Run on Google Cloud
Change into the solr/scripts directory and create a file called secrets.sh:
$ vi secrets.sh
TOKEN=f00bar
:x
Now that's saved, deploy the instance:
$ ./deploy-solr.sh
Instance will be running in 2.5 minutes, listening on port 8389.
The URL for the admin interface looks like this: http://solr:[email protected]:8389
Option #2 - Run a Docker Container
You can also run Solr in a Docker container:
docker run -p 8983:8983 -t solr
API
Fastener
Deploy a controller box for managing spot Solr instances using an API. The scripts should be copied to Google Compute instance templates.
$ ./deploy-fastener.sh
Instance will be running and listening on port 80.