grub-2.0 icon indicating copy to clipboard operation
grub-2.0 copied to clipboard

Grub is an AI powered Web crawler.

Grub-2.0

Grub is a system for crawling and indexing documents and then running machine learning models to them. This is a work in progress.

Deploy a Solr "Neural" Indexer.

These scripts deploy a single Solr instance (9.1.0) running on Google Cloud.

There is also a Docker version of Solr available, if you don't use Google Cloud.

Option #1 - Run on Google Cloud

Change into the solr/scripts directory and create a file called secrets.sh:

$ vi secrets.sh
TOKEN=f00bar
:x

Now that's saved, deploy the instance:

$ ./deploy-solr.sh

Instance will be running in 2.5 minutes, listening on port 8389.

The URL for the admin interface looks like this: http://solr:[email protected]:8389

Option #2 - Run a Docker Container

You can also run Solr in a Docker container:

 docker run -p 8983:8983 -t solr

API

Fastener

Deploy a controller box for managing spot Solr instances using an API. The scripts should be copied to Google Compute instance templates.

$ ./deploy-fastener.sh

Instance will be running and listening on port 80.