Stargraph
Stargraph copied to clipboard
Published
20 hours ago •
Lambda-3
Lambda-3
Startup instructions don't work on Mac OSX
I can't get the README instructions for spinning up a docker container to work.
docker for Mac installed
On macOS High Sierra Version 10.13.1
2.8 GHz and 8 i7 cores (4 dedicated to the docker machine) 16GB memory (8 dedicated to docker-machine)
mac:Stargraph hobs$ nano docker-compose.yml
mac:Stargraph hobs$ docker-machine --version
docker-machine version 0.13.0, build 9ba6da9
mac:Stargraph hobs$ docker-compose --version
docker-compose version 1.17.1, build 6d101fb
mac:Stargraph hobs$ docker --version
Docker version 17.09.1-ce, build 19e2cf6
In a Max OSX Terminal
All the required data/indices seem to be loaded:
mac:Stargraph hobs$ curl -XGET http://localhost:8917/_kb
["dbpedia-2016/entities","dbpedia-2016/facts","dbpedia-2016/relations","obama/entities","obama/facts","obama/relations"]
And the server container seems to boot up without crashing...
mac:Stargraph hobs$ docker-compose up
Starting stargraphv2 ...
Starting stargraphv2
Starting stargraphv2 ... done
Attaching to elastic, stargraphv2
stargraphv2 | STARGRAPH_JAVA_OPTS: -Xms7g -Xmx7g
stargraphv2 | 2017-12-16 21:40:59,896 INFO [core] Initializing obama.entities
stargraphv2 | 2017-12-16 21:41:01,752 INFO [core] Initializing obama.relations
stargraphv2 | 2017-12-16 21:41:01,782 INFO [core] Initializing obama.facts
stargraphv2 | 2017-12-16 21:41:01,909 INFO [core] Initializing dbpedia-2016.entities
stargraphv2 | 2017-12-16 21:41:01,936 INFO [core] Initializing dbpedia-2016.relations
stargraphv2 | 2017-12-16 21:41:01,961 INFO [core] Initializing dbpedia-2016.facts
stargraphv2 | 2017-12-16 21:41:02,016 INFO [core] Indexer: 'net.stargraph.core.index.DefaultIndexerFactory'
stargraphv2 | 2017-12-16 21:41:02,017 INFO [core] DS Service Endpoint: 'http://indra.lambda3.org/relatedness'
stargraphv2 | 2017-12-16 21:41:02,017 INFO [core] ★☆ Morgen Stern, 2.0.0-SNAPSHOT (97be5) ★☆
elastic | [2017-12-16T21:41:02,443][INFO ][o.e.n.Node ] [] initializing ...
elastic | [2017-12-16T21:41:02,567][INFO ][o.e.e.NodeEnvironment ] [ejB6sWq] using [1] data paths, mounts [[/usr/share/elasticsearch/data (osxfs)]], net usable_space [370.7gb], net total_space [465.7gb], spins? [possibly], types [fuse.osxfs]
elastic | [2017-12-16T21:41:02,567][INFO ][o.e.e.NodeEnvironment ] [ejB6sWq] heap size [6.9gb], compressed ordinary object pointers [true]
elastic | [2017-12-16T21:41:02,573][INFO ][o.e.n.Node ] node name [ejB6sWq] derived from node ID [ejB6sWq4QyGhK1nj1ba7AQ]; set [node.name] to override
elastic | [2017-12-16T21:41:02,584][INFO ][o.e.n.Node ] version[5.1.1], pid[1], build[5395e21/2016-12-06T12:36:15.409Z], OS[Linux/4.9.49-moby/amd64], JVM[Oracle Corporation/OpenJDK 64-Bit Server VM/1.8.0_111/25.111-b14]
elastic | [2017-12-16T21:41:03,779][INFO ][o.e.p.PluginsService ] [ejB6sWq] loaded module [aggs-matrix-stats]
elastic | [2017-12-16T21:41:03,779][INFO ][o.e.p.PluginsService ] [ejB6sWq] loaded module [ingest-common]
elastic | [2017-12-16T21:41:03,779][INFO ][o.e.p.PluginsService ] [ejB6sWq] loaded module [lang-expression]
elastic | [2017-12-16T21:41:03,779][INFO ][o.e.p.PluginsService ] [ejB6sWq] loaded module [lang-groovy]
elastic | [2017-12-16T21:41:03,779][INFO ][o.e.p.PluginsService ] [ejB6sWq] loaded module [lang-mustache]
elastic | [2017-12-16T21:41:03,779][INFO ][o.e.p.PluginsService ] [ejB6sWq] loaded module [lang-painless]
elastic | [2017-12-16T21:41:03,779][INFO ][o.e.p.PluginsService ] [ejB6sWq] loaded module [percolator]
elastic | [2017-12-16T21:41:03,779][INFO ][o.e.p.PluginsService ] [ejB6sWq] loaded module [reindex]
elastic | [2017-12-16T21:41:03,779][INFO ][o.e.p.PluginsService ] [ejB6sWq] loaded module [transport-netty3]
elastic | [2017-12-16T21:41:03,780][INFO ][o.e.p.PluginsService ] [ejB6sWq] loaded module [transport-netty4]
elastic | [2017-12-16T21:41:03,780][INFO ][o.e.p.PluginsService ] [ejB6sWq] no plugins loaded
elastic | [2017-12-16T21:41:04,143][WARN ][o.e.d.s.g.GroovyScriptEngineService] [groovy] scripts are deprecated, use [painless] scripts instead
stargraphv2 | 2017-12-16 21:41:05,315 INFO [server] Stargraph listening on http://0.0.0.0:8917
elastic | [2017-12-16T21:41:06,197][INFO ][o.e.n.Node ] initialized
elastic | [2017-12-16T21:41:06,197][INFO ][o.e.n.Node ] [ejB6sWq] starting ...
elastic | [2017-12-16T21:41:06,328][INFO ][o.e.t.TransportService ] [ejB6sWq] publish_address {172.18.0.3:9300}, bound_addresses {0.0.0.0:9300}
elastic | [2017-12-16T21:41:06,333][INFO ][o.e.b.BootstrapCheck ] [ejB6sWq] bound or publishing to a non-loopback or non-link-local address, enforcing bootstrap checks
elastic | [2017-12-16T21:41:09,433][INFO ][o.e.c.s.ClusterService ] [ejB6sWq] new_master {ejB6sWq}{ejB6sWq4QyGhK1nj1ba7AQ}{wf8VBvh5TYe_lb9w2EZoIA}{172.18.0.3}{172.18.0.3:9300}, reason: zen-disco-elected-as-master ([0] nodes joined)
elastic | [2017-12-16T21:41:09,468][INFO ][o.e.h.HttpServer ] [ejB6sWq] publish_address {172.18.0.3:9200}, bound_addresses {0.0.0.0:9200}
elastic | [2017-12-16T21:41:09,468][INFO ][o.e.n.Node ] [ejB6sWq] started
elastic | [2017-12-16T21:41:09,491][INFO ][o.e.g.GatewayService ] [ejB6sWq] recovered [0] indices into cluster_state
stargraphv2 | 2017-12-16 21:42:07,760 INFO [query] Loading Rules.
stargraphv2 | 2017-12-16 21:42:07,818 INFO [query] Loaded 102 Data Model Type patterns for 'EN'
stargraphv2 | 2017-12-16 21:42:07,848 INFO [query] Loaded 71 Stop patterns for 'EN'
stargraphv2 | 2017-12-16 21:42:07,856 INFO [query] Loaded 3 Query Type patterns for 'EN'
stargraphv2 | 2017-12-16 21:42:07,879 INFO [core] Main Namespaces: [dbr]
stargraphv2 | 2017-12-16 21:42:07,881 INFO [core] Namespace resource: default-namespace.txt
stargraphv2 | 2017-12-16 21:42:07,903 INFO [nli] Creating analyzer for 'EN'
stargraphv2 | 2017-12-16 21:42:11,484 INFO [nli] 'Who is the wife of Barack Obama?' analyzed in 3.577s
stargraphv2 | 2017-12-16 21:42:11,677 ERROR [query] Query Error 'Who is the wife of Barack Obama?'
stargraphv2 | org.elasticsearch.index.IndexNotFoundException: no such index
stargraphv2 | at org.elasticsearch.cluster.metadata.IndexNameExpressionResolver$WildcardExpressionResolver.infe(IndexNameExpressionResolver.java:660)
stargraphv2 | at org.elasticsearch.cluster.metadata.IndexNameExpressionResolver$WildcardExpressionResolver.innerResolve(IndexNameExpressionResolver.java:617)
stargraphv2 | at org.elasticsearch.cluster.metadata.IndexNameExpressionResolver$WildcardExpressionResolver.resolve(IndexNameExpressionResolver.java:567)
stargraphv2 | at org.elasticsearch.cluster.metadata.IndexNameExpressionResolver.concreteIndices(IndexNameExpressionResolver.java:164)
stargraphv2 | at org.elasticsearch.cluster.metadata.IndexNameExpressionResolver.concreteIndexNames(IndexNameExpressionResolver.java:139)
stargraphv2 | at org.elasticsearch.cluster.metadata.IndexNameExpressionResolver.concreteIndexNames(IndexNameExpressionResolver.java:135)
stargraphv2 | at org.elasticsearch.action.search.TransportSearchAction.doExecute(TransportSearchAction.java:99)
stargraphv2 | at org.elasticsearch.action.search.TransportSearchAction.doExecute(TransportSearchAction.java:53)
stargraphv2 | at org.elasticsearch.action.support.TransportAction$RequestFilterChain.proceed(TransportAction.java:173)
stargraphv2 | at org.elasticsearch.action.ingest.IngestActionFilter.apply(IngestActionFilter.java:82)
stargraphv2 | at org.elasticsearch.action.support.TransportAction$RequestFilterChain.proceed(TransportAction.java:171)
stargraphv2 | at org.elasticsearch.action.support.TransportAction.execute(TransportAction.java:145)
stargraphv2 | at org.elasticsearch.action.support.HandledTransportAction$TransportHandler.messageReceived(HandledTransportAction.java:64)
stargraphv2 | at org.elasticsearch.action.support.HandledTransportAction$TransportHandler.messageReceived(HandledTransportAction.java:54)
stargraphv2 | at org.elasticsearch.transport.RequestHandlerRegistry.processMessageReceived(RequestHandlerRegistry.java:69)
stargraphv2 | at org.elasticsearch.transport.TcpTransport$RequestHandler.doRun(TcpTransport.java:1385)
stargraphv2 | at org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37)
stargraphv2 | at org.elasticsearch.common.util.concurrent.EsExecutors$1.execute(EsExecutors.java:109)
stargraphv2 | at org.elasticsearch.transport.TcpTransport.handleRequest(TcpTransport.java:1343)
stargraphv2 | at org.elasticsearch.transport.TcpTransport.messageReceived(TcpTransport.java:1242)
stargraphv2 | at org.elasticsearch.transport.netty4.Netty4MessageChannelHandler.channelRead(Netty4MessageChannelHandler.java:74)
stargraphv2 | at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:373)
stargraphv2 | at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:359)
stargraphv2 | at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:351)
stargraphv2 | at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:293)
stargraphv2 | at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:280)
stargraphv2 | at io.netty.handler.codec.ByteToMessageDecoder.callDecode(ByteToMessageDecoder.java:396)
stargraphv2 | at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:248)
stargraphv2 | at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:373)
stargraphv2 | at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:359)
stargraphv2 | at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:351)
stargraphv2 | at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:86)
stargraphv2 | at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:373)
stargraphv2 | at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:359)
stargraphv2 | at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:351)
stargraphv2 | at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1334)
stargraphv2 | at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:373)
stargraphv2 | at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:359)
stargraphv2 | at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:926)
stargraphv2 | at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:129)
stargraphv2 | at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:651)
stargraphv2 | at io.netty.channel.nio.NioEventLoop.processSelectedKeysPlain(NioEventLoop.java:536)
stargraphv2 | at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:490)
stargraphv2 | at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:450)
stargraphv2 | at io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:873)
stargraphv2 | at java.lang.Thread.run(Thread.java:745)
stargraphv2 | 2017-12-16 21:42:11,685 INFO [query] Query Engine took 3.783s Response: NoResponse{'Who is the wife of Barack Obama?', mode='NLI'}
stargraphv2 | 2017-12-16 21:42:11,692 ERROR [server] Query execution failed: 'Who is the wife of Barack Obama?' on 'dbpedia-2016'
stargraphv2 | net.stargraph.StarGraphException: Query Error
stargraphv2 | at net.stargraph.core.query.QueryEngine.query(QueryEngine.java:98)
stargraphv2 | at net.stargraph.server.QueryResourceImpl.query(QueryResourceImpl.java:63)
stargraphv2 | at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
stargraphv2 | at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
stargraphv2 | at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
stargraphv2 | at java.lang.reflect.Method.invoke(Method.java:498)
stargraphv2 | at org.glassfish.jersey.server.model.internal.ResourceMethodInvocationHandlerFactory$1.invoke(ResourceMethodInvocationHandlerFactory.java:81)
stargraphv2 | at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher$1.run(AbstractJavaResourceMethodDispatcher.java:144)
stargraphv2 | at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher.invoke(AbstractJavaResourceMethodDispatcher.java:161)
stargraphv2 | at org.glassfish.jersey.server.model.internal.JavaResourceMethodDispatcherProvider$ResponseOutInvoker.doDispatch(JavaResourceMethodDispatcherProvider.java:160)
stargraphv2 | at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher.dispatch(AbstractJavaResourceMethodDispatcher.java:99)
stargraphv2 | at org.glassfish.jersey.server.model.ResourceMethodInvoker.invoke(ResourceMethodInvoker.java:389)
stargraphv2 | at org.glassfish.jersey.server.model.ResourceMethodInvoker.apply(ResourceMethodInvoker.java:347)
stargraphv2 | at org.glassfish.jersey.server.model.ResourceMethodInvoker.apply(ResourceMethodInvoker.java:102)
stargraphv2 | at org.glassfish.jersey.server.ServerRuntime$2.run(ServerRuntime.java:326)
stargraphv2 | at org.glassfish.jersey.internal.Errors$1.call(Errors.java:271)
stargraphv2 | at org.glassfish.jersey.internal.Errors$1.call(Errors.java:267)
stargraphv2 | at org.glassfish.jersey.internal.Errors.process(Errors.java:315)
stargraphv2 | at org.glassfish.jersey.internal.Errors.process(Errors.java:297)
stargraphv2 | at org.glassfish.jersey.internal.Errors.process(Errors.java:267)
stargraphv2 | at org.glassfish.jersey.process.internal.RequestScope.runInScope(RequestScope.java:317)
stargraphv2 | at org.glassfish.jersey.server.ServerRuntime.process(ServerRuntime.java:305)
stargraphv2 | at org.glassfish.jersey.server.ApplicationHandler.handle(ApplicationHandler.java:1154)
stargraphv2 | at org.glassfish.jersey.grizzly2.httpserver.GrizzlyHttpContainer.service(GrizzlyHttpContainer.java:384)
stargraphv2 | at org.glassfish.grizzly.http.server.HttpHandler$1.run(HttpHandler.java:224)
stargraphv2 | at org.glassfish.grizzly.threadpool.AbstractThreadPool$Worker.doWork(AbstractThreadPool.java:591)
stargraphv2 | at org.glassfish.grizzly.threadpool.AbstractThreadPool$Worker.run(AbstractThreadPool.java:571)
stargraphv2 | at java.lang.Thread.run(Thread.java:745)
stargraphv2 | Caused by: org.elasticsearch.index.IndexNotFoundException: no such index
stargraphv2 | at org.elasticsearch.cluster.metadata.IndexNameExpressionResolver$WildcardExpressionResolver.infe(IndexNameExpressionResolver.java:660)
stargraphv2 | at org.elasticsearch.cluster.metadata.IndexNameExpressionResolver$WildcardExpressionResolver.innerResolve(IndexNameExpressionResolver.java:617)
stargraphv2 | at org.elasticsearch.cluster.metadata.IndexNameExpressionResolver$WildcardExpressionResolver.resolve(IndexNameExpressionResolver.java:567)
stargraphv2 | at org.elasticsearch.cluster.metadata.IndexNameExpressionResolver.concreteIndices(IndexNameExpressionResolver.java:164)
stargraphv2 | at org.elasticsearch.cluster.metadata.IndexNameExpressionResolver.concreteIndexNames(IndexNameExpressionResolver.java:139)
stargraphv2 | at org.elasticsearch.cluster.metadata.IndexNameExpressionResolver.concreteIndexNames(IndexNameExpressionResolver.java:135)
stargraphv2 | at org.elasticsearch.action.search.TransportSearchAction.doExecute(TransportSearchAction.java:99)
stargraphv2 | at org.elasticsearch.action.search.TransportSearchAction.doExecute(TransportSearchAction.java:53)
stargraphv2 | at org.elasticsearch.action.support.TransportAction$RequestFilterChain.proceed(TransportAction.java:173)
stargraphv2 | at org.elasticsearch.action.ingest.IngestActionFilter.apply(IngestActionFilter.java:82)
stargraphv2 | at org.elasticsearch.action.support.TransportAction$RequestFilterChain.proceed(TransportAction.java:171)
stargraphv2 | at org.elasticsearch.action.support.TransportAction.execute(TransportAction.java:145)
stargraphv2 | at org.elasticsearch.action.support.HandledTransportAction$TransportHandler.messageReceived(HandledTransportAction.java:64)
stargraphv2 | at org.elasticsearch.action.support.HandledTransportAction$TransportHandler.messageReceived(HandledTransportAction.java:54)
stargraphv2 | at org.elasticsearch.transport.RequestHandlerRegistry.processMessageReceived(RequestHandlerRegistry.java:69)
stargraphv2 | at org.elasticsearch.transport.TcpTransport$RequestHandler.doRun(TcpTransport.java:1385)
stargraphv2 | at org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37)
stargraphv2 | at org.elasticsearch.common.util.concurrent.EsExecutors$1.execute(EsExecutors.java:109)
stargraphv2 | at org.elasticsearch.transport.TcpTransport.handleRequest(TcpTransport.java:1343)
stargraphv2 | at org.elasticsearch.transport.TcpTransport.messageReceived(TcpTransport.java:1242)
stargraphv2 | at org.elasticsearch.transport.netty4.Netty4MessageChannelHandler.channelRead(Netty4MessageChannelHandler.java:74)
stargraphv2 | at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:373)
stargraphv2 | at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:359)
stargraphv2 | at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:351)
stargraphv2 | at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:293)
stargraphv2 | at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:280)
stargraphv2 | at io.netty.handler.codec.ByteToMessageDecoder.callDecode(ByteToMessageDecoder.java:396)
stargraphv2 | at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:248)
stargraphv2 | at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:373)
stargraphv2 | at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:359)
stargraphv2 | at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:351)
stargraphv2 | at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:86)
stargraphv2 | at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:373)
stargraphv2 | at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:359)
stargraphv2 | at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:351)
stargraphv2 | at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1334)
stargraphv2 | at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:373)
stargraphv2 | at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:359)
stargraphv2 | at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:926)
stargraphv2 | at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:129)
stargraphv2 | at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:651)
stargraphv2 | at io.netty.channel.nio.NioEventLoop.processSelectedKeysPlain(NioEventLoop.java:536)
stargraphv2 | at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:490)
stargraphv2 | at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:450)
stargraphv2 | at io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:873)
stargraphv2 | ... 1 common frames omitted
In the client terminal (same Mac OSX host)
But queries don't work
mac:src hobs$ curl 'http://localhost:8917/_kb/dbpedia-2016/query?q=Who%20is%20the%20wife%20of%20Barak%20Obama?'
curl: (7) Failed to connect to localhost port 8917: Connection refused
mac:src hobs$ curl -v -XGET "http://localhost:8917/_kb/dbpedia-2016/query?q=Who%20is%20the%20wife%20of%20Barack%20Obama?"
Note: Unnecessary use of -X or --request, GET is already inferred.
* Trying ::1...
* TCP_NODELAY set
* Connected to localhost (::1) port 8917 (#0)
> GET /_kb/dbpedia-2016/query?q=Who%20is%20the%20wife%20of%20Barack%20Obama? HTTP/1.1
> Host: localhost:8917
> User-Agent: curl/7.55.1
> Accept: */*
>
< HTTP/1.1 500 Internal Server Error
< Date: Sat, 16 Dec 2017 21:42:11 GMT
< Connection: close
< Content-Length: 0
<
* Closing connection 0
mac:src hobs$ curl -v 'http://localhost:8917/_kb/dbpedia-2016/query?q=Who%20is%20the%20wife%20of%20Barack%20Obama?'
* Trying ::1...
* TCP_NODELAY set
* Connected to localhost (::1) port 8917 (#0)
> GET /_kb/dbpedia-2016/query?q=Who%20is%20the%20wife%20of%20Barack%20Obama? HTTP/1.1
> Host: localhost:8917
> User-Agent: curl/7.55.1
> Accept: */*
>
< HTTP/1.1 500 Internal Server Error
< Date: Sat, 16 Dec 2017 21:54:24 GMT
< Connection: close
< Content-Length: 0
<
* Closing connection 0
No, you have to load the kb first.
I.E.:
curl -XPOST "http://localhost:8917/_kb/dbpedia-2016/_load"
That'll download the DBpedia dump (approx. ~~30~~ 3GB iirc)
For a small subset use the obama KB.
Pretty sure I did that. The output shows DBpedial loaded. Perhaps the download wasn't complete?
--Hobson
On Mon, Dec 18, 2017 at 6:32 AM, Viktor Schlegel [email protected] wrote:
No, you have to load the kb first. I.E.: curl -XPOST "http://localhost:8917/_kb/dbpedia-2016/_load" That'll download the DBpedia dump (approx. 30GB iirc) For a small subset use the obama KB.
— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub https://github.com/Lambda-3/Stargraph/issues/27#issuecomment-352441629, or mute the thread https://github.com/notifications/unsubscribe-auth/AAR39wX_DM4KJAr28K--1nar97MdkLsdks5tBndggaJpZM4REeEt .
Your output
elastic | [2017-12-16T21:41:09,491][INFO ][o.e.g.GatewayService ] [ejB6sWq] recovered [0] indices into cluster_state
hints that the ES indices (used for semantic approximation) are not created (nor populated). In order to do so you have to load the knowledge base. This process downloads the knowledge base and creates the indices after that. As it takes some time it is entirely possible, that the process was not completed. At the moment, there is no implementation to check the indexing progress over the REST interface, so you have to verify that all data was loaded and indexed by checking the log for a
"Successful: [dbpedia-2016.entities ...
message. Please note that
curl -XGET http://localhost:8917/_kb
only lists the knowledge bases which are preconfigured to use, it does not indicate whether the knowledge bases were actually initialized (i.e. downloaded and indexed).
I suggest you try to initialize the knowledge bases again and then check the log output for suspicious activity (such as Fail to load, failing: or some exceptions)
Hope I could help you, regards
Awesome! Trying now.
--Hobson
On Wed, Dec 20, 2017 at 7:29 AM, Viktor Schlegel [email protected] wrote:
Your output
elastic | [2017-12-16T21:41:09,491][INFO ][o.e.g.GatewayService ] [ejB6sWq] recovered [0] indices into cluster_state
hints that the ES indices (used for semantic approximation) are not created (nor populated). In order to do so you have to load the knowledge base. This process downloads the knowledge base and creates the indices after that. As it takes some time it is entirely possible, that the process was not completed. At the moment, there is no implementation to check the indexing progress over the REST interface, so you have to verify that all data was loaded and indexed by checking the log for a
"Successful: [dbpedia-2016.entities ...
message. Please note that
curl -XGET http://localhost:8917/_kb
only lists the knowledge bases which are preconfigured to use, it does not indicate whether the knowledge bases were actually initialized (i.e. downloaded and indexed).
I suggest you try to initialize the knowledge bases again and then check the log output for suspicious activity (such as Fail to load, failing: or some exceptions)
Hope I could help you, regards
— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub https://github.com/Lambda-3/Stargraph/issues/27#issuecomment-353094097, or mute the thread https://github.com/notifications/unsubscribe-auth/AAR3989j3aEIxWSp8oG9mZwV3we09jeUks5tCSfagaJpZM4REeEt .
Unfortunately, the DB seems to have failed to load, without any indication as to why. The download seems to go fine, loading into the DB does not.
elastic | [2017-12-21T00:03:02,753][INFO ][o.e.n.Node ] initialized
elastic | [2017-12-21T00:03:02,753][INFO ][o.e.n.Node ] [ejB6sWq] starting ...
elastic | [2017-12-21T00:03:03,122][INFO ][o.e.t.TransportService ] [ejB6sWq] publish_address {172.18.0.2:9300}, bound_addresses {0.0.0.0:9300}
elastic | [2017-12-21T00:03:03,141][INFO ][o.e.b.BootstrapCheck ] [ejB6sWq] bound or publishing to a non-loopback or non-link-local address, enforcing bootstrap checks
elastic | [2017-12-21T00:03:06,389][INFO ][o.e.c.s.ClusterService ] [ejB6sWq] new_master {ejB6sWq}{ejB6sWq4QyGhK1nj1ba7AQ}{xg_KZf3QTq6YnJX5U9FvXQ}{172.18.0.2}{172.18.0.2:9300}, reason: zen-disco-elected-as-master ([0] nodes joined)
elastic | [2017-12-21T00:03:06,430][INFO ][o.e.h.HttpServer ] [ejB6sWq] publish_address {172.18.0.2:9200}, bound_addresses {0.0.0.0:9200}
elastic | [2017-12-21T00:03:06,431][INFO ][o.e.n.Node ] [ejB6sWq] started
elastic | [2017-12-21T00:03:06,448][INFO ][o.e.g.GatewayService ] [ejB6sWq] recovered [0] indices into cluster_state
stargraphv2 | 2017-12-21 00:05:25,001 WARN [core] Loading ALL DATA of 'dbpedia-2016'. This can take some time ;) ..
stargraphv2 | 2017-12-21 00:05:25,005 INFO [index] Loading dbpedia-2016.relations, [reset=true, limit=-1]
stargraphv2 | 2017-12-21 00:05:25,015 WARN [index] Old data will be DELETED!
stargraphv2 | 2017-12-21 00:05:25,025 INFO [index] Awaiting Loader finalization..
stargraphv2 | 2017-12-21 00:05:25,059 INFO [core] Downloading from: 'http://data.lambda3.org/dbpedia_en-2016.hdt'
stargraphv2 | 2017-12-21 00:20:31,935 INFO [core] Loading '/usr/share/stargraph/data/dbpedia-2016/facts/triples.hdt', useIndex=false
elastic exited with code 137
stargraphv2 | 2017-12-21 00:21:39,427 INFO [core] Main Namespaces: [dbr]
stargraphv2 | 2017-12-21 00:21:39,436 INFO [core] Namespace resource: default-namespace.txt
stargraphv2 | 2017-12-21 00:21:39,476 INFO [core] Creating dbpedia-2016.relations data provider
stargraphv2 | 2017-12-21 00:21:39,864 INFO [core] processors = ProcessorChain{chain=[length-filter, stop-property-filter, sink-duplicate, wordnet]}
stargraphv2 | 2017-12-21 00:21:39,878 ERROR [index] Loader failure.
stargraphv2 | net.stargraph.core.index.IndexingException: Indexing Error
stargraphv2 | at net.stargraph.core.impl.elastic.ElasticIndexer.beforeLoad(ElasticIndexer.java:82)
stargraphv2 | at net.stargraph.core.index.BaseIndexer.doBeforeLoad(BaseIndexer.java:154)
stargraphv2 | at net.stargraph.core.index.BaseIndexer.lambda$doLoad$0(BaseIndexer.java:215)
stargraphv2 | at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
stargraphv2 | at java.util.concurrent.FutureTask.run(FutureTask.java:266)
stargraphv2 | at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
stargraphv2 | at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
stargraphv2 | at java.lang.Thread.run(Thread.java:745)
stargraphv2 | Caused by: org.elasticsearch.client.transport.NoNodeAvailableException: None of the configured nodes are available: [{#transport#-1}{4t3h2d7GSay6LjMuFWAfBg}{elastic}{172.18.0.2:9300}]
stargraphv2 | at org.elasticsearch.client.transport.TransportClientNodesService.ensureNodesAreAvailable(TransportClientNodesService.java:328)
stargraphv2 | at org.elasticsearch.client.transport.TransportClientNodesService.execute(TransportClientNodesService.java:226)
stargraphv2 | at org.elasticsearch.client.transport.TransportProxyClient.execute(TransportProxyClient.java:59)
stargraphv2 | at org.elasticsearch.client.transport.TransportClient.doExecute(TransportClient.java:345)
stargraphv2 | at org.elasticsearch.client.support.AbstractClient.execute(AbstractClient.java:403)
stargraphv2 | at org.elasticsearch.client.support.AbstractClient$IndicesAdmin.execute(AbstractClient.java:1226)
stargraphv2 | at org.elasticsearch.action.ActionRequestBuilder.execute(ActionRequestBuilder.java:80)
stargraphv2 | at org.elasticsearch.action.ActionRequestBuilder.execute(ActionRequestBuilder.java:54)
stargraphv2 | at org.elasticsearch.action.ActionRequestBuilder.get(ActionRequestBuilder.java:62)
stargraphv2 | at net.stargraph.core.impl.elastic.ElasticIndexer.beforeLoad(ElasticIndexer.java:68)
stargraphv2 | ... 7 common frames omitted
stargraphv2 | 2017-12-21 00:21:39,884 INFO [index] Loader is finishing..
stargraphv2 | 2017-12-21 00:21:39,892 WARN [index] Nothing was loaded!
stargraphv2 | 2017-12-21 00:21:39,893 INFO [index] Loader is done.
stargraphv2 | 2017-12-21 00:21:39,900 ERROR [core] Fail to load dbpedia-2016.relations
stargraphv2 | 2017-12-21 00:21:39,910 INFO [index] Loading dbpedia-2016.facts, [reset=true, limit=-1]
stargraphv2 | 2017-12-21 00:21:39,912 WARN [index] Old data will be DELETED!
stargraphv2 | 2017-12-21 00:21:39,914 INFO [index] Awaiting Loader finalization..
stargraphv2 | 2017-12-21 00:21:39,947 INFO [core] Main Namespaces: [dbr]
stargraphv2 | 2017-12-21 00:21:39,962 INFO [core] Namespace resource: default-namespace.txt
stargraphv2 | 2017-12-21 00:21:39,978 INFO [core] Creating dbpedia-2016.facts data provider
stargraphv2 | 2017-12-21 00:21:39,993 INFO [core] processors = ProcessorChain{chain=[length-filter, entity-classifier, regex-filter]}
stargraphv2 | 2017-12-21 00:21:39,997 ERROR [index] Loader failure.
stargraphv2 | net.stargraph.core.index.IndexingException: Indexing Error
stargraphv2 | at net.stargraph.core.impl.elastic.ElasticIndexer.beforeLoad(ElasticIndexer.java:82)
stargraphv2 | at net.stargraph.core.index.BaseIndexer.doBeforeLoad(BaseIndexer.java:154)
stargraphv2 | at net.stargraph.core.index.BaseIndexer.lambda$doLoad$0(BaseIndexer.java:215)
stargraphv2 | at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
stargraphv2 | at java.util.concurrent.FutureTask.run(FutureTask.java:266)
stargraphv2 | at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
stargraphv2 | at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
stargraphv2 | at java.lang.Thread.run(Thread.java:745)
stargraphv2 | Caused by: org.elasticsearch.client.transport.NoNodeAvailableException: None of the configured nodes are available: [{#transport#-1}{rjiSzc7oQHCs_A4xVK0K-g}{elastic}{172.18.0.2:9300}]
stargraphv2 | at org.elasticsearch.client.transport.TransportClientNodesService.ensureNodesAreAvailable(TransportClientNodesService.java:328)
stargraphv2 | at org.elasticsearch.client.transport.TransportClientNodesService.execute(TransportClientNodesService.java:226)
stargraphv2 | at org.elasticsearch.client.transport.TransportProxyClient.execute(TransportProxyClient.java:59)
stargraphv2 | at org.elasticsearch.client.transport.TransportClient.doExecute(TransportClient.java:345)
stargraphv2 | at org.elasticsearch.client.support.AbstractClient.execute(AbstractClient.java:403)
stargraphv2 | at org.elasticsearch.client.support.AbstractClient$IndicesAdmin.execute(AbstractClient.java:1226)
stargraphv2 | at org.elasticsearch.action.ActionRequestBuilder.execute(ActionRequestBuilder.java:80)
stargraphv2 | at org.elasticsearch.action.ActionRequestBuilder.execute(ActionRequestBuilder.java:54)
stargraphv2 | at org.elasticsearch.action.ActionRequestBuilder.get(ActionRequestBuilder.java:62)
stargraphv2 | at net.stargraph.core.impl.elastic.ElasticIndexer.beforeLoad(ElasticIndexer.java:68)
stargraphv2 | ... 7 common frames omitted
stargraphv2 | 2017-12-21 00:21:40,001 INFO [index] Loader is finishing..
stargraphv2 | 2017-12-21 00:21:40,002 WARN [index] Nothing was loaded!
stargraphv2 | 2017-12-21 00:21:40,004 INFO [index] Loader is done.
stargraphv2 | 2017-12-21 00:21:40,006 ERROR [core] Fail to load dbpedia-2016.facts
stargraphv2 | 2017-12-21 00:21:40,008 INFO [index] Loading dbpedia-2016.entities, [reset=true, limit=-1]
stargraphv2 | 2017-12-21 00:21:40,011 WARN [index] Old data will be DELETED!
stargraphv2 | 2017-12-21 00:21:40,013 INFO [index] Awaiting Loader finalization..
stargraphv2 | 2017-12-21 00:21:40,017 INFO [core] Main Namespaces: [dbr]
stargraphv2 | 2017-12-21 00:21:40,018 INFO [core] Namespace resource: default-namespace.txt
stargraphv2 | 2017-12-21 00:21:40,095 INFO [core] Creating dbpedia-2016.entities data provider
stargraphv2 | 2017-12-21 00:21:40,481 INFO [core] processors = ProcessorChain{chain=[length-filter, sink-duplicate]}
stargraphv2 | 2017-12-21 00:21:40,484 ERROR [index] Loader failure.
stargraphv2 | net.stargraph.core.index.IndexingException: Indexing Error
stargraphv2 | at net.stargraph.core.impl.elastic.ElasticIndexer.beforeLoad(ElasticIndexer.java:82)
stargraphv2 | at net.stargraph.core.index.BaseIndexer.doBeforeLoad(BaseIndexer.java:154)
stargraphv2 | at net.stargraph.core.index.BaseIndexer.lambda$doLoad$0(BaseIndexer.java:215)
stargraphv2 | at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
stargraphv2 | at java.util.concurrent.FutureTask.run(FutureTask.java:266)
stargraphv2 | at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
stargraphv2 | at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
stargraphv2 | at java.lang.Thread.run(Thread.java:745)
stargraphv2 | Caused by: org.elasticsearch.client.transport.NoNodeAvailableException: None of the configured nodes are available: [{#transport#-1}{ke_kjhNySAezH7s638SNQQ}{elastic}{172.18.0.2:9300}]
stargraphv2 | at org.elasticsearch.client.transport.TransportClientNodesService.ensureNodesAreAvailable(TransportClientNodesService.java:328)
stargraphv2 | at org.elasticsearch.client.transport.TransportClientNodesService.execute(TransportClientNodesService.java:226)
stargraphv2 | at org.elasticsearch.client.transport.TransportProxyClient.execute(TransportProxyClient.java:59)
stargraphv2 | at org.elasticsearch.client.transport.TransportClient.doExecute(TransportClient.java:345)
stargraphv2 | at org.elasticsearch.client.support.AbstractClient.execute(AbstractClient.java:403)
stargraphv2 | at org.elasticsearch.client.support.AbstractClient$IndicesAdmin.execute(AbstractClient.java:1226)
stargraphv2 | at org.elasticsearch.action.ActionRequestBuilder.execute(ActionRequestBuilder.java:80)
stargraphv2 | at org.elasticsearch.action.ActionRequestBuilder.execute(ActionRequestBuilder.java:54)
stargraphv2 | at org.elasticsearch.action.ActionRequestBuilder.get(ActionRequestBuilder.java:62)
stargraphv2 | at net.stargraph.core.impl.elastic.ElasticIndexer.beforeLoad(ElasticIndexer.java:68)
stargraphv2 | ... 7 common frames omitted
stargraphv2 | 2017-12-21 00:21:40,488 INFO [index] Loader is finishing..
stargraphv2 | 2017-12-21 00:21:40,489 WARN [index] Nothing was loaded!
stargraphv2 | 2017-12-21 00:21:40,490 INFO [index] Loader is done.
stargraphv2 | 2017-12-21 00:21:40,491 ERROR [core] Fail to load dbpedia-2016.entities
stargraphv2 | 2017-12-21 00:21:40,492 WARN [core] Sucessful: [], failing: [dbpedia-2016.relations, dbpedia-2016.facts, dbpedia-2016.entities]
stargraphv2 | Caused by: org.elasticsearch.client.transport.NoNodeAvailableException: None of the configured nodes are available: [{#transport#-1}{4t3h2d7GSay6LjMuFWAfBg}{elastic}{172.18.0.2:9300}]
aah yes.
Try this docker-config.yml
version: '2'
services:
elastic:
image: elasticsearch:5.4.0
container_name: elastic
command: "-Ecluster.name=StarGraphV2Cluster -Ebootstrap.memory_lock=true -Ediscovery.zen.minimum_master_nodes=1 -Ecluster.routing.allocation.disk.threshold_enabled=false -Etransport.host=0.0.0.0 -Ediscovery.type=single-node"
expose:
- 9300
volumes:
- ./esdata:/usr/share/elasticsearch/data
ulimits:
memlock:
soft: -1
hard: -1
nofile:
soft: 65536
hard: 65536
mem_limit: 8g
cap_add:
- IPC_LOCK
environment:
- "ES_JAVA_OPTS=-Xms7g -Xmx7g"
stargraph:
image: lambdacube/stargraph:latest
container_name: stargraphv2
ports:
- 8917:8917
volumes:
- ./logs:/usr/share/stargraph/logs
- ./data:/usr/share/stargraph/data
mem_limit: 8g
environment:
- "STARGRAPH_JAVA_OPTS=-Xms7g -Xmx7g"
note the
-Etransport.host=0.0.0.0 -Ediscovery.type=single-node
appendix.
I couldn't get it to run with the provided docker-compose.yml either - for elastic 5.1 it would crash on startup due to some bug, additionally you have to allow elastic to listen to "0.0.0.0" in order to be able to access it from outside the elastic docker container, which would fail the bootstrap check for me until I added -Ediscovery.type=single-node which is only available from elastic 5.4 on.
Greetings