SemWeb2NL icon indicating copy to clipboard operation
SemWeb2NL copied to clipboard

After some time alive AVATAR stop returning summaries

Open yamalight opened this issue 7 years ago • 3 comments

At some point AVATAR stops giving out summaries at all and starts throwing the following errors:

cls<http://dbpedia.org/ontology/SoccerPlayer>                                                                                                                                                                                                                   
Cluster = [[http://dbpedia.org/ontology/Person/height, http://dbpedia.org/ontology/height], [http://dbpedia.org/ontology/birthPlace], [http://dbpedia.org/ontology/birthYear, http://dbpedia.org/ontology/birthDate], [http://dbpedia.org/ontology/careerStation
, http://dbpedia.org/ontology/position], [http://www.w3.org/ns/prov#wasDerivedFrom, http://dbpedia.org/ontology/team]]                                                                                                                                          
TP:http://dbpedia.org/resource/Neymar @http://dbpedia.org/ontology/birthPlace http://dbpedia.org/resource/São_Paulo -> Neymar's birth place is São Paulo                                                                                                        
TP:http://dbpedia.org/resource/Neymar @http://dbpedia.org/ontology/birthPlace http://dbpedia.org/resource/Mogi_das_Cruzes -> Neymar's birth place is Mogi das Cruzes                                                                                            
TP:http://dbpedia.org/resource/Neymar @http://dbpedia.org/ontology/position http://dbpedia.org/resource/Forward_(association_football) -> Neymar's position is Forward (association football)                                                                   
                                                                                                                                                                                                                                                                
java.lang.NullPointerException                                                                                                                                                                                                                                  
        at org.apache.commons.collections15.map.LRUMap.reuseMapping(LRUMap.java:279)                                                                                                                                                                            
        at org.apache.commons.collections15.map.LRUMap.addMapping(LRUMap.java:250)                                                                                                                                                                              
        at org.apache.commons.collections15.map.AbstractHashedMap.put(AbstractHashedMap.java:296)                                                                                                                                                               
        at org.aksw.triple2nl.converter.DefaultIRIConverter.convert(DefaultIRIConverter.java:195)                                                                                                                                                               
        at org.aksw.triple2nl.converter.DefaultIRIConverter.convert(DefaultIRIConverter.java:131)                                                                                                                                                               
        at org.aksw.triple2nl.TripleConverter.processResourceNode(TripleConverter.java:608)                                                                                                                                                                     
        at org.aksw.triple2nl.TripleConverter.processObject(TripleConverter.java:656)                                                                                                                                                                           
        at org.aksw.triple2nl.TripleConverter.convertToPhrase(TripleConverter.java:352)                                                                                                                                                                         
        at org.aksw.sparql2nl.naturallanguagegeneration.SimpleNLGwithPostprocessing.getNLForTriple(SimpleNLGwithPostprocessing.java:958)                                                                                                                        
        at Verbalizer.generateSimplePhraseFromTriple(Verbalizer.java:482)                                                                                                                                                                                       
        at Verbalizer.getPhraseSpecsFromTriples(Verbalizer.java:423)                                                                                                                                                                                            
        at Verbalizer.generateSentencesFromClusters(Verbalizer.java:304)                                                                                                                                                                                        
        at Verbalizer.verbalize(Verbalizer.java:508)                                                                                                                                                                                                            
        at Verbalizer.verbalize(Verbalizer.java:487)                                                                                                                                                                                                            
        at Verbalizer.getSummary(Verbalizer.java:559)                                                                                                                                                                                                           
        at Verbalizer.summarize(Verbalizer.java:549)                                                                                                                                                                                                            
        at Verbalizer.summarize(Verbalizer.java:540)                                                                                                                                                                                                            
        at AppKt$main$1.handle(App.kt:21)                                                                                                                                                                                                                       
        at AppKt$main$1.handle(App.kt)                                                                                                                                                                                                                          
        at spark.RouteImpl$1.handle(RouteImpl.java:58)                                                                                                                                                                                                          
        at spark.webserver.MatcherFilter.doFilter(MatcherFilter.java:162)                                                                                                                                                                                       
        at spark.webserver.JettyHandler.doHandle(JettyHandler.java:61)                                                                                                                                                                                          
        at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:189)                                                                                                                                                                     
        at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)                                                                                                                                                                        
        at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:119)                                                                                                                                                                      
        at org.eclipse.jetty.server.Server.handle(Server.java:517)                                                                                                                                                                                              
        at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:302)                                                                                                                                                                                    
        at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:242)                                                                                                                                                                          
        at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:245)                                                                                                                                                          
        at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:95)                                                                                                                                                                                     
        at org.eclipse.jetty.io.SelectChannelEndPoint$2.run(SelectChannelEndPoint.java:75)                                                                                                                                                                      
        at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceAndRun(ExecuteProduceConsume.java:246)                                                                                                                                           
        at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:156)                                                                                                                                                     
        at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:654)                                                                                                                                                                     
        at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:572)                                                                                                                                                                      
        at java.lang.Thread.run(Thread.java:748)                                                                                                                                                                                                                                                                                                                                                                                                                                                                             
cls<http://dbpedia.org/ontology/City>                                                                                                                                                                                                                           
cls<http://dbpedia.org/ontology/City>                                                                                                                                                                                                                           
Cluster = [[http://dbpedia.org/ontology/areaTotal, http://dbpedia.org/ontology/areaWater, http://dbpedia.org/ontology/areaLand, http://dbpedia.org/ontology/PopulatedPlace/areaTotal, http://dbpedia.org/ontology/areaCode, http://dbpedia.org/ontology/postalCo
de], [http://dbpedia.org/ontology/populationDensity, http://dbpedia.org/ontology/country, http://dbpedia.org/ontology/populationTotal, http://dbpedia.org/ontology/PopulatedPlace/populationDensity, http://www.w3.org/ns/prov#wasDerivedFrom, http://dbpedia.or
g/ontology/elevation], [http://dbpedia.org/ontology/timeZone, http://dbpedia.org/ontology/type], [http://dbpedia.org/ontology/utcOffset], [http://dbpedia.org/ontology/isPartOf]]                                                                               
Cluster = [[http://dbpedia.org/ontology/areaTotal, http://dbpedia.org/ontology/areaWater, http://dbpedia.org/ontology/areaLand, http://dbpedia.org/ontology/PopulatedPlace/areaTotal, http://dbpedia.org/ontology/areaCode, http://dbpedia.org/ontology/postalCo
de], [http://dbpedia.org/ontology/populationDensity, http://dbpedia.org/ontology/country, http://dbpedia.org/ontology/populationTotal, http://dbpedia.org/ontology/PopulatedPlace/populationDensity, http://www.w3.org/ns/prov#wasDerivedFrom, http://dbpedia.or
g/ontology/elevation], [http://dbpedia.org/ontology/timeZone, http://dbpedia.org/ontology/type], [http://dbpedia.org/ontology/utcOffset], [http://dbpedia.org/ontology/isPartOf]]                                                                               
TP:http://dbpedia.org/resource/Berlin @http://dbpedia.org/ontology/country http://dbpedia.org/resource/Germany -> Berlin's country is Germany                                                                                                                   
TP:http://dbpedia.org/resource/Berlin @http://dbpedia.org/ontology/country http://dbpedia.org/resource/Germany -> Berlin's country is Germany                                                                                                                   
TP:http://dbpedia.org/resource/Berlin @rdf:type http://dbpedia.org/ontology/City -> Berlin is a city                                                                                                                                                            
TP:http://dbpedia.org/resource/Berlin @rdf:type http://dbpedia.org/ontology/City -> Berlin is a city                                                                                                                                                            

                                                                                                                                                                                                                                                                

// In a different place

java.util.NoSuchElementException                                                                                                                                                                                                                                
        at java.util.TreeMap.key(TreeMap.java:1327)                                                                                                                                                                                                             
        at java.util.TreeMap.firstKey(TreeMap.java:290)                                                                                                                                                                                                         
        at java.util.TreeSet.first(TreeSet.java:394)                                                                                                                                                                                                            
        at Verbalizer.getMostSpecificType(Verbalizer.java:617)                                                                                                                                                                                                  
        at Verbalizer.summarize(Verbalizer.java:538)                                                                                                                                                                                                            
        at AppKt$main$1.handle(App.kt:21)                                                                                                                                                                                                                       
        at AppKt$main$1.handle(App.kt)                                                                                                                                                                                                                          
        at spark.RouteImpl$1.handle(RouteImpl.java:58)                                                                                                                                                                                                          
        at spark.webserver.MatcherFilter.doFilter(MatcherFilter.java:162)                                                                                                                                                                                       
        at spark.webserver.JettyHandler.doHandle(JettyHandler.java:61)                                                                                                                                                                                          
        at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:189)                                                                                                                                                                     
        at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)                                                                                                                                                                        
        at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:119)                                                                                                                                                                      
        at org.eclipse.jetty.server.Server.handle(Server.java:517)                                                                                                                                                                                              
        at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:302)                                                                                                                                                                                    
        at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:242)                                                                                                                                                                          
        at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:245)                                                                                                                                                          
        at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:95)                                                                                                                                                                                     
        at org.eclipse.jetty.io.SelectChannelEndPoint$2.run(SelectChannelEndPoint.java:75)                                                                                                                                                                      
        at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceAndRun(ExecuteProduceConsume.java:246)                                                                                                                                           
        at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:156)                                                                                                                                                     
        at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:654)                                                                                                                                                                     
        at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:572)                                                                                                                                                                      
        at java.lang.Thread.run(Thread.java:748)                                                                                                                                                                                                                


// in a different place

com.google.common.util.concurrent.UncheckedExecutionException: HttpException: HttpException: 500: null HTTP 500 error making the query: SPARQL Request Failed
        at com.google.common.cache.LocalCache$Segment.get(LocalCache.java:2218)
        at com.google.common.cache.LocalCache.get(LocalCache.java:4147)
        at com.google.common.cache.LocalCache.getOrLoad(LocalCache.java:4151)
        at com.google.common.cache.LocalCache$LocalLoadingCache.get(LocalCache.java:5140)
        at org.aksw.avatar.dataset.CachedDatasetBasedGraphGenerator.generateGraph(CachedDatasetBasedGraphGenerator.java:134)
        at Verbalizer.verbalize(Verbalizer.java:496)
        at Verbalizer.verbalize(Verbalizer.java:487)
        at Verbalizer.getSummary(Verbalizer.java:559)
        at Verbalizer.summarize(Verbalizer.java:549)
        at Verbalizer.summarize(Verbalizer.java:540)
        at AppKt$main$1.handle(App.kt:21)
        at AppKt$main$1.handle(App.kt)
        at spark.RouteImpl$1.handle(RouteImpl.java:58)
        at spark.webserver.MatcherFilter.doFilter(MatcherFilter.java:162)
        at spark.webserver.JettyHandler.doHandle(JettyHandler.java:61)
        at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:189)
        at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
        at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:119)
        at org.eclipse.jetty.server.Server.handle(Server.java:517)
        at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:302)
        at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:242)
        at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:245)
        at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:95)
        at org.eclipse.jetty.io.SelectChannelEndPoint$2.run(SelectChannelEndPoint.java:75)
        at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceAndRun(ExecuteProduceConsume.java:246)
        at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:156)
        at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:654)
        at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:572)
        at java.lang.Thread.run(Thread.java:748)

I have a full ~11Mb execution log if it can help.

yamalight avatar Aug 17 '17 10:08 yamalight

summoning @LorenzBuehmann

yamalight avatar Aug 17 '17 10:08 yamalight

Thank's for the bug report! Looks like 2 or (even 3 different bugs) ...

Some questions:

  • Which version do you use?
  • Is this the first time that it happened? Or does it always happen after some time once you restarted the server/service?
  • Do you use the Web service?
  • Which dataset is it based on? The log looks like it's DBpedia? If so, do you use the official endpoint?

I have a full ~11Mb execution log if it can help.

Yes, can you share the log file please?

LorenzBuehmann avatar Aug 18 '17 14:08 LorenzBuehmann

Which version do you use?

Build is from ~2 months ago.

Is this the first time that it happened? Or does it always happen after some time once you restarted the server/service?

This is the first time happened. It was running fine for ~2 months. Then just broke at some point.

Do you use the Web service?

Nope. Used Verbalizer class to create my own REST API (see this for source)

Which dataset is it based on? The log looks like it's DBpedia? If so, do you use the official endpoint?

It is DBpedia, official endpoint. It was down occasionally, but at the moment of those errors - it was up. The only thing that fixed the error was restarting the whole thing.

I've attached the full log file to this reply, grab it here: avatar-errors.zip

yamalight avatar Aug 21 '17 08:08 yamalight