virtuoso-opensource icon indicating copy to clipboard operation
virtuoso-opensource copied to clipboard

Insert stopped because out of seg data here or elsewhere host 0 key RDF_QUAD slice 0

Open jordipala opened this issue 9 years ago • 46 comments

The error occurs with different data and at different moments of the execution. After that, the data is corrupted and I must restore from and old backup and continue from that point.

I'm using dbpedia-live-mirror and getting the following error once or twice a day.

06:28:41,733 ERROR ChangesetExecutor: Cannot ADD triple: <http://dbpedia.org/property/autor> <http://www.w3.org/1999/02/22-rdf-syntax-ns#type> <http://www.w3.org/1999/02/22-rdf-syntax-ns#Property> . 06:28:41,734 WARN ChangesetExecutor: Error in query execution: org.dbpedia.extraction.live.mirror.sparul.SPARULException: org.dbpedia.extraction.live.mirror.sparul.SPARULException: virtuoso.jdbc4.VirtuosoException: COL..: Insert stopped because out of seg data here or elsewhere host 0 key RDF_QUAD slice 0 at org.dbpedia.extraction.live.mirror.sparul.SPARULVosExecutor.execSQLWrapper(SPARULVosExecutor.java:74) at org.dbpedia.extraction.live.mirror.sparul.SPARULVosExecutor.executeSPARUL(SPARULVosExecutor.java:29) at org.dbpedia.extraction.live.mirror.changesets.ChangesetExecutor.executeSparulWrapper(ChangesetExecutor.java:140) at org.dbpedia.extraction.live.mirror.changesets.ChangesetExecutor.executeAction(ChangesetExecutor.java:96) at org.dbpedia.extraction.live.mirror.changesets.ChangesetExecutor.executeAction(ChangesetExecutor.java:117) at org.dbpedia.extraction.live.mirror.changesets.ChangesetExecutor.executeAction(ChangesetExecutor.java:117) at org.dbpedia.extraction.live.mirror.changesets.ChangesetExecutor.executeAction(ChangesetExecutor.java:117) at org.dbpedia.extraction.live.mirror.changesets.ChangesetExecutor.executeAction(ChangesetExecutor.java:117) at org.dbpedia.extraction.live.mirror.changesets.ChangesetExecutor.executeAction(ChangesetExecutor.java:117) at org.dbpedia.extraction.live.mirror.changesets.ChangesetExecutor.executeAction(ChangesetExecutor.java:117) at org.dbpedia.extraction.live.mirror.changesets.ChangesetExecutor.applyChangeset(ChangesetExecutor.java:54) at org.dbpedia.extraction.live.mirror.LiveSync.main(LiveSync.java:181) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.codehaus.mojo.exec.ExecJavaMojo$1.run(ExecJavaMojo.java:294) at java.lang.Thread.run(Thread.java:745) Caused by: org.dbpedia.extraction.live.mirror.sparul.SPARULException: virtuoso.jdbc4.VirtuosoException: COL..: Insert stopped because out of seg data here or elsewhere host 0 key RDF_QUAD slice 0 at org.dbpedia.extraction.live.mirror.sparul.SPARULVosExecutor.execSQL(SPARULVosExecutor.java:88) at org.dbpedia.extraction.live.mirror.sparul.SPARULVosExecutor.execSQLWrapper(SPARULVosExecutor.java:40) ... 17 more Caused by: virtuoso.jdbc4.VirtuosoException: COL..: Insert stopped because out of seg data here or elsewhere host 0 key RDF_QUAD slice 0 at virtuoso.jdbc4.VirtuosoResultSet.process_result(Unknown Source) at virtuoso.jdbc4.VirtuosoResultSet.<init>(Unknown Source) at virtuoso.jdbc4.VirtuosoStatement.sendQuery(Unknown Source) at virtuoso.jdbc4.VirtuosoStatement.executeQuery(Unknown Source) at com.jolbox.bonecp.StatementHandle.executeQuery(StatementHandle.java:464) at org.dbpedia.extraction.live.mirror.sparul.SPARULVosExecutor.execSQL(SPARULVosExecutor.java:86) ... 18 more

jordipala avatar Aug 03 '16 09:08 jordipala

@jordipala: I assume you are running the latest Virtuoso 07.20.3217 build (virtuoso-t -?)?

The following steps should be performed to enable transaction logging and special column-store debug logging of database activity that can be replayed step-by-step to determine the cause of the error:

  1. Ensure a full online backup or copy of a known good database that can be provided is in place.

  2. Enable Virtuoso Checkpoint AuditTrail logging with the CheckpointAuditTrail = 1 param in the [Parameters] section of the INI file as detailed here.

  3. Enable column store debug logging by adding the following params to the [Flags] section of the INI file —

    [Flags]   
    dbf_col_ins_dbg_log = 1  
    enable_ce_ins_check = 2  
    

    — and restart the server, to enable special debug transaction logs of the insert/delete operations logged in the order of occurrence to be produced in debug transaction log files of the name —

    virtuoso.debug.trx.<timestamp>
    
  4. Then, at regular intervals, make online backups, and check the database in consistent with the following commands/queries:

    backup '/dev/null'; 
    
    select count (*) from rdf_quad a table option (index rdf_quad) where not exists (select 1 from rdf_quad b table option (loop, index rdf_quad_pogs) where a.g = b.g and a.p = b.p and a.o = b.o and a.s = b.s); 
    
  5. Once it is verified that a known-consistent database has become inconsistent or is giving the error, you can replay the debug logs against a known-good backup and verify they produce the problem. Then the last known good backup plus column store debug logs can be made available for development to replay manually to find where the problem is occurring and fix.

HughWilliams avatar Aug 03 '16 22:08 HughWilliams

I confirm I'm using the latest 07.20.3217

jordipala avatar Aug 03 '16 23:08 jordipala

I can confirm it's still an issue in

14:40:42 OpenLink Virtuoso Universal Server
14:40:42 Version 07.20.3233-pthreads for Linux as of Jun 22 2021
14:40:42 uses OpenSSL 1.0.2u  20 Dec 2019
14:40:42 uses parts of PCRE, Html Tidy
14:40:43 Database version 3126

and I do have a reproducible set of database and transactions that trigger this bug.

hroptatyr avatar Jul 23 '21 14:07 hroptatyr

@hroptatyr Are you able to provide the reproducible test case such that it can be setup in-house to debug and fix ?

HughWilliams avatar Jul 23 '21 15:07 HughWilliams

@hroptatyr -- Please provide the first stanza of command-line output of virtuoso-t -?, as this will confirm the git_head of your build (which the log snippet you provided does not).

Alternatively, you can use the SPARQL query found here to query the running instance, to get the same detail.

TallTed avatar Jul 23 '21 15:07 TallTed

@TallTed

Virtuoso Open Source Edition (Column Store) (multi threaded)
Version 7.2.6.3233-pthreads as of Jun 22 2021 (111d17e5b)
Compiled for Linux (x86_64-generic_glibc25-linux-gnu)
Copyright (C) 1998-2021 OpenLink Software

@HughWilliams https://yadi.sk/d/wVqdUunHyv5xPg

hroptatyr avatar Jul 23 '21 17:07 hroptatyr

@hroptatyr: Is the virtuoso.db file provided a copy of the original database before the special debug transaction logging was enabled? As I would have expected this query —

SQL> select count (*) from rdf_quad a table option (index rdf_quad) where not exists (select 1 from rdf_quad b table option (loop, index rdf_quad_pogs) where a.g = b.g and a.p = b.p and a.o = b.o and a.s = b.s);
count
INTEGER
_______________________________________________________________________________

4

1 Rows. -- 16151 msec.
SQL>

— to return 0 rather than 4, which indicates the rdf_quad_pogs index has missing values compared to the rdf_quad primary key index.

HughWilliams avatar Jul 26 '21 21:07 HughWilliams

You're right, my bad. Attached a proper version, double checked this time.

https://yadi.sk/d/Vks4seAia9ZzEQ

hroptatyr avatar Jul 27 '21 07:07 hroptatyr

An update. I ran into the issue again, this time on an empty database. rdf_loader_run on evtx.ttl.gz will reproduce the issue.

OpenLink Virtuoso Universal Server (Enterprise Edition)
Version 08.03.3322-pthreads as of Jun  3 2021 (6ceb94f1f5)
Compiled for Linux (x86_64-generic-linux-glibc25)
Hosted Runtime Environments:  VDB
Copyright (C) 1998-2021 OpenLink Software

Something's afoot with the turtle reader, I converted the file to ntriples (evty.nt.gz), and loading that one works just fine. Also, removing a few statements in the evtx.ttl.gz makes the error disappear so it might be to do with some size or count limit somewhere.

evtx.ttl.gz evty.nt.gz

hroptatyr avatar Jan 07 '22 12:01 hroptatyr

@pkleef @openlink @HughWilliams -- Please take a look at this.

TallTed avatar Jan 07 '22 13:01 TallTed

The evtx.ttl.gz dataset loads fine for me ...

Binary:

ubuntu@ip-172-30-0-77:~$ /home/ubuntu/v83/bin/virtuoso-iodbc-t -?
OpenLink Virtuoso Universal Server (Enterprise Edition)
Version 08.03.3322-pthreads as of Jun  3 2021 (6ceb94f1f5)
Compiled for Linux (x86_64-generic-linux-glibc25)
Hosted Runtime Environments:  VDB
Copyright (C) 1998-2021 OpenLink Software

Bulk load:

SQL> ld_dir ('/home/ubuntu/v83/database', 'evtx.ttl.gz', 'urn:evtx.ttl.gz');

Done. -- 2 msec.
SQL> select * from load_list where ll_state=0;
ll_file                                                                           ll_graph                                                                          ll_state    ll_started           ll_done              ll_host     ll_work_time  ll_error                                                                          LL_OPTIONS
VARCHAR NOT NULL                                                                  VARCHAR                                                                           INTEGER     TIMESTAMP            TIMESTAMP            INTEGER     INTEGER     VARCHAR                                                                           LONG VARCHAR
_______________________________________________________________________________

/home/ubuntu/v83/database/evtx.ttl.gz                                             urn:evtx.ttl.gz                                                                   0           NULL                 NULL                 NULL        NULL        NULL                                                                              NULL

1 Rows. -- 0 msec.
SQL> rdf_loader_run();

Done. -- 5297 msec.
SQL> select * from load_list where ll_state=0;
ll_file                                                                           ll_graph                                                                          ll_state    ll_started           ll_done              ll_host     ll_work_time  ll_error                                                                          LL_OPTIONS
VARCHAR NOT NULL                                                                  VARCHAR                                                                           INTEGER     TIMESTAMP            TIMESTAMP            INTEGER     INTEGER     VARCHAR                                                                           LONG VARCHAR
_______________________________________________________________________________


0 Rows. -- 1 msec.
SQL> select * from DB.DBA.LOAD_LIST where ll_error IS NOT NULL;
ll_file                                                                           ll_graph                                                                          ll_state    ll_started           ll_done              ll_host     ll_work_time  ll_error                                                                          LL_OPTIONS
VARCHAR NOT NULL                                                                  VARCHAR                                                                           INTEGER     TIMESTAMP            TIMESTAMP            INTEGER     INTEGER     VARCHAR                                                                           LONG VARCHAR
_______________________________________________________________________________


0 Rows. -- 0 msec.
SQL> checkpoint;

Done. -- 917 msec.
SQL> sparql select count(*) from <urn:evtx.ttl.gz> where {?s ?p ?o};
callret-0
INTEGER
_______________________________________________________________________________

477809

1 Rows. -- 7 msec.
SQL>

Virtuoso log:

23:27:23 PL LOG: Loader started
23:27:28 PL LOG: No more files to load. Loader has finished,
23:28:17 Checkpoint started
23:28:18 Checkpoint finished, log reused

Thus what are the specific steps you are performing and where is the error being seen ?

Might your virtuoso.ini config file have any special settings from the default in place ?

What Linux distro and version are you using ?

HughWilliams avatar Jan 07 '22 23:01 HughWilliams

Thanks for testing.

It's a openSuSE 15.2

$ /lib/libc.so.6
GNU C Library (GNU libc) stable release version 2.26 (git 1c9a5c270d8b), by Roland McGrath et al.
Copyright (C) 2017 Free Software Foundation, Inc.
This is free software; see the source for copying conditions.
There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A
PARTICULAR PURPOSE.
Configured for i686-suse-linux.
Compiled by GNU CC version 7.5.0.
Available extensions:
        crypt add-on version 2.1 by Michael Glad and others
        GNU Libidn by Simon Josefsson
        Native POSIX Threads Library by Ulrich Drepper et al
        BIND-8.2.3-T5B
libc ABIs: UNIQUE IFUNC
For bug reporting instructions, please see:
<http://bugs.opensuse.org>.

The only line differing from the default virtuoso.ini is:

[Flags]
enable_ce_ins_check = 2

which I was told to put there.

hroptatyr avatar Jan 08 '22 06:01 hroptatyr

Sorry, found another diff in the virtuoso.ini:

;VectorSize  = 1000

when using this setting, even if it is VectorSize = 0 or VectorSize = 1 it is working, i.e. the error does not show up.

hroptatyr avatar Jan 08 '22 07:01 hroptatyr

You still have not provided the steps being performed to reproduce the problem in your environment, so we can see exactly where the error is occurring when bulk loading the dataset?

With ;VectorSize = 1000 (i.e., commented out in the INI file), the default value used by Virtuoso is 10000, as per the documentation. Commenting out the setting in my INI file and restarting Virtuoso the dataset still loads successfully for me.

The enable_ce_ins_check = 2 setting in the INI file was suggested previously (along with the dbf_col_ins_dbg_log = 1 Flag) to enable a debug transaction log to be created for debugging, and is not needed for normal use. Thus, as you indicate being able to recreate the error by simply loading the evtx.ttl.gz dataset into an empty database, those INI file params do not need to be set.

Can you provide a copy of the virtuoso.ini file being used, for our review and use to try and force recreation?

HughWilliams avatar Jan 08 '22 18:01 HughWilliams

Sure, I'm doing my experiments in /var/tmp/vdbe/. Here's the steps

$ rm vi*; /opt/virtuoso-enterprise/bin/virtuoso +foreground +debug -c .w.ini

in a second shell:

$ isql 1112 dba dba PROMPT=OFF CSV=ON load-evts.sql
OpenLink Virtuoso Interactive SQL (Virtuoso)
Version 07.20.3229 as of Nov 27 2018
Type HELP; for help and EXIT; to exit.
Connected to OpenLink Virtuoso
Driver: 07.20.3229 OpenLink Virtuoso ODBC Driver

Done. -- 1 msec.

Done. -- 1 msec.

Done. -- 0 msec.

Done. -- 1 msec.

Done. -- 1955 msec.

Done. -- 128 msec.
ll_file;ll_graph;ll_state;ll_started;ll_done;ll_host;ll_work_time;ll_error
/var/tmp/vdbe/evtx.ttl.gz;http://data.ga-group.nl/evts/;2;2022.1.9 5:8:45.691553000;2022.1.9 5:8:47.645320000;0;;XXXXX COL..: Insert stopped because out of seg data here or elsewhere host 1 key RDF_QUAD slice 0                                                                                                                                                                                              
1 Rows. -- 0 msec.
G;S;P;O

0 Rows. -- 229 msec.

Done. -- 66 msec.

Attached the files I'm using. Had to gzip them because github wouldn't let me upload them otherwise. load-evts.sql.gz .w.ini.gz

hroptatyr avatar Jan 09 '22 05:01 hroptatyr

You omitted the fact that LiteMode=1 is set in your INI file which is a significant difference, as in LiteMode Virtuoso runs with minimal resource/memory foot print.

And the setting of LiteMode= in conjunction with the VectorSize INI file param being commented out with the default of 10000 then being used results in the error:

ubuntu@ip-172-30-0-77:~/v83/database/git571$ isql 1112 dba dba ECHO=ON VERBOSE=ON PROMPT=OFF CSV=ON load-evts.sql
OpenLink Virtuoso Interactive SQL (Virtuoso)
Version 08.03.3322 as of Nov 12 2021
Type HELP; for help and EXIT; to exit.
Connected to OpenLink Virtuoso
Driver: 08.03.3322 OpenLink Virtuoso ODBC Driver

-- Line 1: log_enable(3,1)

Done. -- 0 msec.

-- Line 2: SPARQL CREATE SILENT GRAPH <http://data.ga-group.nl/evts/>

Done. -- 2 msec.

-- Line 4: DELETE FROM DB.DBA.LOAD_LIST WHERE ll_file = '/home/ubuntu/v83/database/evtx.ttl.gz'

Done. -- 0 msec.

-- Line 5: ld_add('/home/ubuntu/v83/database/evtx.ttl.gz', 'http://data.ga-group.nl/evts/')

Done. -- 1 msec.

-- Line 6: rdf_loader_run()

Done. -- 3360 msec.

-- Line 7: CHECKPOINT

Done. -- 162 msec.

-- Line 8: SELECT * FROM DB.DBA.LOAD_LIST WHERE ll_state < 2 OR ll_error IS NOT NULL
ll_file;ll_graph;ll_state;ll_started;ll_done;ll_host;ll_work_time;ll_error;ll_options
/home/ubuntu/v83/database/evtx.ttl.gz;http://data.ga-group.nl/evts/;2;2022.1.9 21:3:33.36830000;2022.1.9 21:3:36.395288000;0;;XXXXX COL..: Insert stopped because out of seg data here or elsewhere host 1 key RDF_QUAD slice 0;

1 Rows. -- 1 msec.

-- Line 9: select * from rdf_quad a table option (index rdf_quad) where not exists (select 1 from rdf_quad b table option (loop, index rdf_quad_pogs) where a.g = b.g and a.p = b.p and a.o = b.o and a.s = b.s)
G;S;P;O

0 Rows. -- 267 msec.

-- Line 10: CHECKPOINT

Done. -- 111 msec.
ubuntu@ip-172-30-0-77:~/v83/database/git571$

Have you tried uncommenting the ;VectorSize=1000 setting in the INI file such that the value of 1000 is used as per the default INI file we provide, with that setting the dataset loads without the error ?

Will still have development look into why the with VectorSize commented out the error occurs, as this should not be the case.

I presume you specifically set LiteMode=1 to reduce resource/memory consumption for your use case, as it is not set by default ?

HughWilliams avatar Jan 09 '22 21:01 HughWilliams

Oh, it's been a while that I thoroughly studied ini file parameters, my bad. I was under the impression that LiteMode is a toggle for the sparql endpoint. I specifically set it for the testing environment to exclude another source of potential mishap.

You're right indeed that this minimal file doesn't show the error in the default setup but a much larger file (~40 Mtriples) of the same structure does.

hroptatyr avatar Jan 09 '22 23:01 hroptatyr

As indicated in the LiteMode link, it does a lot more than toggle/disable the /sparql endpoint, which is more a side effect than a specific use for LiteMode.

By "default setup", I presume you mean with a default INI file, i.e., without LiteMode=1 set, etc?

If the larger file (~40 Mtriples) is converted to from Turtle to N-Triples, does it then load, as you found with the indicated evty.nt.gz dataset?

Development are looking into this issue and will report back with their findings ...

HughWilliams avatar Jan 10 '22 14:01 HughWilliams

Yes sorry, our jargons are not in sync. Default setup is virtuoso.ini as can be downloaded from this repository here, for instance.

The ntriples version does indeed load (without error), BUT I noticed 2 missing entries in the rdf_quad_pogs index.

Thanks for looking into this.

hroptatyr avatar Jan 10 '22 14:01 hroptatyr

Are you able to provide the dataset with the missing entries in the rdf_quad_pogs index, so we can attempt to recreate in-house?

Also, what is the output of the rdf_quad_pogs index query, and are any errors reported in the virtuoso.log file during the load?

HughWilliams avatar Jan 10 '22 23:01 HughWilliams

It looks like we're chasing a Heisenbug. I've been using the file I marked as working, well apart from two missing index entries, and to my surprise it shows the out-of-seg-data error today on a pristine default.ini.

Worse, I was able to cut it to about 4% (uniform sample of lines) and (for today at least) the error keeps showing. File's attached.

Can you confirm? Is this of interest in the first place, or should I be chasing the "almost working" variant (the one that shows missing index entries)?

If it helps the missing entires are all date or datetime literals.

evts.nt.gz

hroptatyr avatar Jan 12 '22 01:01 hroptatyr

I see the same issue with the "evts.nt.gz" dataset loading into an empty database with default INI file:

ubuntu@ip-172-30-0-77:~/v83/database/git571$ /opt/virtuoso/bin/isql 1111 dba dba ECHO=ON VERBOSE=ON PROMPT=OFF CSV=ON load-evts.sql
OpenLink Virtuoso Interactive SQL (Virtuoso)
Version 08.03.3322 as of Nov 12 2021
Type HELP; for help and EXIT; to exit.
Connected to OpenLink Virtuoso
Driver: 08.03.3322 OpenLink Virtuoso ODBC Driver

-- Line 1: log_enable(3,1)

Done. -- 0 msec.

-- Line 2: SPARQL CREATE SILENT GRAPH <http://data.ga-group.nl/evts/>

Done. -- 2 msec.

-- Line 4: DELETE FROM DB.DBA.LOAD_LIST WHERE ll_file = '/home/ubuntu/v83/database/evts.nt.gz'

Done. -- 0 msec.

-- Line 5: ld_add('/home/ubuntu/v83/database/evts.nt.gz', 'http://data.ga-group.nl/evts/')

Done. -- 0 msec.

-- Line 6: rdf_loader_run()

Done. -- 11878 msec.

-- Line 7: CHECKPOINT

Done. -- 739 msec.

-- Line 8: SELECT * FROM DB.DBA.LOAD_LIST WHERE ll_state < 2 OR ll_error IS NOT NULL
ll_file;ll_graph;ll_state;ll_started;ll_done;ll_host;ll_work_time;ll_error;ll_options
/home/ubuntu/v83/database/evts.nt.gz;http://data.ga-group.nl/evts/;2;2022.1.12 10:14:29.432404000;2022.1.12 10:14:41.307767000;0;;XXXXX COL..: Insert stopped because out of seg data here or elsewhere host 1 key RDF_QUAD slice 0;

1 Rows. -- 0 msec.

-- Line 9: select * from rdf_quad a table option (index rdf_quad) where not exists (select 1 from rdf_quad b table option (loop, index rdf_quad_pogs) where a.g = b.g and a.p = b.p and a.o = b.o and a.s = b.s)
G;S;P;O

0 Rows. -- 603 msec.

-- Line 10: CHECKPOINT

Done. -- 46 msec.
ubuntu@ip-172-30-0-77:~/v83/database/git571$

We should also pursue the missing index entries with the complete dataset that being what you are actually seeking to load. Thus if you can provide the dataset for local recreation that would be ideal ?

HughWilliams avatar Jan 12 '22 10:01 HughWilliams

Hello, I am experiencing the same error. I created a debug repository that can hopefully reproduce the bug (tested on 2 machines) using the vanilla openlink/virtuoso-opensource-7 docker image.

https://github.com/dbpedia/databus-transfer/tree/insert-stopped-debug

This is the log of the virtuoso after trying to insert 2 files after running

SQL > trace_on('transact', 'errors', 'exec') ;

The second file causes the error but only if it is inserted second.

virtuoso_1  | 08:35:58 LTRS_0 0 172.30.0.2 1111:4 Begin transact 0x7f2d9c028d80
virtuoso_1  | 08:35:58 LTRS_0 0 172.30.0.2 1111:3 Begin transact 0x7f2d6c0037b0
virtuoso_1  | 08:35:58 LTRS_0 0 172.30.0.2 1111:5 Begin transact 0x7f2d780037b0
virtuoso_1  | 08:35:58 LTRS_1 0 172.30.0.2 1111:3 Commit transact 0x7f2d6c0037b0 0 7319
virtuoso_1  | 08:35:58 LTRS_2 0 172.30.0.2 1111:3 Restart transact 0x7f2d6c0037b0
virtuoso_1  | 08:35:58 LTRS_1 0 172.30.0.2 1111:4 Commit transact 0x7f2d9c028d80 0 7318
virtuoso_1  | 08:35:58 LTRS_1 0 172.30.0.2 1111:5 Commit transact 0x7f2d780037b0 0 7320
virtuoso_1  | 08:35:58 LTRS_2 0 172.30.0.2 1111:5 Restart transact 0x7f2d780037b0
virtuoso_1  | 08:35:58 LTRS_0 0 172.30.0.2 1111:5 Begin transact 0x7f2d780037b0
virtuoso_1  | 08:35:58 LTRS_2 0 172.30.0.2 1111:4 Restart transact 0x7f2d9c028d80
virtuoso_1  | 08:35:58 LTRS_0 0 172.30.0.2 1111:3 Begin transact 0x7f2d6c0037b0
virtuoso_1  | 08:35:58 LTRS_0 0 172.30.0.2 1111:4 Begin transact 0x7f2d9c028d80
virtuoso_1  | 08:35:58 LTRS_0 0 172.30.0.2 1111:6 Begin transact 0x7f2d6c00d2f0
virtuoso_1  | 08:35:58 LTRS_0 0 172.30.0.2 1111:7 Begin transact 0x7f2d9c033400
virtuoso_1  | 08:35:58 LTRS_1 0 172.30.0.2 1111:6 Commit transact 0x7f2d6c00d2f0 0 7324
virtuoso_1  | 08:35:58 LTRS_2 0 172.30.0.2 1111:6 Restart transact 0x7f2d6c00d2f0
virtuoso_1  | 08:35:58 LTRS_0 0 172.30.0.2 1111:6 Begin transact 0x7f2d6c00d2f0
virtuoso_1  | 08:35:58 LTRS_1 0 172.30.0.2 1111:7 Commit transact 0x7f2d9c033400 0 7325
virtuoso_1  | 08:35:58 LTRS_2 0 172.30.0.2 1111:7 Restart transact 0x7f2d9c033400
virtuoso_1  | 08:35:58 LTRS_0 0 172.30.0.2 1111:7 Begin transact 0x7f2d9c033400
virtuoso_1  | 08:35:58 EXEC_1 0 172.30.0.2 1111:3 ps00 Exec 1 time(s) sparql
virtuoso_1  | CLEAR SILENT GRAPH <http://localhost:3002/g/test/mappings-geo-coordinates-mappingbased-2018.09.12-dataid.jsonld>
virtuoso_1  | 08:35:58 LTRS_1 0 172.30.0.2 1111:3 Commit transact 0x7f2d6c0037b0 0 7322
virtuoso_1  | 08:35:58 LTRS_2 0 172.30.0.2 1111:3 Restart transact 0x7f2d6c0037b0
virtuoso_1  | 08:35:58 EXEC_1 0 172.30.0.2 1111:3 ps01 Exec 1 time(s) sparql
virtuoso_1  | DROP SILENT GRAPH <http://localhost:3002/g/test/mappings-geo-coordinates-mappingbased-2018.09.12-dataid.jsonld>
virtuoso_1  | 08:35:58 LTRS_1 0 172.30.0.2 1111:3 Commit transact 0x7f2d6c0037b0 0 7328
virtuoso_1  | 08:35:58 LTRS_2 0 172.30.0.2 1111:3 Restart transact 0x7f2d6c0037b0
virtuoso_1  | 08:35:58 EXEC_1 0 172.30.0.2 1111:3 ps02 Exec 1 time(s) sparql
virtuoso_1  | INSERT IN GRAPH <http://localhost:3002/g/test/mappings-geo-coordinates-mappingbased-2018.09.12-dataid.jsonld> {
virtuoso_1  | <http://localhost:3000/janfo/mappings/geo-coordinates-mappingbased/2018.09.12#geo-coordinates-mappingbased_lang=nl.ttl.bz2> <http://purl.org/dc/terms/conformsTo> "http://dataid.dbpedia.org/ns/core#" .
virtuoso_1  | <http://localhost:3000/janfo/mappings/geo-coordinates-mappingbased/2018.09.12#geo-coordinates-mappingbased_lang=nl.ttl.bz2> <http://dataid.dbpedia.org/ns/core#sorted> "true"^^<http
virtuoso_1  | 08:35:58 ERRS_0 01V01 QW004 Incompatible types XML_ENTITY (230) and VARCHAR (182) in := for callretSimpleCASE and blob_to_string
virtuoso_1  | 08:35:58 ERRS_0 01V01 QW004 Incompatible types XML_ENTITY (230) and VARCHAR (182) in := for callretSimpleCASE and .RO_VAL
virtuoso_1  | 08:35:58 ERRS_0 01V01 QW004 Incompatible types XML_ENTITY (230) and VARCHAR (182) in := for callretSimpleCASE and blob_to_string
virtuoso_1  | 08:35:58 ERRS_0 01V01 QW004 Incompatible types XML_ENTITY (230) and VARCHAR (182) in := for callretSimpleCASE and .RO_VAL
virtuoso_1  | 08:35:58 LTRS_1 0 172.30.0.2 1111:3 Commit transact 0x7f2d6c0037b0 0 7329
virtuoso_1  | 08:35:58 LTRS_2 0 172.30.0.2 1111:3 Restart transact 0x7f2d6c0037b0
virtuoso_1  | 08:35:59 LTRS_1 0 172.30.0.2 1111:3 Commit transact 0x7f2d6c0037b0 0 7330
virtuoso_1  | 08:35:59 LTRS_2 0 172.30.0.2 1111:3 Restart transact 0x7f2d6c0037b0
virtuoso_1  | 08:35:59 EXEC_1 0 172.30.0.2 1111:3 ps03 Exec 1 time(s) sparql
virtuoso_1  | CLEAR SILENT GRAPH <http://localhost:3002/g/test/mappings-mappingbased-literals-2018.12.01-dataid.jsonld>
virtuoso_1  | 08:35:59 LTRS_1 0 172.30.0.2 1111:3 Commit transact 0x7f2d6c0037b0 0 7331
virtuoso_1  | 08:35:59 LTRS_2 0 172.30.0.2 1111:3 Restart transact 0x7f2d6c0037b0
virtuoso_1  | 08:35:59 EXEC_1 0 172.30.0.2 1111:3 ps04 Exec 1 time(s) sparql
virtuoso_1  | DROP SILENT GRAPH <http://localhost:3002/g/test/mappings-mappingbased-literals-2018.12.01-dataid.jsonld>
virtuoso_1  | 08:35:59 LTRS_1 0 172.30.0.2 1111:3 Commit transact 0x7f2d6c0037b0 0 7332
virtuoso_1  | 08:35:59 LTRS_2 0 172.30.0.2 1111:3 Restart transact 0x7f2d6c0037b0
virtuoso_1  | 08:35:59 EXEC_1 0 172.30.0.2 1111:3 ps05 Exec 1 time(s) sparql
virtuoso_1  | INSERT IN GRAPH <http://localhost:3002/g/test/mappings-mappingbased-literals-2018.12.01-dataid.jsonld> {
virtuoso_1  | <http://localhost:3000/janfo/mappings/mappingbased-literals/2018.12.01#mappingbased-literals_lang=sl.ttl.bz2> <http://www.w3.org/ns/dcat#downloadURL> <https://downloads.dbpedia.org/repo/lts/mappings/mappingbased-literals/2018.12.01/mappingbased-literals_lang=sl.ttl.bz2> .
virtuoso_1  | <http://localhost:3000/janfo/mappings/mappingbased-literals/2018.12.01#mappingbased-literals_lang=sl.ttl.bz2> <http
virtuoso_1  | 08:35:59 ERRS_0 XXXXX COL.. Insert stopped because out of seg data here or elsewhere host 0 key RDF_QUAD_POGS slice 0
virtuoso_1  | 08:35:59 LTRS_1 0 172.30.0.2 1111:3 Rollback transact 0x7f2d6c0037b0 0 7333
virtuoso_1  | 08:35:59 LTRS_2 0 172.30.0.2 1111:3 Restart transact 0x7f2d6c0037b0
virtuoso_1  | 08:35:59 EXEC_1 0 172.30.0.2 1111:3 ps06 Exec 1 time(s) SELECT name_part(\KEY_TABLE,0) AS \TABLE_CAT VARCHAR(128),name_part(\KEY_TABLE,1) AS \TABLE_SCHEM VARCHAR(128),name_part(\KEY_TABLE,2) AS \TABLE_NAME VARCHAR(128),table_type(\KEY_TABLE)  AS \TABLE_TYPE VARCHAR(128),NULL AS \REMARKS VARCHAR(254) ,NULL AS \TYPE_CAT  VARCHAR(128) ,NULL AS \TYPE_SCHEM VARCHAR(128) ,NULL AS \TYPE_NAME VARCHAR(128) ,NULL AS \SELF_REFERENCING_COL_NAME VARCHAR(128) ,NULL AS \REF_GENERATION VARCHAR(128) FROM DB.DBA.SYS_KEYS WHERE __any_grants(\KEY_TABLE) AND UPPER(name_p
virtuoso_1  | 08:35:59 LTRS_1 0 172.30.0.2 1111:3 Commit transact 0x7f2d6c0037b0 0 7334
virtuoso_1  | 08:35:59 LTRS_2 0 172.30.0.2 1111:3 Restart transact 0x7f2d6c0037b0
virtuoso_1  | 08:35:59 LTRS_1 0 172.30.0.2 1111:3 Rollback transact 0x7f2d6c0037b0 0 7335
virtuoso_1  | 08:35:59 LTRS_2 0 172.30.0.2 1111:3 Restart transact 0x7f2d6c0037b0

There is no error when only inserting the second file There is also no error when inserting the second file first and then inserting both

The setup is using a docker image called dbpedia/gstore which is taking jsonld files and makes SPARQL updates The input files are in the debug-in folder.

I will set up an example without the dbpedia/gstore asap

holycrab13 avatar Mar 03 '22 08:03 holycrab13

In some rare cases, the database was corrputed after and failed to start with either

virtuoso_1  | 07:36:30 Roll forward started
virtuoso_1  | 07:36:30 SQL Error: 23000 : SR175: Uniqueness violation : Violating unique index RDF_LANGUAGE on table DB.DBA.RDF_LANGUAGE. Transaction killed.
virtuoso_1  | 07:36:30 In roll forward batch commit failed code 5
virtuoso_1  | 07:36:30 Rfwd error: 23000: SR175: Uniqueness violation : Violating unique index RDF_LANGUAGE on table DB.DBA.RDF_LANGUAGE. Transaction killed.
virtuoso_1  | 07:36:30 SQL Error: 23000 : SR175: Uniqueness violation : Violating unique index RDF_LANGUAGE on table DB.DBA.RDF_LANGUAGE. Transaction killed.
virtuoso_1  | 07:36:30 SQL Error: XXXXX : COL..: Insert stopped because out of seg data here or elsewhere host 0 key RDF_QUAD_POGS slice 0
virtuoso_1  | 07:36:30 Rfwd error: XXXXX: COL..: Insert stopped because out of seg data here or elsewhere host 0 key RDF_QUAD_POGS slice 0

virtuoso_1  | 07:36:30 SQL Error: XXXXX : COL..: Insert stopped because out of seg data here or elsewhere host 0 key RDF_QUAD_GS slice 0
virtuoso_1  | 07:36:30 SQL Error: XXXXX : COL..: Insert stopped because out of seg data here or elsewhere host 0 key RDF_QUAD_OP slice 0
virtuoso_1  | 07:36:30 SQL Error: 23000 : SR175: Uniqueness violation : Violating unique index RO_START on table DB.DBA.RO_START. Transaction killed.
virtuoso_1  | 07:36:30 Rfwd error: XXXXX: COL..: Insert stopped because out of seg data here or elsewhere host 0 key RDF_QUAD_OP slice 0
virtuoso_1  | 07:36:30 In roll forward batch commit failed code 5
virtuoso_1  | 07:36:30 SQL Error: XXXXX : COL..: Insert stopped because out of seg data here or elsewhere host 0 key RDF_QUAD_SP slice 0
virtuoso_1  | 07:36:30 SQL Error: XXXXX : COL..: Insert stopped because out of seg data here or elsewhere host 0 key RDF_QUAD slice 0
virtuoso_1  | 07:36:30 Rfwd error: 23000: SR175: Uniqueness violation : Violating unique index RO_START on table DB.DBA.RO_START. Transaction killed.
virtuoso_1  | 07:36:30 Rfwd error: XXXXX: COL..: Insert stopped because out of seg data here or elsewhere host 0 key RDF_QUAD slice 0

....

virtuoso_1  | 07:36:30 SQL Error: 23000 : SR175: Uniqueness violation : Violating unique index RO_START on table DB.DBA.RO_START. Transaction killed.
virtuoso_1  | 07:36:30 In roll forward batch commit failed code 5
virtuoso_1  | 07:36:30 SQL Error: XXXXX : COL..: Insert stopped because out of seg data here or elsewhere host 0 key RDF_QUAD_SP slice 0
virtuoso_1  | 07:36:30 SQL Error: XXXXX : COL..: Insert stopped because out of seg data here or elsewhere host 0 key RDF_QUAD_POGS slice 0
virtuoso_1  | 07:36:30 Rfwd error: 23000: SR175: Uniqueness violation : Violating unique index RO_START on table DB.DBA.RO_START. Transaction killed.
virtuoso_1  | 07:36:30 SQL Error: XXXXX : COL..: Insert stopped because out of seg data here or elsewhere host 0 key RDF_QUAD slice 0
virtuoso_1  | 07:36:30 Rfwd error: XXXXX: COL..: Insert stopped because out of seg data here or elsewhere host 0 key RDF_QUAD slice 0
virtuoso_1  | 07:36:30 Rfwd error: XXXXX: COL..: Insert stopped because out of seg data here or elsewhere host 0 key RDF_QUAD_SP slice 0
virtuoso_1  | 07:36:30 Rfwd error: XXXXX: COL..: Insert stopped because out of seg data here or elsewhere host 0 key RDF_QUAD_POGS slice 0
virtuoso_1  | 07:36:30 Rfwd error: XXXXX: COL..: Insert stopped because out of seg data here or elsewhere host 0 key RDF_QUAD_GS slice 0
virtuoso_1  | 07:36:30 SQL Error: XXXXX : COL..: Insert stopped because out of seg data here or elsewhere host 0 key RDF_QUAD_OP slice 0
virtuoso_1  | 07:36:30 SQL Error: 23000 : SR175: Uniqueness violation : Violating unique index RO_START on table DB.DBA.RO_START. Transaction killed.
virtuoso_1  | 07:36:30 SQL Error: XXXXX : COL..: Insert stopped because out of seg data here or elsewhere host 0 key RDF_QUAD_GS slice 0
virtuoso_1  | 07:36:30 SQL Error: XXXXX : COL..: Insert stopped because out of seg data here or elsewhere host 0 key RDF_QUAD_OP slice 0
virtuoso_1  | 07:36:30 In roll forward batch commit failed code 5
virtuoso_1  | 07:36:30 SQL Error: XXXXX : COL..: Insert stopped because out of seg data here or elsewhere host 0 key RDF_QUAD_SP slice 0
virtuoso_1  | 07:36:30 SQL Error: XXXXX : COL..: Insert stopped because out of seg data here or elsewhere host 0 key RDF_QUAD slice 0
virtuoso_1  | 07:36:30 SQL Error: XXXXX : COL..: Insert stopped because out of seg data here or elsewhere host 0 key RDF_QUAD_POGS slice 0
virtuoso_1  | 07:36:30 Rfwd error: XXXXX: COL..: Insert stopped because out of seg data here or elsewhere host 0 key RDF_QUAD_OP slice 0
virtuoso_1  | 07:36:30 Rfwd error: 23000: SR175: Uniqueness violation : Violating unique index RO_START on table DB.DBA.RO_START. Transaction killed.
virtuoso_1  | 07:36:30 Rfwd error: XXXXX: COL..: Insert stopped because out of seg data here or elsewhere host 0 key RDF_QUAD slice 0
virtuoso_1  | 07:36:30 Rfwd error: XXXXX: COL..: Insert stopped because out of seg data here or elsewhere host 0 key RDF_QUAD_SP slice 0
virtuoso_1  | 07:36:30 Rfwd error: XXXXX: COL..: Insert stopped because out of seg data here or elsewhere host 0 key RDF_QUAD_POGS slice 0
virtuoso_1  | 07:36:30 Rfwd error: XXXXX: COL..: Insert stopped because out of seg data here or elsewhere host 0 key RDF_QUAD_GS slice 0
virtuoso_1  | 07:36:30 SQL Error: XXXXX : COL..: Insert stopped because out of seg data here or elsewhere host 0 key RDF_QUAD_GS slice 0
virtuoso_1  | 07:36:30 SQL Error: XXXXX : COL..: Insert stopped because out of seg data here or elsewhere host 0 key RDF_QUAD_POGS slice 0
virtuoso_1  | 07:36:30 SQL Error: XXXXX : COL..: Insert stopped because out of seg data here or elsewhere host 0 key RDF_QUAD_POGS slice 0
virtuoso_1  | 07:36:30 SQL Error: XXXXX : COL..: Insert stopped because out of seg data here or elsewhere host 0 key RDF_QUAD_GS slice 0
virtuoso_1  | 07:36:30 SQL Error: 23000 : SR175: Uniqueness violation : Violating unique index RO_START on table DB.DBA.RO_START. Transaction killed.
virtuoso_1  | 07:36:30 In roll forward batch commit failed code 5
virtuoso_1  | 07:36:30 SQL Error: XXXXX : COL..: Insert stopped because out of seg data here or elsewhere host 0 key RDF_QUAD_OP slice 0
virtuoso_1  | 07:36:30 Rfwd error: XXXXX: COL..: Insert stopped because out of seg data here or elsewhere host 0 key RDF_QUAD_OP slice 0
virtuoso_1  | 07:36:30 SQL Error: XXXXX : COL..: Insert stopped because out of seg data here or elsewhere host 0 key RDF_QUAD slice 0
virtuoso_1  | 07:36:30 SQL Error: XXXXX : COL..: Insert stopped because out of seg data here or elsewhere host 0 key RDF_QUAD_SP slice 0
virtuoso_1  | 07:36:30 Rfwd error: 23000: SR175: Uniqueness violation : Violating unique index RO_START on table DB.DBA.RO_START. Transaction killed.
virtuoso_1  | 07:36:30 Rfwd error: XXXXX: COL..: Insert stopped because out of seg data here or elsewhere host 0 key RDF_QUAD slice 0
virtuoso_1  | 07:36:30 Rfwd error: XXXXX: COL..: Insert stopped because out of seg data here or elsewhere host 0 key RDF_QUAD_SP slice 0
virtuoso_1  | 07:36:30 Rfwd error: XXXXX: COL..: Insert stopped because out of seg data here or elsewhere host 0 key RDF_QUAD_GS slice 0
virtuoso_1  | 07:36:30 SQL Error: XXXXX : COL..: Insert stopped because out of seg data here or elsewhere host 0 key RDF_QUAD_GS slice 0
virtuoso_1  | 07:36:30 SQL Error: XXXXX : COL..: Insert stopped because out of seg data here or elsewhere host 0 key RDF_QUAD_SP slice 0
virtuoso_1  | 07:36:30 SQL Error: XXXXX : COL..: Insert stopped because out of seg data here or elsewhere host 0 key RDF_QUAD_SP slice 0
virtuoso_1  | 07:36:30 SQL Error: 23000 : SR175: Uniqueness violation : Violating unique index RO_START on table DB.DBA.RO_START. Transaction killed.
virtuoso_1  | 07:36:30 In roll forward batch commit failed code 5
virtuoso_1  | 07:36:30 Rfwd error: 23000: SR175: Uniqueness violation : Violating unique index RO_START on table DB.DBA.RO_START. Transaction killed.
virtuoso_1  | 07:36:30 SQL Error: XXXXX : COL..: Insert stopped because out of seg data here or elsewhere host 0 key RDF_QUAD_POGS slice 0
virtuoso_1  | 07:36:30 Rfwd error: XXXXX: COL..: Insert stopped because out of seg data here or elsewhere host 0 key RDF_QUAD_POGS slice 0
virtuoso_1  | 07:36:30 SQL Error: 23000 : SR175: Uniqueness violation : Violating unique index RO_START on table DB.DBA.RO_START. Transaction killed.
virtuoso_1  | 07:36:30 SQL Error: XXXXX : COL..: Insert stopped because out of seg data here or elsewhere host 0 key RDF_QUAD_GS slice 0
virtuoso_1  | 07:36:30 SQL Error: 23000 : SR175: Uniqueness violation : Violating unique index RO_START on table DB.DBA.RO_START. Transaction killed.
virtuoso_1  | 07:36:30 SQL Error: XXXXX : COL..: Insert stopped because out of seg data here or elsewhere host 0 key RDF_QUAD_SP slice 0
virtuoso_1  | 07:36:30 In roll forward batch commit failed code 5
virtuoso_1  | 07:36:30 SQL Error: XXXXX : COL..: Insert stopped because out of seg data here or elsewhere host 0 key RDF_QUAD_OP slice 0
virtuoso_1  | 07:36:30 Rfwd error: XXXXX: COL..: Insert stopped because out of seg data here or elsewhere host 0 key RDF_QUAD_OP slice 0
virtuoso_1  | 07:36:30 SQL Error: XXXXX : COL..: Insert stopped because out of seg data here or elsewhere host 0 key RDF_QUAD_POGS slice 0
virtuoso_1  | 07:36:30 Rfwd error: 23000: SR175: Uniqueness violation : Violating unique index RO_START on table DB.DBA.RO_START. Transaction killed.
virtuoso_1  | 07:36:30 SQL Error: XXXXX : COL..: Insert stopped because out of seg data here or elsewhere host 0 key RDF_QUAD slice 0
virtuoso_1  | 07:36:30 Rfwd error: XXXXX: COL..: Insert stopped because out of seg data here or elsewhere host 0 key RDF_QUAD slice 0
virtuoso_1  | 07:36:30 Rfwd error: XXXXX: COL..: Insert stopped because out of seg data here or elsewhere host 0 key RDF_QUAD_SP slice 0
virtuoso_1  | 07:36:30 Rfwd error: XXXXX: COL..: Insert stopped because out of seg data here or elsewhere host 0 key RDF_QUAD_POGS slice 0
virtuoso_1  | 07:36:30 Rfwd error: XXXXX: COL..: Insert stopped because out of seg data here or elsewhere host 0 key RDF_QUAD_GS slice 0
virtuoso_1  | 07:36:30 SQL Error: XXXXX : COL..: Insert stopped because out of seg data here or elsewhere host 0 key RDF_QUAD_GS slice 0
virtuoso_1  | 07:36:30 SQL Error: XXXXX : COL..: Insert stopped because out of seg data here or elsewhere host 0 key RDF_QUAD_GS slice 0
virtuoso_1  | 07:36:30 SQL Error: 23000 : SR175: Uniqueness violation : Violating unique index RO_START on table DB.DBA.RO_START. Transaction killed.
virtuoso_1  | 07:36:30 In roll forward batch commit failed code 5
virtuoso_1  | 07:36:30 SQL Error: XXXXX : COL..: Insert stopped because out of seg data here or elsewhere host 0 key RDF_QUAD_OP slice 0
virtuoso_1  | 07:36:30 Rfwd error: XXXXX: COL..: Insert stopped because out of seg data here or elsewhere host 0 key RDF_QUAD_OP slice 0
virtuoso_1  | 07:36:30 SQL Error: XXXXX : COL..: Insert stopped because out of seg data here or elsewhere host 0 key RDF_QUAD_SP slice 0
virtuoso_1  | 07:36:30 Rfwd error: 23000: SR175: Uniqueness violation : Violating unique index RO_START on table DB.DBA.RO_START. Transaction killed.
virtuoso_1  | 07:36:30 SQL Error: XXXXX : COL..: Insert stopped because out of seg data here or elsewhere host 0 key RDF_QUAD slice 0
virtuoso_1  | 07:36:30 Rfwd error: XXXXX: COL..: Insert stopped because out of seg data here or elsewhere host 0 key RDF_QUAD slice 0
virtuoso_1  | 07:36:30 Rfwd error: XXXXX: COL..: Insert stopped because out of seg data here or elsewhere host 0 key RDF_QUAD_SP slice 0
virtuoso_1  | 07:36:30 SQL Error: XXXXX : COL..: Insert stopped because out of seg data here or elsewhere host 0 key RDF_QUAD_POGS slice 0
virtuoso_1  | 07:36:30 Rfwd error: XXXXX: COL..: Insert stopped because out of seg data here or elsewhere host 0 key RDF_QUAD_POGS slice 0
virtuoso_1  | 07:36:30 Rfwd error: XXXXX: COL..: Insert stopped because out of seg data here or elsewhere host 0 key RDF_QUAD_GS slice 0
virtuoso_1  | 07:36:30 SQL Error: XXXXX : COL..: Insert stopped because out of seg data here or elsewhere host 0 key RDF_QUAD_GS slice 0
virtuoso_1  | 07:36:30 Roll forward complete
virtuoso_1  | 07:36:30 Error executing a server init statement : XXXXX: COL..: Insert stopped because out of seg data here or elsewhere host 0 key RDF_QUAD_SP slice 0 --  WS.WS.SYS_DAV_INIT_RDF ()

OR

virtuoso_1  | 07:41:13 Compiler unit is timed at 0.000103 msec
virtuoso_1  | 07:41:13 Reference to page with free remap dp = 6917, remap = 6917
virtuoso_1  | 07:41:13 Reference to page with free remap dp = 6917, remap = 6917
virtuoso_1  | 07:41:13 Reference to page with free remap dp = 6917, remap = 6917
virtuoso_1  | 07:41:13 Reference to page with free remap dp = 5378, remap = 5378
virtuoso_1  | 07:41:13 Broken index RDF_QUAD
virtuoso_1  | 07:41:13 /opt/virtuoso-opensource/bin/virtuoso-t() [0x917aca]
virtuoso_1  | 07:41:13 /opt/virtuoso-opensource/bin/virtuoso-t() [0x917b55]
virtuoso_1  | 07:41:13 /opt/virtuoso-opensource/bin/virtuoso-t() [0x4a2ec0]
virtuoso_1  | 07:41:13 /opt/virtuoso-opensource/bin/virtuoso-t() [0x4a3619]
virtuoso_1  | 07:41:13 /opt/virtuoso-opensource/bin/virtuoso-t() [0x48182b]
virtuoso_1  | 07:41:13 /opt/virtuoso-opensource/bin/virtuoso-t() [0x541891]
virtuoso_1  | 07:41:13 /opt/virtuoso-opensource/bin/virtuoso-t() [0x541b4b]
virtuoso_1  | 07:41:13 /opt/virtuoso-opensource/bin/virtuoso-t() [0x547991]
virtuoso_1  | 07:41:13 /opt/virtuoso-opensource/bin/virtuoso-t() [0x548312]
virtuoso_1  | 07:41:13 /opt/virtuoso-opensource/bin/virtuoso-t() [0x548c57]
virtuoso_1  | 07:41:13 /opt/virtuoso-opensource/bin/virtuoso-t() [0x548dbc]
virtuoso_1  | 07:41:13 /opt/virtuoso-opensource/bin/virtuoso-t() [0x59cd38]
virtuoso_1  | 07:41:13 /opt/virtuoso-opensource/bin/virtuoso-t() [0x5b0c3a]
virtuoso_1  | 07:41:13 /opt/virtuoso-opensource/bin/virtuoso-t() [0x5b14fe]
virtuoso_1  | 07:41:13 /opt/virtuoso-opensource/bin/virtuoso-t() [0x5b62d7]
virtuoso_1  | 07:41:13 /opt/virtuoso-opensource/bin/virtuoso-t() [0x5b6503]
virtuoso_1  | 07:41:13 /opt/virtuoso-opensource/bin/virtuoso-t() [0x5b68ec]
virtuoso_1  | 07:41:13 /opt/virtuoso-opensource/bin/virtuoso-t() [0x594382]
virtuoso_1  | 07:41:13 /opt/virtuoso-opensource/bin/virtuoso-t() [0x596b61]
virtuoso_1  | 07:41:13 /opt/virtuoso-opensource/bin/virtuoso-t() [0x693fe7]
virtuoso_1  | 07:41:13 /opt/virtuoso-opensource/bin/virtuoso-t() [0x6946ec]
virtuoso_1  | 07:41:13 /opt/virtuoso-opensource/bin/virtuoso-t() [0x679e9d]
virtuoso_1  | 07:41:13 /opt/virtuoso-opensource/bin/virtuoso-t() [0x61adde]
virtuoso_1  | 07:41:13 /opt/virtuoso-opensource/bin/virtuoso-t() [0x45a164]
virtuoso_1  | 07:41:13 /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xe7) [0x7f03ea3a3bf7]
virtuoso_1  | 07:41:13 /opt/virtuoso-opensource/bin/virtuoso-t(realloc+0x351) [0x454c29]
virtuoso_1  | 07:41:13 GPF: colsearch.c:818 ref to deld col page
virtuoso_1  | GPF: colsearch.c:818 ref to deld col page

holycrab13 avatar Mar 03 '22 08:03 holycrab13

We are looking into this issue ...

HughWilliams avatar Mar 03 '22 12:03 HughWilliams

@HughWilliams @holycrab13 Hey guys here is minimal repro snippet in java JDBC Driver used (http://download3.openlinksw.com/uda/virtuoso/jdbc/virtjdbc4.jar) virtuoso used (docker pull openlink/virtuoso-opensource-7):

import java.nio.file.Files;
import java.nio.file.Path;
import java.nio.file.Paths;
import java.sql.Connection;
import java.sql.DriverManager;
import java.sql.PreparedStatement;
import java.sql.SQLException;
import java.util.Properties;

public class Repro {

    public static void main(String[] args) throws Exception {
        Connection conn = getConnection("localhost", 1111, "dba", "your password");
        String filePa = "<path to file with the query below>";
        Path req = Paths.get(filePa);
        byte[] queryBs = Files.readAllBytes(req);
        String q = new String(queryBs, "UTF-8");
        PreparedStatement ps = conn.prepareStatement("sparql\n" + q);
        int re = ps.executeUpdate();
        System.out.println(re);
    }


    public static Connection getConnection(String host, Integer port, String login, String pass) throws SQLException {
        Properties connectionProps = new Properties();
        connectionProps.put("user", login);
        connectionProps.put("password", pass);
        Connection conn = DriverManager.getConnection(
                "jdbc:virtuoso://" + host + ":" + port + "/charset=UTF-8",
                connectionProps);
        return conn;
    }

}

Here is the query:

INSERT IN GRAPH <http://localhost:3002/g/test/mappings-mappingbased-literals-2018.12.01-dataid.jsonld> {
<http://localhost:3000/janfo/mappings/mappingbased-literals/2018.12.01#mappingbased-literals_lang=sr.ttl.bz2> <http://dataid.dbpedia.org/ns/core#preview> "<http://sr.dbpedia.org/resource/!!!> <http://xmlns.com/foaf/0.1/name> \"!!!\"@sr .\n<http://sr.dbpedia.org/resource/!!!__Album__1> <http://dbpedia.org/ontology/year> \"2007\"^^<http://www.w3.org/2001/XMLSchema#gYear> .\n<http://sr.dbpedia.org/resource/!!!__Album__1> <http://xmlns.com/foaf/0.1/name> \"-{Myth Takes}-\"@sr .\n<http://sr.dbpedia.org/resource/$O$> <http://dbpedia.org/ontology/runtime> \"4083.0\"^^<http://www.w3.org/2001/XMLSchema#double> .\n<http://sr.dbpedia.org/resource/$O$> <http://dbpedia.org/ontology/year> \"2009\"^^<http://www.w3.org/2001/XMLSchema#gYear> .\n<http://sr.dbpedia.org/resource/$O$> <http://xmlns.com/foaf/0.1/name> \"$O$\"@sr .\n<http://sr.dbpedia.org/resource/$O$__Album__2> <http://dbpedia.org/ontology/year> \"2010\"^^<http://www.w3.org/2001/XMLSchema#gYear> .\n<http://sr.dbpedia.org/resource/$O$__Album__2> <http://xmlns.com/foaf/0.1/name> \"5\"@sr .\n<http://sr.dbpedia.org/resource/'64_-_'95> <http://dbpedia.org/ontology/runtime> \"3180.0\"^^<http://www.w3.org/2001/XMLSchema#double> .\n<http://sr.dbpedia.org/resource/'64_-_'95> <http://dbpedia.org/ontology/year> \"2005\"^^<http://www.w3.org/2001/XMLSchema#gYear> ." .
<http://localhost:3000/janfo/mappings/mappingbased-literals/2018.12.01#mappingbased-literals_lang=sr.ttl.bz2> <http://www.w3.org/ns/dcat#mediaType> <http://dataid.dbpedia.org/ns/mt#ApplicationNTriples> .
<http://localhost:3000/janfo/mappings/mappingbased-literals/2018.12.01#mappingbased-literals_lang=sr.ttl.bz2> <http://purl.org/dc/terms/conformsTo> "http://dataid.dbpedia.org/ns/core#" .
<http://localhost:3000/janfo/mappings/mappingbased-literals/2018.12.01#mappingbased-literals_lang=sr.ttl.bz2> <http://dataid.dbpedia.org/ns/core#formatExtension> "ttl" .
<http://localhost:3000/janfo/mappings/mappingbased-literals/2018.12.01#mappingbased-literals_lang=sr.ttl.bz2> <http://dataid.dbpedia.org/ns/core#uncompressedByteSize> "NaN"^^<http://www.w3.org/2001/XMLSchema#double> .
<http://localhost:3000/janfo/mappings/mappingbased-literals/2018.12.01#mappingbased-literals_lang=sr.ttl.bz2> <http://dataid.dbpedia.org/ns/core#file> <http://localhost:3000/janfo/mappings/mappingbased-literals/2018.12.01/mappingbased-literals_lang=sr.ttl.bz2> .
<http://localhost:3000/janfo/mappings/mappingbased-literals/2018.12.01#mappingbased-literals_lang=sr.ttl.bz2> <http://www.w3.org/ns/dcat#downloadURL> <https://downloads.dbpedia.org/repo/lts/mappings/mappingbased-literals/2018.12.01/mappingbased-literals_lang=sr.ttl.bz2> .
<http://localhost:3000/janfo/mappings/mappingbased-literals/2018.12.01#mappingbased-literals_lang=sr.ttl.bz2> <http://dataid.dbpedia.org/ns/cv#lang> "sr" .
<http://localhost:3000/janfo/mappings/mappingbased-literals/2018.12.01#mappingbased-literals_lang=sr.ttl.bz2> <http://dataid.dbpedia.org/ns/core#sha256sum> "3f99c63424d0b6b1bd659573236f6b5c9b8f00c4e06ec66ccff8b99d8cef0259" .
<http://localhost:3000/janfo/mappings/mappingbased-literals/2018.12.01#mappingbased-literals_lang=sr.ttl.bz2> <http://dataid.dbpedia.org/ns/core#nonEmptyLines> "NaN"^^<http://www.w3.org/2001/XMLSchema#double> .
<http://localhost:3000/janfo/mappings/mappingbased-literals/2018.12.01#mappingbased-literals_lang=sr.ttl.bz2> <http://purl.org/dc/terms/license> <http://purl.oclc.org/NET/rdflicense/cc-by3.0> .
<http://localhost:3000/janfo/mappings/mappingbased-literals/2018.12.01#mappingbased-literals_lang=sr.ttl.bz2> <http://purl.org/dc/terms/issued> "2018-12-01T00:00:00Z"^^<http://www.w3.org/2001/XMLSchema#dateTime> .
<http://localhost:3000/janfo/mappings/mappingbased-literals/2018.12.01#mappingbased-literals_lang=gl.ttl.bz2> <http://www.w3.org/ns/dcat#downloadURL> <https://downloads.dbpedia.org/repo/lts/mappings/mappingbased-literals/2018.12.01/mappingbased-literals_lang=gl.ttl.bz2> .
<http://localhost:3000/janfo/mappings/mappingbased-literals/2018.12.01#mappingbased-literals_lang=gl.ttl.bz2> <http://www.w3.org/ns/dcat#mediaType> <http://dataid.dbpedia.org/ns/mt#ApplicationNTriples> .
<http://localhost:3000/janfo/mappings/mappingbased-literals/2018.12.01#mappingbased-literals_lang=gl.ttl.bz2> <http://dataid.dbpedia.org/ns/core#sorted> "false"^^<http://www.w3.org/2001/XMLSchema#boolean> .
<http://localhost:3000/janfo/mappings/mappingbased-literals/2018.12.01#mappingbased-literals_lang=gl.ttl.bz2> <http://www.w3.org/ns/dcat#byteSize> "2590477"^^<http://www.w3.org/2001/XMLSchema#decimal> .
<http://localhost:3000/janfo/mappings/mappingbased-literals/2018.12.01#mappingbased-literals_lang=gl.ttl.bz2> <http://purl.org/dc/terms/title> "Literals extracted with mappings"@en .
<http://localhost:3000/janfo/mappings/mappingbased-literals/2018.12.01#mappingbased-literals_lang=gl.ttl.bz2> <http://dataid.dbpedia.org/ns/core#compression> "bzip2" .
<http://localhost:3000/janfo/mappings/mappingbased-literals/2018.12.01#mappingbased-literals_lang=gl.ttl.bz2> <http://purl.org/dc/terms/issued> "2018-12-01T00:00:00Z"^^<http://www.w3.org/2001/XMLSchema#dateTime> .
<http://localhost:3000/janfo/mappings/mappingbased-literals/2018.12.01#mappingbased-literals_lang=gl.ttl.bz2> <http://dataid.dbpedia.org/ns/core#uncompressedByteSize> "NaN"^^<http://www.w3.org/2001/XMLSchema#double> .
<http://localhost:3000/janfo/mappings/mappingbased-literals/2018.12.01#mappingbased-literals_lang=gl.ttl.bz2> <http://purl.org/dc/terms/hasVersion> "2018.12.01" .
<http://localhost:3000/janfo/mappings/mappingbased-literals/2018.12.01#mappingbased-literals_lang=gl.ttl.bz2> <http://dataid.dbpedia.org/ns/core#preview> "<http://gl.dbpedia.org/resource/!!!> <http://dbpedia.org/ontology/activeYearsStartYear> \"1996\"^^<http://www.w3.org/2001/XMLSchema#gYear> .\n<http://gl.dbpedia.org/resource/!!!> <http://xmlns.com/foaf/0.1/name> \"!!!\"@gl .\n<http://gl.dbpedia.org/resource/!!!> <http://xmlns.com/foaf/0.1/name> \"\"@gl .\n<http://gl.dbpedia.org/resource/!!!_(\u00E1lbum)> <http://dbpedia.org/ontology/runtime> \"2727.0\"^^<http://www.w3.org/2001/XMLSchema#double> .\n<http://gl.dbpedia.org/resource/!!!_(\u00E1lbum)> <http://dbpedia.org/ontology/runtime> \"304.0\"^^<http://www.w3.org/2001/XMLSchema#double> .\n<http://gl.dbpedia.org/resource/!!!_(\u00E1lbum)> <http://dbpedia.org/ontology/runtime> \"315.0\"^^<http://www.w3.org/2001/XMLSchema#double> .\n<http://gl.dbpedia.org/resource/!!!_(\u00E1lbum)> <http://dbpedia.org/ontology/runtime> \"348.0\"^^<http://www.w3.org/2001/XMLSchema#double> .\n<http://gl.dbpedia.org/resource/!!!_(\u00E1lbum)> <http://dbpedia.org/ontology/runtime> \"368.0\"^^<http://www.w3.org/2001/XMLSchema#double> .\n<http://gl.dbpedia.org/resource/!!!_(\u00E1lbum)> <http://dbpedia.org/ontology/runtime> \"414.0\"^^<http://www.w3.org/2001/XMLSchema#double> .\n<http://gl.dbpedia.org/resource/!!!_(\u00E1lbum)> <http://dbpedia.org/ontology/runtime> \"446.0\"^^<http://www.w3.org/2001/XMLSchema#double> ." .
<http://localhost:3000/janfo/mappings/mappingbased-literals/2018.12.01#mappingbased-literals_lang=gl.ttl.bz2> <http://www.w3.org/1999/02/22-rdf-syntax-ns#type> <http://dataid.dbpedia.org/ns/core#Part> .
<http://localhost:3000/janfo/mappings/mappingbased-literals/2018.12.01#mappingbased-literals_lang=gl.ttl.bz2> <http://dataid.dbpedia.org/ns/core#sha256sum> "096779e28af73e8ee9f1fb5d5383d045bc1e18a8dbbdcd093b47cdff7b85af0d" .
<http://localhost:3000/janfo/mappings/mappingbased-literals/2018.12.01#mappingbased-literals_lang=gl.ttl.bz2> <http://dataid.dbpedia.org/ns/core#formatExtension> "ttl" .
<http://localhost:3000/janfo/mappings/mappingbased-literals/2018.12.01#mappingbased-literals_lang=gl.ttl.bz2> <http://dataid.dbpedia.org/ns/cv#lang> "gl" .
<http://localhost:3000/janfo/mappings/mappingbased-literals/2018.12.01#mappingbased-literals_lang=gl.ttl.bz2> <http://purl.org/dc/terms/conformsTo> "http://dataid.dbpedia.org/ns/core#" .
<http://localhost:3000/janfo/mappings/mappingbased-literals/2018.12.01#mappingbased-literals_lang=gl.ttl.bz2> <http://purl.org/dc/terms/license> <http://purl.oclc.org/NET/rdflicense/cc-by3.0> .
<http://localhost:3000/janfo/mappings/mappingbased-literals/2018.12.01#mappingbased-literals_lang=gl.ttl.bz2> <http://purl.org/dc/terms/modified> "2019-01-11T01:01:01Z"^^<http://www.w3.org/2001/XMLSchema#dateTime> .
<http://localhost:3000/janfo/mappings/mappingbased-literals/2018.12.01#mappingbased-literals_lang=gl.ttl.bz2> <http://dataid.dbpedia.org/ns/core#file> <http://localhost:3000/janfo/mappings/mappingbased-literals/2018.12.01/mappingbased-literals_lang=gl.ttl.bz2> .
<http://localhost:3000/janfo/mappings/mappingbased-literals/2018.12.01#mappingbased-literals_lang=gl.ttl.bz2> <http://dataid.dbpedia.org/ns/core#nonEmptyLines> "NaN"^^<http://www.w3.org/2001/XMLSchema#double> .
<http://localhost:3000/janfo/mappings/mappingbased-literals/2018.12.01#mappingbased-literals_lang=hy.ttl.bz2> <http://dataid.dbpedia.org/ns/core#sorted> "true"^^<http://www.w3.org/2001/XMLSchema#boolean> .
<http://localhost:3000/janfo/mappings/mappingbased-literals/2018.12.01#mappingbased-literals_lang=hy.ttl.bz2> <http://dataid.dbpedia.org/ns/core#compression> "bzip2" .
<http://localhost:3000/janfo/mappings/mappingbased-literals/2018.12.01#mappingbased-literals_lang=hy.ttl.bz2> <http://dataid.dbpedia.org/ns/core#nonEmptyLines> "331.0"^^<http://www.w3.org/2001/XMLSchema#decimal> .
<http://localhost:3000/janfo/mappings/mappingbased-literals/2018.12.01#mappingbased-literals_lang=hy.ttl.bz2> <http://www.w3.org/ns/dcat#byteSize> "4216"^^<http://www.w3.org/2001/XMLSchema#decimal> .
<http://localhost:3000/janfo/mappings/mappingbased-literals/2018.12.01#mappingbased-literals_lang=hy.ttl.bz2> <http://dataid.dbpedia.org/ns/cv#lang> "hy" .
<http://localhost:3000/janfo/mappings/mappingbased-literals/2018.12.01#mappingbased-literals_lang=hy.ttl.bz2> <http://purl.org/dc/terms/license> <http://purl.oclc.org/NET/rdflicense/cc-by3.0> .
<http://localhost:3000/janfo/mappings/mappingbased-literals/2018.12.01#mappingbased-literals_lang=hy.ttl.bz2> <http://purl.org/dc/terms/title> "Literals extracted with mappings"@en .
<http://localhost:3000/janfo/mappings/mappingbased-literals/2018.12.01#mappingbased-literals_lang=hy.ttl.bz2> <http://purl.org/dc/terms/issued> "2018-12-01T00:00:00Z"^^<http://www.w3.org/2001/XMLSchema#dateTime> .
<http://localhost:3000/janfo/mappings/mappingbased-literals/2018.12.01#mappingbased-literals_lang=hy.ttl.bz2> <http://dataid.dbpedia.org/ns/core#file> <http://localhost:3000/janfo/mappings/mappingbased-literals/2018.12.01/mappingbased-literals_lang=hy.ttl.bz2> .
<http://localhost:3000/janfo/mappings/mappingbased-literals/2018.12.01#mappingbased-literals_lang=hy.ttl.bz2> <http://dataid.dbpedia.org/ns/core#uncompressedByteSize> "51933.0"^^<http://www.w3.org/2001/XMLSchema#decimal> .
<http://localhost:3000/janfo/mappings/mappingbased-literals/2018.12.01#mappingbased-literals_lang=hy.ttl.bz2> <http://dataid.dbpedia.org/ns/core#sha256sum> "03dd0a618b90e0ab204306fa8d55e1fccfcf29e543541611b2781d48525d5911" .
<http://localhost:3000/janfo/mappings/mappingbased-literals/2018.12.01#mappingbased-literals_lang=hy.ttl.bz2> <http://dataid.dbpedia.org/ns/core#formatExtension> "ttl" .
<http://localhost:3000/janfo/mappings/mappingbased-literals/2018.12.01#mappingbased-literals_lang=hy.ttl.bz2> <http://www.w3.org/ns/dcat#downloadURL> <https://downloads.dbpedia.org/repo/lts/mappings/mappingbased-literals/2018.12.01/mappingbased-literals_lang=hy.ttl.bz2> .
<http://localhost:3000/janfo/mappings/mappingbased-literals/2018.12.01#mappingbased-literals_lang=hy.ttl.bz2> <http://dataid.dbpedia.org/ns/core#preview> "<http://hy.dbpedia.org/resource/\u0531\u0562\u0580\u0561\u0570\u0561\u0574_\u0536\u0561\u0574\u056B\u0576\u0575\u0561\u0576> <http://xmlns.com/foaf/0.1/name> \"\u0531\u0562\u0580\u0561\u0570\u0561\u0574 \u0536\u0561\u0574\u056B\u0576\u0575\u0561\u0576\"@hy .\n<http://hy.dbpedia.org/resource/\u0531\u0563\u0561\u0569\u0561_\u0554\u0580\u056B\u057D\u057F\u056B> <http://dbpedia.org/ontology/activeYearsEndYear> \"1976\"^^<http://www.w3.org/2001/XMLSchema#gYear> .\n<http://hy.dbpedia.org/resource/\u0531\u0563\u0561\u0569\u0561_\u0554\u0580\u056B\u057D\u057F\u056B> <http://dbpedia.org/ontology/activeYearsStartYear> \"1920\"^^<http://www.w3.org/2001/XMLSchema#gYear> .\n<http://hy.dbpedia.org/resource/\u0531\u0564\u0578\u0576\u056B\u057D_(\u0562\u0561\u0576\u0561\u057D\u057F\u0565\u0572\u056E)> <http://dbpedia.org/ontology/activeYearsEndYear> \"0020\"^^<http://www.w3.org/2001/XMLSchema#gYear> .\n<http://hy.dbpedia.org/resource/\u0531\u0564\u0578\u0576\u056B\u057D_(\u0562\u0561\u0576\u0561\u057D\u057F\u0565\u0572\u056E)> <http://dbpedia.org/ontology/activeYearsStartYear> \"0020\"^^<http://www.w3.org/2001/XMLSchema#gYear> .\n<http://hy.dbpedia.org/resource/\u0531\u0564\u0578\u0576\u056B\u057D_(\u0562\u0561\u0576\u0561\u057D\u057F\u0565\u0572\u056E)> <http://dbpedia.org/ontology/pseudonym> \"\u0531\u0564\u0578\u0576\u056B\u057D\"@hy .\n<http://hy.dbpedia.org/resource/\u0531\u056C\u0562\u0565\u0580_\u053F\u0561\u0574\u0575\u0578\u0582> <http://dbpedia.org/ontology/activeYearsEndYear> \"1960\"^^<http://www.w3.org/2001/XMLSchema#gYear> .\n<http://hy.dbpedia.org/resource/\u0531\u056C\u0562\u0565\u0580_\u053F\u0561\u0574\u0575\u0578\u0582> <http://dbpedia.org/ontology/activeYearsStartYear> \"1934\"^^<http://www.w3.org/2001/XMLSchema#gYear> .\n<http://hy.dbpedia.org/resource/\u0531\u056C\u0564\u0561_\u0544\u0565\u0580\u056B\u0576\u056B> <http://dbpedia.org/ontology/activeYearsEndYear> \"2008\"^^<http://www.w3.org/2001/XMLSchema#gYear> .\n<http://hy.dbpedia.org/resource/\u0531\u056C\u0564\u0561_\u0544\u0565\u0580\u056B\u0576\u056B> <http://dbpedia.org/ontology/activeYearsStartYear> \"1953\"^^<http://www.w3.org/2001/XMLSchema#gYear> ." .
<http://localhost:3000/janfo/mappings/mappingbased-literals/2018.12.01#mappingbased-literals_lang=hy.ttl.bz2> <http://www.w3.org/ns/dcat#mediaType> <http://dataid.dbpedia.org/ns/mt#ApplicationNTriples> .
<http://localhost:3000/janfo/mappings/mappingbased-literals/2018.12.01#mappingbased-literals_lang=hy.ttl.bz2> <http://purl.org/dc/terms/hasVersion> "2018.12.01" .
<http://localhost:3000/janfo/mappings/mappingbased-literals/2018.12.01#mappingbased-literals_lang=hy.ttl.bz2> <http://purl.org/dc/terms/conformsTo> "http://dataid.dbpedia.org/ns/core#" .
<http://localhost:3000/janfo/mappings/mappingbased-literals/2018.12.01#mappingbased-literals_lang=hy.ttl.bz2> <http://www.w3.org/1999/02/22-rdf-syntax-ns#type> <http://dataid.dbpedia.org/ns/core#Part> .
<http://localhost:3000/janfo/mappings/mappingbased-literals/2018.12.01#mappingbased-literals_lang=hy.ttl.bz2> <http://purl.org/dc/terms/modified> "2019-01-11T01:01:06Z"^^<http://www.w3.org/2001/XMLSchema#dateTime> .
<http://localhost:3000/janfo/mappings/mappingbased-literals/2018.12.01#mappingbased-literals_lang=es.ttl.bz2> <http://purl.org/dc/terms/conformsTo> "http://dataid.dbpedia.org/ns/core#" .
<http://localhost:3000/janfo/mappings/mappingbased-literals/2018.12.01#mappingbased-literals_lang=es.ttl.bz2> <http://dataid.dbpedia.org/ns/core#uncompressedByteSize> "NaN"^^<http://www.w3.org/2001/XMLSchema#double> .
<http://localhost:3000/janfo/mappings/mappingbased-literals/2018.12.01#mappingbased-literals_lang=es.ttl.bz2> <http://dataid.dbpedia.org/ns/core#sha256sum> "dc74352d57e6fd9118e5148261b31d961cb47bb9621da4513e021e6f865f8f6b" .
<http://localhost:3000/janfo/mappings/mappingbased-literals/2018.12.01#mappingbased-literals_lang=es.ttl.bz2> <http://dataid.dbpedia.org/ns/core#formatExtension> "ttl" .
<http://localhost:3000/janfo/mappings/mappingbased-literals/2018.12.01#mappingbased-literals_lang=es.ttl.bz2> <http://dataid.dbpedia.org/ns/core#compression> "bzip2" .
<http://localhost:3000/janfo/mappings/mappingbased-literals/2018.12.01#mappingbased-literals_lang=es.ttl.bz2> <http://www.w3.org/ns/dcat#mediaType> <http://dataid.dbpedia.org/ns/mt#ApplicationNTriples> .
<http://localhost:3000/janfo/mappings/mappingbased-literals/2018.12.01#mappingbased-literals_lang=es.ttl.bz2> <http://dataid.dbpedia.org/ns/cv#lang> "es" .
<http://localhost:3000/janfo/mappings/mappingbased-literals/2018.12.01#mappingbased-literals_lang=es.ttl.bz2> <http://dataid.dbpedia.org/ns/core#file> <http://localhost:3000/janfo/mappings/mappingbased-literals/2018.12.01/mappingbased-literals_lang=es.ttl.bz2> .
<http://localhost:3000/janfo/mappings/mappingbased-literals/2018.12.01#mappingbased-literals_lang=es.ttl.bz2> <http://purl.org/dc/terms/issued> "2018-12-01T00:00:00Z"^^<http://www.w3.org/2001/XMLSchema#dateTime> .
<http://localhost:3000/janfo/mappings/mappingbased-literals/2018.12.01#mappingbased-literals_lang=es.ttl.bz2> <http://purl.org/dc/terms/license> <http://purl.oclc.org/NET/rdflicense/cc-by3.0> .
<http://localhost:3000/janfo/mappings/mappingbased-literals/2018.12.01#mappingbased-literals_lang=es.ttl.bz2> <http://www.w3.org/ns/dcat#byteSize> "27794328"^^<http://www.w3.org/2001/XMLSchema#decimal> .
<http://localhost:3000/janfo/mappings/mappingbased-literals/2018.12.01#mappingbased-literals_lang=es.ttl.bz2> <http://www.w3.org/1999/02/22-rdf-syntax-ns#type> <http://dataid.dbpedia.org/ns/core#Part> .
<http://localhost:3000/janfo/mappings/mappingbased-literals/2018.12.01#mappingbased-literals_lang=es.ttl.bz2> <http://purl.org/dc/terms/title> "Literals extracted with mappings"@en .
<http://localhost:3000/janfo/mappings/mappingbased-literals/2018.12.01#mappingbased-literals_lang=es.ttl.bz2> <http://purl.org/dc/terms/modified> "2019-01-11T00:59:47Z"^^<http://www.w3.org/2001/XMLSchema#dateTime> .
<http://localhost:3000/janfo/mappings/mappingbased-literals/2018.12.01#mappingbased-literals_lang=es.ttl.bz2> <http://dataid.dbpedia.org/ns/core#nonEmptyLines> "NaN"^^<http://www.w3.org/2001/XMLSchema#double> .
<http://localhost:3000/janfo/mappings/mappingbased-literals/2018.12.01#mappingbased-literals_lang=es.ttl.bz2> <http://dataid.dbpedia.org/ns/core#sorted> "false"^^<http://www.w3.org/2001/XMLSchema#boolean> .
<http://localhost:3000/janfo/mappings/mappingbased-literals/2018.12.01#mappingbased-literals_lang=es.ttl.bz2> <http://www.w3.org/ns/dcat#downloadURL> <https://downloads.dbpedia.org/repo/lts/mappings/mappingbased-literals/2018.12.01/mappingbased-literals_lang=es.ttl.bz2> .
<http://localhost:3000/janfo/mappings/mappingbased-literals/2018.12.01#mappingbased-literals_lang=es.ttl.bz2> <http://dataid.dbpedia.org/ns/core#preview> "<http://es.dbpedia.org/resource/!!!> <http://dbpedia.org/ontology/activeYearsStartYear> \"1995\"^^<http://www.w3.org/2001/XMLSchema#gYear> .\n<http://es.dbpedia.org/resource/!!!> <http://dbpedia.org/ontology/background> \"grupo_o_banda\" .\n<http://es.dbpedia.org/resource/!!!> <http://dbpedia.org/ontology/status> \"Activo\" .\n<http://es.dbpedia.org/resource/!!!> <http://xmlns.com/foaf/0.1/name> \"!!!\"@es .\n<http://es.dbpedia.org/resource/!!!_(\u00E1lbum)> <http://dbpedia.org/ontology/review> \"http://web.archive.org/web/http://pitchforkmedia.com/article/record_review/16471/_hk_Chk_Chk_\"^^<http://www.w3.org/2001/XMLSchema#anyURI> .\n<http://es.dbpedia.org/resource/!!!_(\u00E1lbum)> <http://dbpedia.org/ontology/review> \"http://www.allmusic.com/album/r540530\"^^<http://www.w3.org/2001/XMLSchema#anyURI> .\n<http://es.dbpedia.org/resource/!!!_(\u00E1lbum)> <http://dbpedia.org/ontology/runtime> \"0.0\"^^<http://www.w3.org/2001/XMLSchema#double> .\n<http://es.dbpedia.org/resource/!!!_(\u00E1lbum)> <http://dbpedia.org/ontology/runtime> \"2727.0\"^^<http://www.w3.org/2001/XMLSchema#double> .\n<http://es.dbpedia.org/resource/!!!_(\u00E1lbum)> <http://dbpedia.org/ontology/runtime> \"304.0\"^^<http://www.w3.org/2001/XMLSchema#double> .\n<http://es.dbpedia.org/resource/!!!_(\u00E1lbum)> <http://dbpedia.org/ontology/runtime> \"315.0\"^^<http://www.w3.org/2001/XMLSchema#double> ." .
<http://localhost:3000/janfo/mappings/mappingbased-literals/2018.12.01#mappingbased-literals_lang=es.ttl.bz2> <http://purl.org/dc/terms/hasVersion> "2018.12.01" .
<http://localhost:3000/janfo/mappings/mappingbased-literals> <http://www.w3.org/1999/02/22-rdf-syntax-ns#type> <http://dataid.dbpedia.org/ns/core#Artifact> .
<http://localhost:3000/janfo/mappings/mappingbased-literals/2018.12.01#mappingbased-literals_lang=ja.ttl.bz2> <http://purl.org/dc/terms/conformsTo> "http://dataid.dbpedia.org/ns/core#" .
<http://localhost:3000/janfo/mappings/mappingbased-literals/2018.12.01#mappingbased-literals_lang=ja.ttl.bz2> <http://www.w3.org/ns/dcat#byteSize> "14262606"^^<http://www.w3.org/2001/XMLSchema#decimal> .
<http://localhost:3000/janfo/mappings/mappingbased-literals/2018.12.01#mappingbased-literals_lang=ja.ttl.bz2> <http://purl.org/dc/terms/hasVersion> "2018.12.01" .
<http://localhost:3000/janfo/mappings/mappingbased-literals/2018.12.01#mappingbased-literals_lang=ja.ttl.bz2> <http://dataid.dbpedia.org/ns/core#nonEmptyLines> "NaN"^^<http://www.w3.org/2001/XMLSchema#double> .
<http://localhost:3000/janfo/mappings/mappingbased-literals/2018.12.01#mappingbased-literals_lang=ja.ttl.bz2> <http://dataid.dbpedia.org/ns/core#file> <http://localhost:3000/janfo/mappings/mappingbased-literals/2018.12.01/mappingbased-literals_lang=ja.ttl.bz2> .
<http://localhost:3000/janfo/mappings/mappingbased-literals/2018.12.01#mappingbased-literals_lang=ja.ttl.bz2> <http://dataid.dbpedia.org/ns/cv#lang> "ja" .
<http://localhost:3000/janfo/mappings/mappingbased-literals/2018.12.01#mappingbased-literals_lang=ja.ttl.bz2> <http://dataid.dbpedia.org/ns/core#uncompressedByteSize> "NaN"^^<http://www.w3.org/2001/XMLSchema#double> .
<http://localhost:3000/janfo/mappings/mappingbased-literals/2018.12.01#mappingbased-literals_lang=ja.ttl.bz2> <http://purl.org/dc/terms/title> "Literals extracted with mappings"@en .
<http://localhost:3000/janfo/mappings/mappingbased-literals/2018.12.01#mappingbased-literals_lang=ja.ttl.bz2> <http://purl.org/dc/terms/issued> "2018-12-01T00:00:00Z"^^<http://www.w3.org/2001/XMLSchema#dateTime> .
<http://localhost:3000/janfo/mappings/mappingbased-literals/2018.12.01#mappingbased-literals_lang=ja.ttl.bz2> <http://www.w3.org/ns/dcat#mediaType> <http://dataid.dbpedia.org/ns/mt#ApplicationNTriples> .
<http://localhost:3000/janfo/mappings/mappingbased-literals/2018.12.01#mappingbased-literals_lang=ja.ttl.bz2> <http://dataid.dbpedia.org/ns/core#preview> "<http://ja.dbpedia.org/resource/!!!> <http://dbpedia.org/ontology/activeYearsStartYear> \"1995\"^^<http://www.w3.org/2001/XMLSchema#gYear> .\n<http://ja.dbpedia.org/resource/!!!> <http://dbpedia.org/ontology/background> \"band\" .\n<http://ja.dbpedia.org/resource/!!!> <http://xmlns.com/foaf/0.1/name> \"!!!\"@ja .\n<http://ja.dbpedia.org/resource/!!!Fuck_You!!!> <http://dbpedia.org/ontology/title> \"!!!Fuck You!!!\"@ja .\n<http://ja.dbpedia.org/resource/!!!Fuck_You!!!> <http://dbpedia.org/ontology/title> \"\"@ja .\n<http://ja.dbpedia.org/resource/!LOUD!> <http://dbpedia.org/ontology/title> \"!LOUD!\"@ja .\n<http://ja.dbpedia.org/resource/!SHOUT!> <http://dbpedia.org/ontology/title> \"!SHOUT!\"@ja .\n<http://ja.dbpedia.org/resource/!_-attention-> <http://dbpedia.org/ontology/title> \"! -attention-\"@ja .\n<http://ja.dbpedia.org/resource/!wagero!> <http://dbpedia.org/ontology/activeYearsEndYear> \"2009\"^^<http://www.w3.org/2001/XMLSchema#gYear> .\n<http://ja.dbpedia.org/resource/!wagero!> <http://dbpedia.org/ontology/activeYearsStartYear> \"1998\"^^<http://www.w3.org/2001/XMLSchema#gYear> ." .
<http://localhost:3000/janfo/mappings/mappingbased-literals/2018.12.01#mappingbased-literals_lang=ja.ttl.bz2> <http://www.w3.org/ns/dcat#downloadURL> <https://downloads.dbpedia.org/repo/lts/mappings/mappingbased-literals/2018.12.01/mappingbased-literals_lang=ja.ttl.bz2> .
<http://localhost:3000/janfo/mappings/mappingbased-literals/2018.12.01#mappingbased-literals_lang=ja.ttl.bz2> <http://dataid.dbpedia.org/ns/core#sorted> "false"^^<http://www.w3.org/2001/XMLSchema#boolean> .
<http://localhost:3000/janfo/mappings/mappingbased-literals/2018.12.01#mappingbased-literals_lang=ja.ttl.bz2> <http://www.w3.org/1999/02/22-rdf-syntax-ns#type> <http://dataid.dbpedia.org/ns/core#Part> .
<http://localhost:3000/janfo/mappings/mappingbased-literals/2018.12.01#mappingbased-literals_lang=ja.ttl.bz2> <http://dataid.dbpedia.org/ns/core#compression> "bzip2" .
<http://localhost:3000/janfo/mappings/mappingbased-literals/2018.12.01#mappingbased-literals_lang=ja.ttl.bz2> <http://purl.org/dc/terms/modified> "2019-01-11T01:01:59Z"^^<http://www.w3.org/2001/XMLSchema#dateTime> .
<http://localhost:3000/janfo/mappings/mappingbased-literals/2018.12.01#mappingbased-literals_lang=ja.ttl.bz2> <http://purl.org/dc/terms/license> <http://purl.oclc.org/NET/rdflicense/cc-by3.0> .
<http://localhost:3000/janfo/mappings/mappingbased-literals/2018.12.01#mappingbased-literals_lang=ja.ttl.bz2> <http://dataid.dbpedia.org/ns/core#sha256sum> "bfcdb21f91d6957345b42225a736ed209881fe962f34f690a929eb1cd960b6f9" .
<http://localhost:3000/janfo/mappings/mappingbased-literals/2018.12.01#mappingbased-literals_lang=ja.ttl.bz2> <http://dataid.dbpedia.org/ns/core#formatExtension> "ttl" .
<http://localhost:3000/janfo/mappings/mappingbased-literals/2018.12.01#mappingbased-literals_lang=ga.ttl.bz2> <http://dataid.dbpedia.org/ns/core#uncompressedByteSize> "NaN"^^<http://www.w3.org/2001/XMLSchema#double> .
<http://localhost:3000/janfo/mappings/mappingbased-literals/2018.12.01#mappingbased-literals_lang=ga.ttl.bz2> <http://dataid.dbpedia.org/ns/cv#lang> "ga" .
<http://localhost:3000/janfo/mappings/mappingbased-literals/2018.12.01#mappingbased-literals_lang=ga.ttl.bz2> <http://dataid.dbpedia.org/ns/core#formatExtension> "ttl" .
<http://localhost:3000/janfo/mappings/mappingbased-literals/2018.12.01#mappingbased-literals_lang=ga.ttl.bz2> <http://purl.org/dc/terms/hasVersion> "2018.12.01" .
<http://localhost:3000/janfo/mappings/mappingbased-literals/2018.12.01#mappingbased-literals_lang=ga.ttl.bz2> <http://purl.org/dc/terms/issued> "2018-12-01T00:00:00Z"^^<http://www.w3.org/2001/XMLSchema#dateTime> .
<http://localhost:3000/janfo/mappings/mappingbased-literals/2018.12.01#mappingbased-literals_lang=ga.ttl.bz2> <http://dataid.dbpedia.org/ns/core#preview> "[binary data - no preview]" .
<http://localhost:3000/janfo/mappings/mappingbased-literals/2018.12.01#mappingbased-literals_lang=ga.ttl.bz2> <http://dataid.dbpedia.org/ns/core#file> <http://localhost:3000/janfo/mappings/mappingbased-literals/2018.12.01/mappingbased-literals_lang=ga.ttl.bz2> .
<http://localhost:3000/janfo/mappings/mappingbased-literals/2018.12.01#mappingbased-literals_lang=ga.ttl.bz2> <http://dataid.dbpedia.org/ns/core#compression> "bzip2" .
<http://localhost:3000/janfo/mappings/mappingbased-literals/2018.12.01#mappingbased-literals_lang=ga.ttl.bz2> <http://purl.org/dc/terms/title> "Literals extracted with mappings"@en .
<http://localhost:3000/janfo/mappings/mappingbased-literals/2018.12.01#mappingbased-literals_lang=ga.ttl.bz2> <http://www.w3.org/ns/dcat#byteSize> "273212"^^<http://www.w3.org/2001/XMLSchema#decimal> .
<http://localhost:3000/janfo/mappings/mappingbased-literals/2018.12.01#mappingbased-literals_lang=ga.ttl.bz2> <http://dataid.dbpedia.org/ns/core#nonEmptyLines> "NaN"^^<http://www.w3.org/2001/XMLSchema#double> .
}

output after running:

Exception in thread "main" virtuoso.jdbc4.VirtuosoException: COL..: Insert stopped because out of seg data here or elsewhere host 0 key RDF_QUAD_OP slice 0
	at virtuoso.jdbc4.VirtuosoResultSet.process_result(VirtuosoResultSet.java:363)
	at virtuoso.jdbc4.VirtuosoResultSet.getMoreResults(VirtuosoResultSet.java:85)
	at virtuoso.jdbc4.VirtuosoPreparedStatement.sendQuery(VirtuosoPreparedStatement.java:88)
	at virtuoso.jdbc4.VirtuosoPreparedStatement.executeUpdate(VirtuosoPreparedStatement.java:119)
	at org.dbpedia.databus.Repro.main(Repro.java:23)

manonthegithub avatar Mar 08 '22 15:03 manonthegithub

Using the latest Virtuoso open source docker image from docker pull openlink/virtuoso-opensource-7, I am able to run your test application successfully inserting 100 triples:

De-iMac:~ hwilliams$ javac -cp "./Downloads/virtjdbc4.jar:." Repro.java 
De-iMac:~ hwilliams$ java -cp "./Downloads/virtjdbc4.jar:." Repro
100
De-iMac:~ hwilliams$ ~/isql 1111
OpenLink Virtuoso Interactive SQL (Virtuoso)
Type HELP; for help and EXIT; to exit.
Connected to OpenLink Virtuoso
SQL> sparql select count(*) from <http://localhost:3002/g/test/mappings-mappingbased-literals-2018.12.01-dataid.jsonld> where {?s ?p ?o};
callret-0
INTEGER
_______________________________________________________________________________

100

1 Rows. -- 3 msec.
SQL>

Note: this is starting with an empty database, i.e., new docker instance. Is this where you are starting from, or is yours an existing database with other RDF data already loaded?

HughWilliams avatar Mar 09 '22 11:03 HughWilliams

The example I posted earlier was tested on two different machines with a clean docker container and the bug occured in both cases.

I have tested the example posted by @manonthegithub and cannot reproduce it with that either. I think the reason why he was able to reproduce it with the posted INSERT statement was that his virtuoso was already in the faulty state from running my repro example.

holycrab13 avatar Mar 09 '22 12:03 holycrab13

Here is an example that is reproducing the issue for me on a clean virtuoso: https://github.com/dbpedia/databus-transfer/tree/insert-stopped-debug

JDBC Driver used (http://download3.openlinksw.com/uda/virtuoso/jdbc/virtjdbc4.jar) Virtuoso image used (docker pull openlink/virtuoso-opensource-7)

with

docker run --name test_virtuoso --interactive --tty --env DBA_PASSWORD=password --publish 1111:1111 --publish 8890:8890 openlink/virtuoso-opensource-7:latest

and then

javac -cp "./Downloads/virtjdbc4.jar:." Repro.java 
java -cp "./Downloads/virtjdbc4.jar:." Repro

It triggers when doing 2 inserts sequentially. I pruned both inserts down step by step. I haven't found the sweet spot yet, but at some point the issue stops happening.

  • Insert 1 is 8 triples
  • Insert 2 is 178 triples

Inserting the same data into one graph works without problems Running only one insert works

holycrab13 avatar Mar 09 '22 13:03 holycrab13

@HughWilliams so @holycrab13's example worked for me (reproduced). Please try that one :). I used non empty database as you supposed.

manonthegithub avatar Mar 09 '22 14:03 manonthegithub