orientdb
orientdb copied to clipboard
Error in Pipeline execution: [OETLPipeline] 2024-01-08 12:38:55:086 SEVER ETL process has problem: [OETLProcessor] 2024-01-08 12:38:55:088 INFO END ETL PROCESSOR [OETLProcessor]
Hi, everyone! I'm trying to upload a dataset on an OrientDB Instance. It has 41456 rows, but in such a time for uploading, I'm facing this error:
2024-01-08 12:38:50:573 INFO Windows OS is detected, 262144 limit of open files will be set for the disk cache. [ONative]
2024-01-08 12:38:50:937 INFO 12836626432 B/12241 MB/11 GB of physical memory were detected on machine [ONative]
2024-01-08 12:38:50:937 INFO Detected memory limit for current process is 12836626432 B/12241 MB/11 GB [ONative]
2024-01-08 12:38:50:938 INFO JVM can use maximum 455MB of heap memory [OMemoryAndLocalPaginatedEnginesInitializer]
2024-01-08 12:38:50:939 INFO Because OrientDB is running outside a container 2g of memory will be left unallocated according to the setting 'memory.leftToOS' not taking into account heap memory [OMemoryAndLocalPaginatedEnginesInitializer]
2024-01-08 12:38:50:940 INFO OrientDB auto-config DISKCACHE=9,738MB (heap=455MB os=12,241MB) [orientechnologies]
2024-01-08 12:38:50:941 INFO System is started under an effective user : `BartoAlheiros` [OEngineLocalPaginated]
2024-01-08 12:38:51:104 INFO WAL maximum segment size is set to 7,202 MB [OrientDBEmbedded]
2024-01-08 12:38:51:643 INFO Page size for WAL located in H:\orientdb-community-3.2.19\orientdb-community-3.2.19\databases\inep24 is set to 4096 bytes. [CASDiskWriteAheadLog]
2024-01-08 12:38:51:833 INFO DWL:inep24: block size = 4096 bytes, maximum segment size = 7202 MB [DoubleWriteLogGL]
2024-01-08 12:38:52:034 INFO Storage 'plocal:H:\orientdb-community-3.2.19\orientdb-community-3.2.19\databases/inep24' is opened under OrientDB distribution : 3.2.19 (build c652e539f26ddbc167c93d4921c43993f3c6538c, branch UNKNOWN) [OLocalPaginatedStorage]
2024-01-08 12:38:52:298 INFO Page size for WAL located in H:\orientdb-community-3.2.19\orientdb-community-3.2.19\databases\OSystem is set to 4096 bytes. [CASDiskWriteAheadLog]
2024-01-08 12:38:52:370 INFO {db=inep24} DWL:OSystem: block size = 4096 bytes, maximum segment size = 7202 MB [DoubleWriteLogGL]
2024-01-08 12:38:52:436 INFO Storage 'plocal:H:\orientdb-community-3.2.19\orientdb-community-3.2.19\databases/OSystem' is opened under OrientDB distribution : 3.2.19 (build c652e539f26ddbc167c93d4921c43993f3c6538c, branch UNKNOWN) [OLocalPaginatedStorage]
2024-01-08 12:38:52:634 INFO BEGIN ETL PROCESSOR [OETLProcessor]
2024-01-08 12:38:52:647 INFO [file] Reading from file H:\microdados_censo_da_educacao_superior_2021\Microdados do Censo da Educação Superior 2021\dados\NordesteCursos.csv with encoding UTF-8 [OETLFileSource]
**2024-01-08 12:38:52:648 INFO Started execution with 1 worker threads [OETLProcessor]
2024-01-08 12:38:53:648 INFO + extracted 0 rows (0 rows/sec) - 0 rows -> loaded 0 vertices (0 vertices/sec) Total time: 1013ms [0 warnings, 0 errors] [OETLProcessor]
2024-01-08 12:38:54:655 INFO + extracted 56 rows (55 rows/sec) - 56 rows -> loaded 56 vertices (55 vertices/sec) Total time: 2020ms [0 warnings, 0 errors] [OETLProcessor]
2024-01-08 12:38:55:085 SEVER {db=inep24} Error in Pipeline execution: [OETLPipeline]
2024-01-08 12:38:55:086 SEVER ETL process has problem: [OETLProcessor]
2024-01-08 12:38:55:089 INFO END ETL PROCESSOR [OETLProcessor]
2024-01-08 12:38:55:089 INFO + extracted 388 rows (763 rows/sec) - 388 rows -> loaded 380 vertices (744 vertices/sec) Total time: 2455ms [0 warnings, 1 errors] [OETLProcessor]
2024-01-08 12:38:55:092 INFO - shutdown storage: OSystem ... [OrientDBEmbedded]
2024-01-08 12:38:55:504 INFO - shutdown storage: inep24 ... [OrientDBEmbedded]**
Does have someone any ideia why I'm seeying this error?
Any response would be very helpful.
Thank to you all, Happy New Year, friends!