clarin-eric
ParlaMint 4.1 BE: Unexpected processing warning line at start of ParlaMint-BE.txt file
A warning line unrelated to the data was found at the beginning of the file ParlaMint-BE.txt/2020/ParlaMint-BE_2020-05-08-55-commissie-ic173x.txt in the ParlaMint 4.1 BE dataset.
This line appears to be generated by the data processing and it causes errors when one wants to parse the file.
Unexpected line:
[0.002s][warning][perf,memops] Cannot use file /tmp/hsperfdata_kopp/1081190 because it is locked by another process (errno = 11)
This looks like a Java issue: https://stackoverflow.com/questions/76327/how-can-i-prevent-java-from-creating-hsperfdata-files
Changing java setting and/or additional validation needs to be done
However, I have no idea how this error ends in the file, and the error is not passed to STDERR.
I (very) vaguelly remember seeing or having similar problems before, incl. things that should go to STDERR going to STDOUT.
However, the link you gave @matyaskopp does say that simply adding -XX:-UsePerfData to java call should fix this, so maybe - at least for starters - this could be added to the java variable wherever it is found?
The original reported error no longer appears in TSV files.
@matyaskopp, if you don't plan to use -XX:-UsePerfData in the Java calls please close this.
@matyaskopp, would you close this or comment that -XX:-UsePerfData will be used in the Future.
Sorry, I missed this.
I will implement this in future, and together with this, a kind of derived format validation can be implemented.
- eg TSV is valid