dkan2
dkan2 copied to clipboard
Some dummy content CSV files cause errors
Steps to reproduce:
- dktl install (from master)
- dktl drush dkan-dummy-content:create
- dktl drush cron
- dktl drush dkan-datastore:list
- dktl drush dkan-harvest:list
Will output errors such as:
[error] Import for 144f86b3-9828-556a-be7c-9331b9843dc3 returned an error: Machine did not halt
[error] Drupal\Core\Database\IntegrityConstraintViolationException: SQLSTATE[23000]: Integrity constraint violation: 1062 Duplicate entry '53' for key 'PRIMARY': INSERT INTO {jobstore_dkan_datastore_importer} (ref_uuid, job_data) VALUES (:db_insert_placeholder_0, :db_insert_placeholder_1); Array
(
[:db_insert_placeholder_0] => 53
[:db_insert_placeholder_1] =>
)
in Drupal\Core\Database\Connection->handleQueryException() (line 689 of /Users/thierry.dallacroce/Code/dkan/docroot/core/lib/Drupal/Core/Database/Connection.php).
SQLSTATE[23000]: Integrity constraint violation: 1062 Duplicate entry '53' for key 'PRIMARY': INSERT INTO {jobstore_dkan_datastore_importer} (ref_uuid, job_data) VALUES (:db
_insert_placeholder_0, :db_insert_placeholder_1); Array
(
[:db_insert_placeholder_0] => 53
[:db_insert_placeholder_1] => {"parser":{"@type":"object","@class":"CsvParser\\Parser\\Csv","data":{"delimiter":",","quote":"\"","escape":"\\","recordEnd":["\n","\r"],"r
ecords":[],"fields":[],"field":"","machine":{"currentStates":["s_new_field"],"halted":false,"machines":[]}}},"identifier":"53","result":null,"timeLimit":9223372036854775807}
)
I diagnosed the issues to the following dummy content CSV files:
-
docroot/profiles/contrib/dkan2/modules/custom/dkan_dummy_content/files/district_centerpoints_0.csv
has right-to-left characters -
docroot/profiles/contrib/dkan2/modules/custom/dkan_dummy_content/files/data_0.csv
has Windows line endings
This findings might reveal bugs or limitations within GetDKAN/csv-parser