dbeam
dbeam copied to clipboard
Add failing tests for reading just produced output avro files.
Print user-provided Avro schema to a log.
Unit-tests to illustrate existing issues when incorrect user-supplied Avro schema is used. #579
Testing
- "Unit tests are included"
Checklist for PR author(s)
- [x] Changes are covered by unit tests (no major decrease in code coverage %) and/or integration tests.
- [x] Ensure code formating (use
mvn com.coveo:fmt-maven-plugin:format org.codehaus.mojo:license-maven-plugin:update-file-header
) - [x] Document any relevant additions/changes in the appropriate spot in javadocs/docs/README.
@deepakn94 , could you help review?
Hi @acphile , thanks so much for the PR! I believe we implemented something similar in parallel: https://github.com/NVIDIA/Megatron-LM/commit/e69187bc3679ea5841030a165d587bb48b56ee77. Let me know if you think otherwise!
OK. Thank you for letting me know this commit. Yes, I think the intention is the same
Marking as stale. No activity in 60 days.