cudf
cudf copied to clipboard
JSON Column creation in GPU
Description
This PR generates json column creation from the traversed json tree. It has following parts
- gather_column_info - gathers tree information for each column and number of rows in each column.
- make_json_column2 - creates the GPU json column tree structure from tree and column info
- json_column_to_cudf_column2 - converts this GPU json column to cudf column.
- parse_nested_json2 - combines all json tokenizer, json tree generation, traversal, json column creation, cudf column conversion together.
Depends on PR #11518 #11610 For code-review, use PR https://github.com/karthikeyann/cudf/pull/5 which contains only this tree changes.
Checklist
- [x] I am familiar with the Contributing Guidelines.
- [ ] New or existing tests cover these changes.
- [ ] The documentation is up to date with these changes.
Codecov Report
:exclamation: No coverage uploaded for pull request base (
branch-22.10@006b254). Click here to learn what that means. Patch has no changes to coverable lines.
Additional details and impacted files
@@ Coverage Diff @@
## branch-22.10 #11714 +/- ##
===============================================
Coverage ? 87.52%
===============================================
Files ? 133
Lines ? 21794
Branches ? 0
===============================================
Hits ? 19075
Misses ? 2719
Partials ? 0
Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.
:umbrella: View full report at Codecov.
:loudspeaker: Do you have feedback about the report comment? Let us know in this issue.
rerun tests
rerun tests
@gpucibot merge