cudf icon indicating copy to clipboard operation
cudf copied to clipboard

JSON Column creation in GPU

Open karthikeyann opened this issue 3 years ago • 1 comments
trafficstars

Description

This PR generates json column creation from the traversed json tree. It has following parts

  1. gather_column_info - gathers tree information for each column and number of rows in each column.
  2. make_json_column2 - creates the GPU json column tree structure from tree and column info
  3. json_column_to_cudf_column2 - converts this GPU json column to cudf column.
  4. parse_nested_json2 - combines all json tokenizer, json tree generation, traversal, json column creation, cudf column conversion together.

Depends on PR #11518 #11610 For code-review, use PR https://github.com/karthikeyann/cudf/pull/5 which contains only this tree changes.

Checklist

  • [x] I am familiar with the Contributing Guidelines.
  • [ ] New or existing tests cover these changes.
  • [ ] The documentation is up to date with these changes.

karthikeyann avatar Sep 19 '22 12:09 karthikeyann

Codecov Report

:exclamation: No coverage uploaded for pull request base (branch-22.10@006b254). Click here to learn what that means. Patch has no changes to coverable lines.

Additional details and impacted files
@@               Coverage Diff               @@
##             branch-22.10   #11714   +/-   ##
===============================================
  Coverage                ?   87.52%           
===============================================
  Files                   ?      133           
  Lines                   ?    21794           
  Branches                ?        0           
===============================================
  Hits                    ?    19075           
  Misses                  ?     2719           
  Partials                ?        0           

Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.

:umbrella: View full report at Codecov.
:loudspeaker: Do you have feedback about the report comment? Let us know in this issue.

codecov[bot] avatar Sep 19 '22 14:09 codecov[bot]

rerun tests

galipremsagar avatar Sep 26 '22 20:09 galipremsagar

rerun tests

karthikeyann avatar Sep 26 '22 21:09 karthikeyann

@gpucibot merge

karthikeyann avatar Sep 27 '22 09:09 karthikeyann