dataproc-templates icon indicating copy to clipboard operation
dataproc-templates copied to clipboard

Published 20 hours ago • verified publisher icon GoogleCloudPlatform

[test-cases] Test GCSToSpanner template for robustness

Open shashank-google opened this issue 2 years ago • 0 comments

Test if following scenarios work with GCSToSpanner template. You may use any of the template (JDBCToGCS, BQToGCS etc) to generate test data in GCS.

  1. Test for appending data into table from Avro To Spanner. (ideally it should work).
  2. Test for appending data into table from Avro to Spanner when sequence of columns in avro and spanner is different. (goal is to know if spark can automatically figure out matching column names).
  3. Test with avro datatype has boolean, int, long, float, double, string, enum, fixed and bytes
  4. Test with with avro datatype array.
  5. Test with with avro datatype struct.

If each of test which fails, log a github issue with the bug accordingly.

shashank-google avatar Aug 05 '22 16:08 shashank-google