Randall Whitman
Randall Whitman
@guillemfrancisco There is a little bit of info in comment under - https://stackoverflow.com/questions/38963487/how-to-optimize-scan-of-1-huge-file-table-in-hive-to-confirm-check-if-lat-long
If I understand correctly from the other issue, you have v2.3 of Hive. https://github.com/Esri/spatial-framework-for-hadoop/wiki/ST_Geometry-for-Hive-Compatibility-with-Hive-Versions https://github.com/Esri/spatial-framework-for-hadoop/releases
Also how is `spatial-interpolated-line` generated? Maybe it is a shape buffer without the prefix. In which case try `ST_GeomFromShape`.
Ah - `decimal` type - may be the same issue as with #171.
Did not repro with SparkSQL-3.0; probably original issue was passing an argument of type `string` rather than `binary`. ``` spark-sql> select ST_AsText(ST_Buffer(ST_Point(1,1), 0.00001)); POLYGON ((1.00001 1, 1.0000099785892325 1.0000006540312922, ... 1.0000099785892325...
Hi @ChenZhangg - thanks for contributing this PR. For you, how long does it take to run sequential, versus, how long in parallel?
For me `mvn clean test` runs in under 10 seconds as is; I'm not sure running in parallel would in fact be faster.
Apparently I [committed JSON-naming changes to branch](https://github.com/Esri/gis-tools-for-hadoop/tree/json-class-naming) ~without ever merging~ - it may be that the changes hadn't gotten tested. [update] No - that *was* merged in #58, but not...
Should probably update Hive and Hadoop versions too. [update: also Jackson version, to match Geometry v2.]
Updated the tutorials today. @smambrose