CartoLineGen icon indicating copy to clipboard operation
CartoLineGen copied to clipboard

Size limitation of generalizer to shapefile limits?

Open newcomb-d opened this issue 5 years ago • 3 comments

Hi, I tried generalizing a large vector data set ( 7.5 gb geopackage layer, more than 37,000,000 verticies) . I was trying to read from and out put to a geopackage layer, but got an error that it could not write to a shapefile output. I assume that the plugin does not scale to geometries that are larger than shapefiles can handle?

newcomb-d avatar Jan 27 '20 15:01 newcomb-d

Hello,

Thank you for that info. It uses OGR for reading/writing shapefiles, so I guess limitations are related to it.

Best, Drazen

Get Outlook for Androidhttps://aka.ms/ghei36


From: Doug Newcomb [email protected] Sent: Monday, January 27, 2020 4:28:04 PM To: GEOF-OSGL/CartoLineGen [email protected] Cc: Subscribed [email protected] Subject: [GEOF-OSGL/CartoLineGen] Size limitation of generalizer to shapefile limits? (#3)

Hi, I tried generalizing a large vector data set ( 7.5 gb geopackage layer, more than 37,000,000 verticies) . I was trying to read from and out put to a geopackage layer, but got an error that it could not write to a shapefile output. I assume that the plugin does not scale to geometries that are larger than shapefiles can handle?

— You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHubhttps://github.com/GEOF-OSGL/CartoLineGen/issues/3?email_source=notifications&email_token=AD7EZOE5W7ATR7OFOJLZ2J3Q734QJA5CNFSM4KMDGPQKYY3PNVWWK3TUL52HS4DFUVEXG43VMWVGG33NNVSW45C7NFSM4II6RUJQ, or unsubscribehttps://github.com/notifications/unsubscribe-auth/AD7EZOFSTHGT3WH7ZHQXXDDQ734QJANCNFSM4KMDGPQA.

dtutic avatar Jan 27 '20 15:01 dtutic

Shapefile is the default output for OGR, but other options are available. I did not notice an option in the plugin to choose the output format. Would geopackage be a safer alternative?

Doug

On Mon, Jan 27, 2020 at 10:43 AM Dražen Tutić [email protected] wrote:

Hello,

Thank you for that info. It uses OGR for reading/writing shapefiles, so I guess limitations are related to it.

Best, Drazen

Get Outlook for Androidhttps://aka.ms/ghei36


From: Doug Newcomb [email protected] Sent: Monday, January 27, 2020 4:28:04 PM To: GEOF-OSGL/CartoLineGen [email protected] Cc: Subscribed [email protected] Subject: [GEOF-OSGL/CartoLineGen] Size limitation of generalizer to shapefile limits? (#3)

Hi, I tried generalizing a large vector data set ( 7.5 gb geopackage layer, more than 37,000,000 verticies) . I was trying to read from and out put to a geopackage layer, but got an error that it could not write to a shapefile output. I assume that the plugin does not scale to geometries that are larger than shapefiles can handle?

— You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub< https://github.com/GEOF-OSGL/CartoLineGen/issues/3?email_source=notifications&email_token=AD7EZOE5W7ATR7OFOJLZ2J3Q734QJA5CNFSM4KMDGPQKYY3PNVWWK3TUL52HS4DFUVEXG43VMWVGG33NNVSW45C7NFSM4II6RUJQ>, or unsubscribe< https://github.com/notifications/unsubscribe-auth/AD7EZOFSTHGT3WH7ZHQXXDDQ734QJANCNFSM4KMDGPQA

.

— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub https://github.com/GEOF-OSGL/CartoLineGen/issues/3?email_source=notifications&email_token=ABSYN7WXGZHZGMNGYWZDVLTQ736GPA5CNFSM4KMDGPQKYY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOEJ76XYY#issuecomment-578808803, or unsubscribe https://github.com/notifications/unsubscribe-auth/ABSYN7VXGXI2LY5HCGKHWODQ736GPANCNFSM4KMDGPQA .

-- Doug Newcomb - Cartographer USFWS 551F Pylon Dr Raleigh, NC 919-856-4520 ext. 14 [email protected]

*NOTE: This email correspondence and any attachments to and from this sender is subject to the Freedom of Information Act (FOIA) and may be disclosed to third parties.*​

newcomb-d avatar Jan 27 '20 15:01 newcomb-d

Have no expertise on that. You can try to modify code in generalize.py to use other format. Should work.


From: Doug Newcomb [email protected] Sent: Monday, January 27, 2020 4:47:01 PM To: GEOF-OSGL/CartoLineGen [email protected] Cc: Dražen Tutić [email protected]; Comment [email protected] Subject: Re: [GEOF-OSGL/CartoLineGen] Size limitation of generalizer to shapefile limits? (#3)

Shapefile is the default output for OGR, but other options are available. I did not notice an option in the plugin to choose the output format. Would geopackage be a safer alternative?

Doug

On Mon, Jan 27, 2020 at 10:43 AM Dražen Tutić [email protected] wrote:

Hello,

Thank you for that info. It uses OGR for reading/writing shapefiles, so I guess limitations are related to it.

Best, Drazen

Get Outlook for Androidhttps://aka.ms/ghei36


From: Doug Newcomb [email protected] Sent: Monday, January 27, 2020 4:28:04 PM To: GEOF-OSGL/CartoLineGen [email protected] Cc: Subscribed [email protected] Subject: [GEOF-OSGL/CartoLineGen] Size limitation of generalizer to shapefile limits? (#3)

Hi, I tried generalizing a large vector data set ( 7.5 gb geopackage layer, more than 37,000,000 verticies) . I was trying to read from and out put to a geopackage layer, but got an error that it could not write to a shapefile output. I assume that the plugin does not scale to geometries that are larger than shapefiles can handle?

— You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub< https://github.com/GEOF-OSGL/CartoLineGen/issues/3?email_source=notifications&email_token=AD7EZOE5W7ATR7OFOJLZ2J3Q734QJA5CNFSM4KMDGPQKYY3PNVWWK3TUL52HS4DFUVEXG43VMWVGG33NNVSW45C7NFSM4II6RUJQ>, or unsubscribe< https://github.com/notifications/unsubscribe-auth/AD7EZOFSTHGT3WH7ZHQXXDDQ734QJANCNFSM4KMDGPQA

.

— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub https://github.com/GEOF-OSGL/CartoLineGen/issues/3?email_source=notifications&email_token=ABSYN7WXGZHZGMNGYWZDVLTQ736GPA5CNFSM4KMDGPQKYY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOEJ76XYY#issuecomment-578808803, or unsubscribe https://github.com/notifications/unsubscribe-auth/ABSYN7VXGXI2LY5HCGKHWODQ736GPANCNFSM4KMDGPQA .

-- Doug Newcomb - Cartographer USFWS 551F Pylon Dr Raleigh, NC 919-856-4520 ext. 14 [email protected]

*NOTE: This email correspondence and any attachments to and from this sender is subject to the Freedom of Information Act (FOIA) and may be disclosed to third parties.*​

— You are receiving this because you commented. Reply to this email directly, view it on GitHubhttps://github.com/GEOF-OSGL/CartoLineGen/issues/3?email_source=notifications&email_token=AD7EZODVWLS7MHWTMO5FC33Q736XLA5CNFSM4KMDGPQKYY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOEJ77H5Q#issuecomment-578810870, or unsubscribehttps://github.com/notifications/unsubscribe-auth/AD7EZOFEZALA3ZCC6RTBNGTQ736XLANCNFSM4KMDGPQA.

dtutic avatar Jan 27 '20 16:01 dtutic