core icon indicating copy to clipboard operation
core copied to clipboard

Generating DCAT feed eats memory

Open pietercolpaert opened this issue 8 years ago • 5 comments

I now get this error on demo.thedatatank:

[Tue May 10 14:56:04.860052 2016] [:error] [pid 6551] [client 78.21.55.178:55568] PHP Fatal error:  Allowed memory size of 134217728 bytes exhausted (tried to allocate 78 bytes) in /home/tdt/demo/core/bootstrap/compiled.php on line 6199

pietercolpaert avatar May 10 '16 15:05 pietercolpaert

How much memory is assigned? (check php.ini)

I'll check if we're caching this properly.

coreation avatar May 10 '16 15:05 coreation

As the error message says: 134217728 bytes ;)

But it really should not take that much memory to get a DCAT feed with only a few datasets, right?

pietercolpaert avatar May 10 '16 15:05 pietercolpaert

Depends, we're working on more meta-data right now, but normally it should not.

coreation avatar May 10 '16 15:05 coreation

Wasn't due to the DCAT, it was because on our demo server needed some maintenance :).

coreation avatar May 21 '16 13:05 coreation

Reopening this: seems like EasyRDF is a horrible library concerning performance and memory. I’m soon launching the Hardf library which also support quads: https://github.com/pietercolpaert/hardf/pull/5

I get a 200 times faster parsing speed with Hardf

pietercolpaert avatar Apr 15 '17 12:04 pietercolpaert