*SOLVED* How to Generate 1M Rows or more

[jasalcido]

I have been struggling with the same issue I see in past posts about needing to generate large amounts of data with the script. I found that 100,000 was my limit and anything larger would result in an HTTP 500 error. After doing some debugging, I think I found the reason for the problem and how to fix it.

I downloaded the docker verison of generatedata per the link given in the readme. Once up and running, you will need to open a bash shell to the docker instance of generatedata. Use "docker ps" to determine what the instance id is for your machine.

docker exec -it /bin/bash

From the command line, edit this file:

vi /usr/local/etc/php-fpm.d/www.conf

Go to the bottom of the file and uncomment the last line on memory limit. Change it to something larger (to fit your machine). In my case, I set it to 16GB.

php_admin_value[memory_limit] = 16384M

Save the file and exit the shell. Restart the docker instance:

docker stop docker start

Now try to generate a large data set and you should see it complete successfully. I used the REST API to invoke the request and have done up to 1M with no issues.

[javiercr2020]

1m is not that much, Excel can do 1m. Any luck generating anything bigger? I can't go beyond 20m. Thanks