PHPExcel icon indicating copy to clipboard operation
PHPExcel copied to clipboard

Can't process large file

Open lwoods opened this issue 6 years ago • 10 comments

I tried using the "Chunked" version of the example on a large xls file. I am blowing up with memory allocation. It looks like the complete file is loaded and then the chunking begins. Is this true and, if so, any way around loading a large file into limited ( 67 Meg ) memory?

Thanks

lwoods avatar Nov 04 '17 16:11 lwoods

sorry, but there is -afaik- none. You need aprox. 4-6 times the memory as the size of the uncompressed file.

Adorfer avatar Nov 04 '17 16:11 Adorfer

You should use Java Libraries for handling with Large files. Most of the servers would time-out.

code05-hello avatar Nov 07 '17 20:11 code05-hello

Sorry. Gotta' plead dumb, here. I am running on a public hosting site ( GoDaddy ). Are your "Java Libraries" running on the server and, if so, do I load them or what?

On Tue, Nov 7, 2017 at 1:40 PM, Kalim M Puthawala [email protected] wrote:

You should use Java Libraries for handling with Large files. Most of the servers would time-out.

— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub https://mailtrack.io/trace/link/e08cce337d837f219bccd6165b4d87051d2cb0f5?url=https%3A%2F%2Fgithub.com%2FPHPOffice%2FPHPExcel%2Fissues%2F1344%23issuecomment-342614946&userId=1611542&signature=1cdbde00e3deb78a, or mute the thread https://mailtrack.io/trace/link/78152be880d1fd93109a655c20c813330142b33f?url=https%3A%2F%2Fgithub.com%2Fnotifications%2Funsubscribe-auth%2FAALE2SuInLhw-tzv6vGn5xAui8NQvtJeks5s0MA-gaJpZM4QSEjr&userId=1611542&signature=4146dfb0d25e0d8c .

--

Office: 623-556-8949 Cell: 602-369-5049

--- NOTICE ---

This message is for the designated recipient only and may contain confidential, privileged or proprietary information. If you have received it in error, please notify the sender immediately and delete the original and any copy or printout. Unintended recipients are prohibited from making any other use of this e-mail. Although we have taken reasonable precautions to ensure no viruses are present in this e-mail, we accept no liability for any loss or damage arising from the use of this e-mail or attachments, or for any delay or errors or omissions in the contents which result from e-mail transmission.

lwoods avatar Nov 07 '17 20:11 lwoods

No, I mean you should take the process offline (on your local pc) and not on the server. I hope it helps.

Sent from Windows Mail

From: lwoods Sent: ‎Wednesday‎, ‎November‎ ‎8‎, ‎2017 ‎2‎:‎21‎ ‎AM To: PHPOffice/PHPExcel Cc: Kalim M Puthawala, Comment

Sorry. Gotta' plead dumb, here. I am running on a public hosting site ( GoDaddy ). Are your "Java Libraries" running on the server and, if so, do I load them or what?

On Tue, Nov 7, 2017 at 1:40 PM, Kalim M Puthawala [email protected] wrote:

You should use Java Libraries for handling with Large files. Most of the servers would time-out.

— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub https://mailtrack.io/trace/link/e08cce337d837f219bccd6165b4d87051d2cb0f5?url=https%3A%2F%2Fgithub.com%2FPHPOffice%2FPHPExcel%2Fissues%2F1344%23issuecomment-342614946&userId=1611542&signature=1cdbde00e3deb78a, or mute the thread https://mailtrack.io/trace/link/78152be880d1fd93109a655c20c813330142b33f?url=https%3A%2F%2Fgithub.com%2Fnotifications%2Funsubscribe-auth%2FAALE2SuInLhw-tzv6vGn5xAui8NQvtJeks5s0MA-gaJpZM4QSEjr&userId=1611542&signature=4146dfb0d25e0d8c .

--

Office: 623-556-8949 Cell: 602-369-5049

--- NOTICE ---

This message is for the designated recipient only and may contain confidential, privileged or proprietary information. If you have received it in error, please notify the sender immediately and delete the original and any copy or printout. Unintended recipients are prohibited from making any other use of this e-mail. Although we have taken reasonable precautions to ensure no viruses are present in this e-mail, we accept no liability for any loss or damage arising from the use of this e-mail or attachments, or for any delay or errors or omissions in the contents which result from e-mail transmission.

— You are receiving this because you commented. Reply to this email directly, view it on GitHub, or mute the thread.

code05-hello avatar Nov 07 '17 20:11 code05-hello

That would defeat the purpose. I am trying to take all action away from the client because they are not computer-literate. My goal was "Click, and Done!"

On Tue, Nov 7, 2017 at 1:54 PM, Kalim M Puthawala [email protected] wrote:

No, I mean you should take the process offline (on your local pc) and not on the server. I hope it helps.

Sent from Windows Mail

From: lwoods Sent: ‎Wednesday‎, ‎November‎ ‎8‎, ‎2017 ‎2‎:‎21‎ ‎AM To: PHPOffice/PHPExcel Cc: Kalim M Puthawala, Comment

Sorry. Gotta' plead dumb, here. I am running on a public hosting site ( GoDaddy ). Are your "Java Libraries" running on the server and, if so, do I load them or what?

On Tue, Nov 7, 2017 at 1:40 PM, Kalim M Puthawala < [email protected]> wrote:

You should use Java Libraries for handling with Large files. Most of the servers would time-out.

— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub <https://mailtrack.io/trace/link/e08cce337d837f219bccd6165b4d87 051d2cb0f5?url=https%3A%2F%2Fgithub.com%2FPHPOffice% 2FPHPExcel%2Fissues%2F1344%23issuecomment-342614946& userId=1611542&signature=1cdbde00e3deb78a https://mailtrack.io/trace/link/4acabdf6071bd2ab1592e53daf62ed1002c3f290?url=https%3A%2F%2Fgithub.com%2FPHPOffice%2FPHPExcel%2Fissues%2F1344%23issuecomment-342614946&userId=1611542&signature=1d628469fcabe9d7>,

or mute the thread <https://mailtrack.io/trace/link/78152be880d1fd93109a655c20c813 330142b33f?url=https%3A%2F%2Fgithub.com%2Fnotifications% 2Funsubscribe-auth%2FAALE2SuInLhw-tzv6vGn5xAui8NQvtJeks5s0MA- gaJpZM4QSEjr&userId=1611542&signature=4146dfb0d25e0d8c https://mailtrack.io/trace/link/68c3735e2e20992581b453de02ade04b7fcd87a0?url=https%3A%2F%2Fgithub.com%2Fnotifications%2Funsubscribe-auth%2FAALE2SuInLhw-tzv6vGn5xAui8NQvtJeks5s0MA-gaJpZM4QSEjr&userId=1611542&signature=17c37078f902f6c8>

.

--

Office: 623-556-8949 <(623)%20556-8949> Cell: 602-369-5049 <(602)%20369-5049>

--- NOTICE ---

This message is for the designated recipient only and may contain confidential, privileged or proprietary information. If you have received it in error, please notify the sender immediately and delete the original and any copy or printout. Unintended recipients are prohibited from making any other use of this e-mail. Although we have taken reasonable precautions to ensure no viruses are present in this e-mail, we accept no liability for any loss or damage arising from the use of this e-mail or attachments, or for any delay or errors or omissions in the contents which result from e-mail transmission.

— You are receiving this because you commented. Reply to this email directly, view it on GitHub, or mute the thread.

— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub https://mailtrack.io/trace/link/05c863566f6e062e4d8cecd599899b85d36c6e5f?url=https%3A%2F%2Fgithub.com%2FPHPOffice%2FPHPExcel%2Fissues%2F1344%23issuecomment-342618851&userId=1611542&signature=9f73780c19e2212d, or mute the thread https://mailtrack.io/trace/link/076f828e5befcdaaa810029290720aaa22c2a64f?url=https%3A%2F%2Fgithub.com%2Fnotifications%2Funsubscribe-auth%2FAALE2fRQBSjKErCYKpYf8qf7M4wAa5rsks5s0MOggaJpZM4QSEjr&userId=1611542&signature=301b563a8b741aca .

--

Office: 623-556-8949 Cell: 602-369-5049

--- NOTICE ---

This message is for the designated recipient only and may contain confidential, privileged or proprietary information. If you have received it in error, please notify the sender immediately and delete the original and any copy or printout. Unintended recipients are prohibited from making any other use of this e-mail. Although we have taken reasonable precautions to ensure no viruses are present in this e-mail, we accept no liability for any loss or damage arising from the use of this e-mail or attachments, or for any delay or errors or omissions in the contents which result from e-mail transmission.

lwoods avatar Nov 07 '17 21:11 lwoods

@kalimputhawala "timeout" sounds like a different issue than "out of memory". i can't follow your recommendations.

Adorfer avatar Nov 07 '17 21:11 Adorfer

In php.ini file increase the memory, memory_limit= 64M

https://www.drupal.org/docs/7/managing-site-performance-and-scalability/changing-php-memory-limits

Sent from Windows Mail

From: lwoods Sent: ‎Wednesday‎, ‎November‎ ‎8‎, ‎2017 ‎2‎:‎33‎ ‎AM To: PHPOffice/PHPExcel Cc: Kalim M Puthawala, Comment

That would defeat the purpose. I am trying to take all action away from the client because they are not computer-literate. My goal was "Click, and Done!"

On Tue, Nov 7, 2017 at 1:54 PM, Kalim M Puthawala [email protected] wrote:

No, I mean you should take the process offline (on your local pc) and not on the server. I hope it helps.

Sent from Windows Mail

From: lwoods Sent: ‎Wednesday‎, ‎November‎ ‎8‎, ‎2017 ‎2‎:‎21‎ ‎AM To: PHPOffice/PHPExcel Cc: Kalim M Puthawala, Comment

Sorry. Gotta' plead dumb, here. I am running on a public hosting site ( GoDaddy ). Are your "Java Libraries" running on the server and, if so, do I load them or what?

On Tue, Nov 7, 2017 at 1:40 PM, Kalim M Puthawala < [email protected]> wrote:

You should use Java Libraries for handling with Large files. Most of the servers would time-out.

— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub <https://mailtrack.io/trace/link/e08cce337d837f219bccd6165b4d87 051d2cb0f5?url=https%3A%2F%2Fgithub.com%2FPHPOffice% 2FPHPExcel%2Fissues%2F1344%23issuecomment-342614946& userId=1611542&signature=1cdbde00e3deb78a https://mailtrack.io/trace/link/4acabdf6071bd2ab1592e53daf62ed1002c3f290?url=https%3A%2F%2Fgithub.com%2FPHPOffice%2FPHPExcel%2Fissues%2F1344%23issuecomment-342614946&userId=1611542&signature=1d628469fcabe9d7>,

or mute the thread <https://mailtrack.io/trace/link/78152be880d1fd93109a655c20c813 330142b33f?url=https%3A%2F%2Fgithub.com%2Fnotifications% 2Funsubscribe-auth%2FAALE2SuInLhw-tzv6vGn5xAui8NQvtJeks5s0MA- gaJpZM4QSEjr&userId=1611542&signature=4146dfb0d25e0d8c https://mailtrack.io/trace/link/68c3735e2e20992581b453de02ade04b7fcd87a0?url=https%3A%2F%2Fgithub.com%2Fnotifications%2Funsubscribe-auth%2FAALE2SuInLhw-tzv6vGn5xAui8NQvtJeks5s0MA-gaJpZM4QSEjr&userId=1611542&signature=17c37078f902f6c8>

.

--

Office: 623-556-8949 <(623)%20556-8949> Cell: 602-369-5049 <(602)%20369-5049>

--- NOTICE ---

This message is for the designated recipient only and may contain confidential, privileged or proprietary information. If you have received it in error, please notify the sender immediately and delete the original and any copy or printout. Unintended recipients are prohibited from making any other use of this e-mail. Although we have taken reasonable precautions to ensure no viruses are present in this e-mail, we accept no liability for any loss or damage arising from the use of this e-mail or attachments, or for any delay or errors or omissions in the contents which result from e-mail transmission.

— You are receiving this because you commented. Reply to this email directly, view it on GitHub, or mute the thread.

— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub https://mailtrack.io/trace/link/05c863566f6e062e4d8cecd599899b85d36c6e5f?url=https%3A%2F%2Fgithub.com%2FPHPOffice%2FPHPExcel%2Fissues%2F1344%23issuecomment-342618851&userId=1611542&signature=9f73780c19e2212d, or mute the thread https://mailtrack.io/trace/link/076f828e5befcdaaa810029290720aaa22c2a64f?url=https%3A%2F%2Fgithub.com%2Fnotifications%2Funsubscribe-auth%2FAALE2fRQBSjKErCYKpYf8qf7M4wAa5rsks5s0MOggaJpZM4QSEjr&userId=1611542&signature=301b563a8b741aca .

--

Office: 623-556-8949 Cell: 602-369-5049

--- NOTICE ---

This message is for the designated recipient only and may contain confidential, privileged or proprietary information. If you have received it in error, please notify the sender immediately and delete the original and any copy or printout. Unintended recipients are prohibited from making any other use of this e-mail. Although we have taken reasonable precautions to ensure no viruses are present in this e-mail, we accept no liability for any loss or damage arising from the use of this e-mail or attachments, or for any delay or errors or omissions in the contents which result from e-mail transmission.

— You are receiving this because you commented. Reply to this email directly, view it on GitHub, or mute the thread.

code05-hello avatar Nov 07 '17 21:11 code05-hello

Hi lwoods. I've successfully written large Excel files with PHPExcel on FreeBSD; I set PHP's "max_execution_time" high (I used 86400 [one hour]) in the script and memory_limit=1024M in PHP.ini.

In PHPExcel, we use PHPExcel_CachedObjectStorageFactory::cache_to_discISAM, per the docs. Problem there is that very large files fill up a lot of disk space (been working on one lately that's over 2GB, and that one is giving us some trouble).

Hope this helps ....

dalecosp avatar Nov 16 '17 20:11 dalecosp

Thanks for the reply, Kevin,

My file is 6 Meg!!!

On Thu, Nov 16, 2017 at 1:12 PM, Kevin Kinsey [email protected] wrote:

Hi lwoods. I've successfully written Excel files in excess of 1GB with PHPExcel on FreeBSD; I set PHP's "max_execution_time" high (I used 86400 [one hour]) in the script and memory_limit=1024M in PHP.ini.

In PHPExcel, we use PHPExcel_CachedObjectStorageFactory::cache_to_discISAM, per the docs.

I have had trouble with a TWO GB file though ;-)

Hope this helps ....

— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub https://mailtrack.io/trace/link/ed1a71a1c3d47c42736bea48de7ca7099e8421f1?url=https%3A%2F%2Fgithub.com%2FPHPOffice%2FPHPExcel%2Fissues%2F1344%23issuecomment-345048447&userId=1611542&signature=d8c04235c41bd80d, or mute the thread https://mailtrack.io/trace/link/3a8d7eb22397d65ffd49804162a1380c1f1d3482?url=https%3A%2F%2Fgithub.com%2Fnotifications%2Funsubscribe-auth%2FAALE2UwVZOOGwdwFGQwabRyjygrHCoL6ks5s3JdBgaJpZM4QSEjr&userId=1611542&signature=5cbd189d5e35ce05 .

--

Office: 623-556-8949 Cell: 602-369-5049

--- NOTICE ---

This message is for the designated recipient only and may contain confidential, privileged or proprietary information. If you have received it in error, please notify the sender immediately and delete the original and any copy or printout. Unintended recipients are prohibited from making any other use of this e-mail. Although we have taken reasonable precautions to ensure no viruses are present in this e-mail, we accept no liability for any loss or damage arising from the use of this e-mail or attachments, or for any delay or errors or omissions in the contents which result from e-mail transmission.

lwoods avatar Nov 16 '17 21:11 lwoods

I guess I was trying to be lazy. I used to tear about Access databases at the hex level so I guess ripping up an Excel spreadsheet will not be much harder. Here I go!

On Thu, Nov 16, 2017 at 1:12 PM, Kevin Kinsey [email protected] wrote:

Hi lwoods. I've successfully written Excel files in excess of 1GB with PHPExcel on FreeBSD; I set PHP's "max_execution_time" high (I used 86400 [one hour]) in the script and memory_limit=1024M in PHP.ini.

In PHPExcel, we use PHPExcel_CachedObjectStorageFactory::cache_to_discISAM, per the docs.

I have had trouble with a TWO GB file though ;-)

Hope this helps ....

— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub https://mailtrack.io/trace/link/2e2e414c28f656ef98d6cc41c20cfb76bf2b3356?url=https%3A%2F%2Fgithub.com%2FPHPOffice%2FPHPExcel%2Fissues%2F1344%23issuecomment-345048447&userId=1611542&signature=8ba5d1adc439a4b4, or mute the thread https://mailtrack.io/trace/link/58eecc57d79177b210be3ae8eb802c7d4e700faf?url=https%3A%2F%2Fgithub.com%2Fnotifications%2Funsubscribe-auth%2FAALE2UwVZOOGwdwFGQwabRyjygrHCoL6ks5s3JdBgaJpZM4QSEjr&userId=1611542&signature=0266f40f267ee5e6 .

--

Office: 623-556-8949 Cell: 602-369-5049

--- NOTICE ---

This message is for the designated recipient only and may contain confidential, privileged or proprietary information. If you have received it in error, please notify the sender immediately and delete the original and any copy or printout. Unintended recipients are prohibited from making any other use of this e-mail. Although we have taken reasonable precautions to ensure no viruses are present in this e-mail, we accept no liability for any loss or damage arising from the use of this e-mail or attachments, or for any delay or errors or omissions in the contents which result from e-mail transmission.

lwoods avatar Nov 16 '17 21:11 lwoods