Out of memory error on IE11 #167

Closed
opened 2015-01-30 11:08:36 +00:00 by GreenTeaBalls · 3 comments
GreenTeaBalls commented 2015-01-30 11:08:36 +00:00 (Migrated from github.com)

I'm trying to write 40.000 rows by 220 columns into an excel file.

On average only 15 columns per row actually contain a value, the others are empty.

Creating the worksheet already generates a sizeable memory load (seen in task manager and IE's memory profiler) but once I pass it to XLSX.write() the memory consumption goes wild.

Used memory increases very quickly by over 100mb at a time and I soon thereafter receive an out of memory error.

Size of the downloaded spreadsheet should be ~70mb. I've managed to download a spreadsheet with 20.000 rows that is about 35mb.

I know this is kind of vague, please let me know which other details I could provide!

BTW: I can't use another browser because of some other code my project uses.

Best regards,
Timo

EDIT: I've attached a screen clipping to show the sudden increase in memory consumption once the worksheet/workbook gets handed over to XLSX.write()

xslx-js

I'm trying to write 40.000 rows by 220 columns into an excel file. On average only 15 columns per row actually contain a value, the others are empty. Creating the worksheet already generates a sizeable memory load (seen in task manager and IE's memory profiler) but once I pass it to XLSX.write() the memory consumption goes wild. Used memory increases very quickly by over 100mb at a time and I soon thereafter receive an out of memory error. Size of the downloaded spreadsheet should be ~70mb. I've managed to download a spreadsheet with 20.000 rows that is about 35mb. I know this is kind of vague, please let me know which other details I could provide! BTW: I can't use another browser because of some other code my project uses. Best regards, Timo EDIT: I've attached a screen clipping to show the sudden increase in memory consumption once the worksheet/workbook gets handed over to XLSX.write() ![xslx-js](https://cloud.githubusercontent.com/assets/4040549/5974947/8a0207ae-a87a-11e4-8e71-de6f72250888.png)
SheetJSDev commented 2015-01-30 14:42:34 +00:00 (Migrated from github.com)

I'll try to create a reproducible test case and see where the blowup happens. Would you say the data is primarily numeric or textual? A rough estimate of the ratio would help.

I'll try to create a reproducible test case and see where the blowup happens. Would you say the data is primarily numeric or textual? A rough estimate of the ratio would help.
GreenTeaBalls commented 2015-02-02 07:45:30 +00:00 (Migrated from github.com)

Thanks for the quick reply. The data is primarily numeric, I'd estimate the ratio of numbers to text is about 15 to 1. If it would help I could upload a smaller spreadsheet (20.000 rows) with less data that I managed to generate without running into the out of memory error.

Thanks for the quick reply. The data is primarily numeric, I'd estimate the ratio of numbers to text is about 15 to 1. If it would help I could upload a smaller spreadsheet (20.000 rows) with less data that I managed to generate without running into the out of memory error.
GreenTeaBalls commented 2015-03-02 13:28:57 +00:00 (Migrated from github.com)

Hi there, I'm wondering if you've had any time to look into the issue and run a test? We're still experiencing the same issue and its effectively blocking us from creating large spreadsheets.

I've tried to modify (read: hack) the code so that an array of arrays can be passed into the library as I assumed that high memory consumption was due to a lot of cell objects being created. It doesn't seem to make a big difference at the moment.

Hi there, I'm wondering if you've had any time to look into the issue and run a test? We're still experiencing the same issue and its effectively blocking us from creating large spreadsheets. I've tried to modify (read: hack) the code so that an array of arrays can be passed into the library as I assumed that high memory consumption was due to a lot of cell objects being created. It doesn't seem to make a big difference at the moment.
Sign in to join this conversation.
No Milestone
No Assignees
1 Participants
Notifications
Due Date
The due date is invalid or out of range. Please use the format 'yyyy-mm-dd'.

No due date set.

Dependencies

No dependencies set.

Reference: sheetjs/sheetjs#167
No description provided.