I saw in the LibreOffice 3.3 release notes that the problem with the spreadsheet rows limit was fixed, so I went on and removed OpenOffice 3.1 and replaced it with LibreOffice 3.4. In general it seems to be better, but still when I try to import data from a CSV file, only the first 1000 rows are imported.
Can't reproduce that problem with master/beta2. Could you test with a 3.5 beta2 build? If the problem is still there it would be great if you could add a test document.
Although the error message mentions "max number of rows", I think the bug is related with "max number of columns" during CVS import. I have a CVS file that has 1600+ columns and 10 data rows. LibreOffice gives the above mentioned "maximum number of rows exceeded" error message for this file. Hence the bug should be related with "number of columns"
Created attachment 54932 [details] 100 column test file Here is a 100 column CSV test file, which can be opened by LibreOffice
Created attachment 54933 [details] 2000 column test file And, here is a 2000 column CSV test file, which LibreOffice can not open
(In reply to comment #2) > Although the error message mentions "max number of rows", I think the bug is > related with "max number of columns" during CVS import. > I have a CVS file that has 1600+ columns and 10 data rows. > LibreOffice gives the above mentioned "maximum number of rows exceeded" error > message for this file. > Hence the bug should be related with "number of columns" Yes, that is probably what happened to me as well. The data I was importing had thousands of columns.
Markus, is this a fix for this bug? or it's just a part of it? http://cgit.freedesktop.org/libreoffice/core/commit/?id=51caf9b45403b92deadf934347f2d6f9ffecdf08 IOW, could we mark this bug as RESOLVED/FIXED?
It is not a fix for this bug. It was just a fix for a related problem I discovered during a quick look at the code. There is no easy fix for this problem without more investigation. Normally the commit message should read: related fdo#43911 but that did not fit into the commit message
Hi Markus, Have you been able to test it, with the "2000 column test file" I have uploaded? I think the quick fix of this problem is to increase the "Max Column Limit during CSV import". It seems that the limit is 1024 now. More practical limit would be 8192 or even better 65536. Thank you, Cem
> I think the quick fix of this problem is to increase the "Max Column Limit > during CSV import". It seems that the limit is 1024 now. More practical limit > would be 8192 or even better 65536. > No. We won't increase the column limit soon. First we would need to rework all internal cell datastructures like I did for sheets in 3.5. We still use fixed size containers for columns. That means that increasing the column limit will increase the the memory needed for every sheet extremelly. The column limit of 1024 is a design decision by us. If you are really in need for LibO with a bigger column limit you can easily build one yourself and I tell you the line you need to change to increase the limit. This bug report is about the wrong error message and not about the the column limit of 1024 in 3.4+, 256 till 3.3.
(In reply to comment #9) > > I think the quick fix of this problem is to increase the "Max Column Limit > > during CSV import". It seems that the limit is 1024 now. More practical limit > > would be 8192 or even better 65536. > > > > No. We won't increase the column limit soon. First we would need to rework all > internal cell datastructures like I did for sheets in 3.5. We still use fixed > size containers for columns. That means that increasing the column limit will > increase the the memory needed for every sheet extremelly. The column limit of > 1024 is a design decision by us. > > If you are really in need for LibO with a bigger column limit you can easily > build one yourself and I tell you the line you need to change to increase the > limit. > > This bug report is about the wrong error message and not about the the column > limit of 1024 in 3.4+, 256 till 3.3. I understand and ack your technical comments. However, this bug report (which I opened) is about the data not being fully imported. At the beginning I thought it was a limit on the rows, but apparently it is a limit on the columns (possibly a wrong error message). Fact of the matter is, the main issue for me was that I had to open and edit the file using Microsoft Office, because libreoffice could not open the file correctly for further editing.
> > > ... It seems that the limit is 1024 now. More practical limit > > > would be 8192 or even better 65536. > > > > > > > No. We won't increase the column limit soon. ... The column limit of > > 1024 is a design decision by us. > > > > This bug report is about the wrong error message and not about the the column > > limit of 1024 in 3.4+, 256 till 3.3. > > I understand and ack your technical comments. > However, this bug report (which I opened) is about the data not being fully > imported. At the beginning I thought it was a limit on the rows, but apparently > it is a limit on the columns (possibly a wrong error message). > Fact of the matter is, the main issue for me was that I had to open and edit > the file using Microsoft Office, because libreoffice could not open the file > correctly for further editing. Hi Markus, I also have found my way to this "bug report" only because I have a 1600+ column CSV file that I am trying to import into LibO. So, our hopes is to convince developers to increase the "Max Column" limit, or that they switch to a dynamic size column container approach in order to use necessary memory. Is it the final decision that the distributed official LibO version will have a "Max Column" limit of 1024 in the near future releases? And people like me will have to modify the "Max Column" limit and recompile/recreate a special LibO version for our needs? Thank you, Cem
> > I understand and ack your technical comments. > > However, this bug report (which I opened) is about the data not being fully > > imported. At the beginning I thought it was a limit on the rows, but apparently > > it is a limit on the columns (possibly a wrong error message). > > Fact of the matter is, the main issue for me was that I had to open and edit > > the file using Microsoft Office, because libreoffice could not open the file > > correctly for further editing. > > Hi Markus, > I also have found my way to this "bug report" only because I have a 1600+ > column CSV file that I am trying to import into LibO. > So, our hopes is to convince developers to increase the "Max Column" limit, or > that they switch to a dynamic size column container approach in order to use > necessary memory. This is not an easy switch. This is more like half a heart transplant and therefore is nothing that will be done just from today to tomorrow. I needed around one month for the change for the sheet change and I think that changing the column container might take much more time. > Is it the final decision that the distributed official LibO version will have a > "Max Column" limit of 1024 in the near future releases? And people like me will > have to modify the "Max Column" limit and recompile/recreate a special LibO > version for our needs? It is not a final decision but I doubt that we will increase the column limit if we did not change the column container to a dynamic container. In my dev builds a empty sheet already needs around 150 KB. For the change we need someone whohas enough time to work on it. Feel free to step in here and help to improve the situation. You'll get as much help as possible by us and we will assist as much as we can.
> It is not a final decision but I doubt that we will increase the column limit > if we did not change the column container to a dynamic container. In my dev > builds a empty sheet already needs around 150 KB. For the change we need > someone whohas enough time to work on it. > > Feel free to step in here and help to improve the situation. You'll get as much > help as possible by us and we will assist as much as we can. I can spend like a day per week for contribution to the project. Can you please, email me steps I should take?? And people I should be in contact with?? Thank you, Cem
(In reply to comment #13) > > It is not a final decision but I doubt that we will increase the column limit > > if we did not change the column container to a dynamic container. In my dev > > builds a empty sheet already needs around 150 KB. For the change we need > > someone whohas enough time to work on it. > > > > Feel free to step in here and help to improve the situation. You'll get as much > > help as possible by us and we will assist as much as we can. > > I can spend like a day per week for contribution to the project. > Can you please, email me steps I should take?? And people I should be in > contact with?? http://wiki.documentfoundation.org/Development should contain all information needed to finish a first build. You should get help at #libreoffice dev or the dev mailing list if you need. It might be a good idea to start with an easy hack and then continue with something more difficult.
*** Bug 48516 has been marked as a duplicate of this bug. ***
Fixed with http://cgit.freedesktop.org/libreoffice/core/commit/?id=684cf5cca6ea6c8fc2743f1622f624f668db9e84
And http://cgit.freedesktop.org/libreoffice/core/commit/?id=9f77876a96911a7138aa2081077a03abd34a9cf4
*** Bug 40415 has been marked as a duplicate of this bug. ***
Thank you for this fix. It resolves (in LO 3.6 only) a long standing OOo bug : https://issues.apache.org/ooo/show_bug.cgi?id=75199 Best regards. JBF
(In reply to cemyuceer from comment #3) > Created attachment 54932 [details] > 100 column test file > > Here is a 100 column CSV test file, which can be opened by LibreOffice https://pinoytambayantoday.su https://dramacool.name https://isharoisharomein.su/ I got this web site from my friend who told me concerning this web page and now this time I am visiting this web site and reading very informative content here.
(In reply to cemyuceer from comment #13) > > It is not a final decision but I doubt that we will increase the column limit > > if we did not change the column container to a dynamic container. In my dev > > builds a empty sheet already needs around 150 KB. For the change we need > > someone whohas enough time to work on it. > > > > Feel free to step in here and help to improve the situation. You'll get as much > > help as possible by us and we will assist as much as we can. > > I can spend like a day per week for contribution to the project. > Can you please, email me steps I should take?? And people I should be in > contact with?? > Thank you, > Cem https://pinoytambayantoday.su https://dramacool.name https://isharoisharomein.su/ I got this web site from my friend who told me concerning this web page and now this time I am visiting this web site and reading very informative content here.