Bug 120560 - Calc Spreadsheet arithmetic error depending on cell width
Summary: Calc Spreadsheet arithmetic error depending on cell width
Status: RESOLVED NOTABUG
Alias: None
Product: LibreOffice
Classification: Unclassified
Component: Calc (show other bugs)
Version:
(earliest affected)
6.1.2.1 release
Hardware: Other All
: medium normal
Assignee: Not Assigned
URL:
Whiteboard:
Keywords:
Depends on:
Blocks:
 
Reported: 2018-10-13 09:40 UTC by Joel Hilsenrath
Modified: 2018-10-13 12:10 UTC (History)
1 user (show)

See Also:
Crash report or crash signature:

Attachments
video describing the bug (831.51 KB, video/mp4)
2018-10-13 11:11 UTC, BogdanB 		Details
View All Add an attachment (proposed patch, testcase, etc.)

Note You need to log in before you can comment on or make changes to this bug.
Description Joel Hilsenrath 2018-10-13 09:40:12 UTC 
Description:
I installed version 6.1.2.1 on a Windows 8.1 Toshiba laptop.  The error occurs when the cell width exceeds 1.25".  

In a wide cell, I typed:
     =267.52-266.54 

The result is: 
     0.979999999999961 

I get the same result when I put the values in two cells, and do the subtraction by reference.  




Steps to Reproduce:
1. set cell width to exceed 1.25"
2. type:    =267.52-266.54
3. hit <ENTER> 

Actual Results:
0.979999999999961

Expected Results:
0.98 


Reproducible: Always


User Profile Reset: No



Additional Info:
[Information automatically included from LibreOffice]
Locale: en-US
Module: StartModule
[Information guessed from browser]
OS: Windows (All)
OS is 64bit: no

===================

Version: 6.1.2.1 (x64)
Build ID: 65905a128db06ba48db947242809d14d3f9a93fe
CPU threads: 4; OS: Windows 6.3; UI render: default; 
Locale: en-US (en_US); Calc: group threaded
Comment 1 BogdanB 2018-10-13 11:11:43 UTC 
Created attachment 145671 [details]
video describing the bug

See the video.

Confirmed on
Version: 6.2.0.0.alpha0+
Build ID: 144da6d5079bcd435e6637cb5cf95305f3ec1306
CPU threads: 4; OS: Linux 4.15; UI render: default; VCL: gtk2; 
TinderBox: Linux-rpm_deb-x86_64@70-TDF, Branch:master, Time: 2018-10-12_02:13:01
Locale: ro-RO (ro_RO.UTF-8); Calc: threaded
Comment 2 Xavier Van Wijmeersch 2018-10-13 12:10:50 UTC 
Sorry no bug, 
In Option => Libreoffice Calc => calculate there
you can check the option "Limit decimals for general numbers" exp to 2

If you not agree you can reopen the report

Best regards