Bug 122411 - PERCENTRANK produces Err:538 when over 100,000 rows of data referenced
Summary: PERCENTRANK produces Err:538 when over 100,000 rows of data referenced
Status: RESOLVED FIXED
Alias: None
Product: LibreOffice
Classification: Unclassified
Component: Calc (show other bugs)
Version:
(earliest affected)
6.0.1.1 release
Hardware: All Windows (All)
: medium normal
Assignee: Not Assigned
URL:
Whiteboard:
Keywords:
Depends on:
Blocks:
 
Reported: 2019-01-01 23:22 UTC by Libomark
Modified: 2019-01-02 14:58 UTC (History)
3 users (show)

See Also:
Crash report or crash signature:

Attachments
PERCENTRANK (1.40 MB, application/vnd.oasis.opendocument.spreadsheet)
2019-01-02 14:24 UTC, Oliver Brinzing 		Details
View All Add an attachment (proposed patch, testcase, etc.)

Note You need to log in before you can comment on or make changes to this bug.
Description Libomark 2019-01-01 23:22:11 UTC 
As per title:

Using 64bit Windows version 6.0.1.1, =PERCENTRANK(A1:a100001,0.5,) e.g. in cell D1, with column A1:A100001 filled with random numbers between 0 and 1  produces Err:538 (not even listed in my version of Help!)

Reduce the number of rows below 100,000 and the calculation is correct.

Contrast with PERCENTILE(), which happily deals with at least 320,000 rows.
Comment 1 Libomark 2019-01-01 23:34:21 UTC 
I imagine this has been the case ever since PERCENTRANK() was implemented.
Comment 2 Oliver Brinzing 2019-01-02 14:24:29 UTC 
Created attachment 147936 [details]
PERCENTRANK
Comment 3 Oliver Brinzing 2019-01-02 14:26:50 UTC 
reproducible with

Version: 6.0.7.3 (x64)
Build-ID: dc89aa7a9eabfd848af146d5086077aeed2ae4a5
CPU-Threads: 4; BS: Windows 10.0; UI-Render: Standard; 
Gebietsschema: de-DE (de_DE); Calc: group

but *not* reproducible anymore with

Version: 6.1.4.2 (x64)
Build ID: 9d0f32d1f0b509096fd65e0d4bec26ddd1938fd3
CPU threads: 4; OS: Windows 10.0; UI render: default; 
Locale: de-DE (de_DE); Calc: group threaded

and

Version: 6.2.0.1 (x64)
Build-ID: 0412ee99e862f384c1106d0841a950c4cfaa9df1
CPU-Threads: 4; BS: Windows 10.0; UI-Render: Standard; VCL: win; 
Gebietsschema: de-DE (de_DE); UI-Sprache: de-DE
Calc: threaded
Comment 4 Oliver Brinzing 2019-01-02 14:58:44 UTC 
setting to resolved/fixed, even if i can not find the relevant commit:

/cygdrive/d/sources/bibisect/bibisect-win32-6.1
$ git bisect log
# bad: [1d66cc00ca6fd2e562cbed88704051b2f5d989e3] source 8d2abb388b0a2423c9b7e1f52373e1b06dd9786f
# good: [29d08f54c2f71ffee4fe12dbb24c5f5cbedecfd2] source 6eeac3539ea4cac32d126c5e24141f262eb5a4d9
git bisect start 'master' 'oldest'
# bad: [3ac46f6c41b5044f162a451b10af0dc5afdcc113] source 22c7c3f54dbb93f856190c561b2540064c5a767d
git bisect bad 3ac46f6c41b5044f162a451b10af0dc5afdcc113
# bad: [aa87e2b4fca257b364e56d731159caf9884e32dd] source 7970cca95027cca9847202c6e8263124a4eb30a6
git bisect bad aa87e2b4fca257b364e56d731159caf9884e32dd
# bad: [c76d72527c9591f94ec82f87130c10fe600502f0] source a5be07d6b627a18f104e2feed063ff9020e8c610
git bisect bad c76d72527c9591f94ec82f87130c10fe600502f0
# bad: [29511c6b4a1b32ee7152a65c936b19264d5fb0ed] source 7cbedaa94f23a1f7676ff649ee6c19eb3a42dfb0
git bisect bad 29511c6b4a1b32ee7152a65c936b19264d5fb0ed
# bad: [224b94ee3b8bda787708897c9ad0f3fadb2d09be] source 035fad219e1729c9e4fe8a54fd85f23c065de616
git bisect bad 224b94ee3b8bda787708897c9ad0f3fadb2d09be
# bad: [d9bc9c7692ac60857e334bfe41694bd720283e6c] source 76f28863e7974da5a7280b3efa8a157c114ca03c
git bisect bad d9bc9c7692ac60857e334bfe41694bd720283e6c
# bad: [a5bb05703be3b9637dd4a720ae7f6d7a1141c514] source ca2bc4b6d8fb10b2b9d7bf9646b1be22be88e2ef
git bisect bad a5bb05703be3b9637dd4a720ae7f6d7a1141c514
# bad: [2ec4acdee55f82f28ddd8596d9080dd4ba1a4f93] source d685d96c3479bb75dac9ffbdb537e1ac00d33295
git bisect bad 2ec4acdee55f82f28ddd8596d9080dd4ba1a4f93
# bad: [5e324077dc7468ddcb77399b9b26861026683d3f] source ae3a10fc86620250363724d5634c09a9f61f91be
git bisect bad 5e324077dc7468ddcb77399b9b26861026683d3f
# bad: [ec94b20606d6622441d8f6a3d0bb761f61d692c5] source 2618e4a13d719122e6358d9d96864d1691e56a02
git bisect bad ec94b20606d6622441d8f6a3d0bb761f61d692c5
# bad: [c5b18f9f3db474df241362d11d88e716dd2be6d2] source 3d4a0e5cf5b7dca6a62508521849ac3908c2af05
git bisect bad c5b18f9f3db474df241362d11d88e716dd2be6d2
# bad: [f49909f76ffa1ebc935ca72e257cf2c22e7c4f07] source 5efc05bf398ace1170b3e6e2276d79342f1f607a
git bisect bad f49909f76ffa1ebc935ca72e257cf2c22e7c4f07
# bad: [c13c27fe65d9db19604819761d44d7e781873f73] source 2569e688ed34dac7282e362a6f0432e1e26cfae4
git bisect bad c13c27fe65d9db19604819761d44d7e781873f73
# first bad commit: [c13c27fe65d9db19604819761d44d7e781873f73] source 2569e688ed34dac7282e362a6f0432e1e26cfae4

bad:
Version: 6.1.0.0.alpha0+
Build ID: 2569e688ed34dac7282e362a6f0432e1e26cfae4
CPU threads: 4; OS: Windows 10.0; UI render: default; 
Locale: de-DE (de_DE); Calc: group threaded

good:
Version: 6.1.4.0.0+
Build ID: 8d2abb388b0a2423c9b7e1f52373e1b06dd9786f
CPU threads: 4; OS: Windows 10.0; UI render: default; 
Locale: de-DE (de_DE); Calc: group threaded