Project

General

Profile

task #9123

Fix BigDecimal algebra in aggregation algorithms

Added by Andreas Müller over 1 year ago. Updated 3 days ago.

Status:
Closed
Priority:
Priority14
Category:
cdmlib
Target version:
Start date:
07/04/2020
Due date:
% Done:

100%

Severity:
normal

Description

see #8978 for details


Related issues

Related to Edit - feature request #8978: Implement measurement values as BigDecimal Closed 04/25/2020
Related to Edit - feature request #9080: Use detailElement of quantitative data in dialog of character matrix New 06/18/2020
Related to Edit - feature request #7980: Enhance matrix description aggregation Closed 01/14/2019
Copied from Edit - task #9810: Test if BigDecimal algebra is correct in PolytomousKey algorithms New 10/12/2021

Associated revisions

Revision b55fc921 (diff)
Added by Andreas Müller 17 days ago

ref #9123 add rounding to average computing in DDS aggregation (not yet complete)

Revision b7cfb9fb (diff)
Added by Andreas Müller 16 days ago

ref #9123 improve precision handling for average computing in DDS aggregation

History

#1 Updated by Andreas Müller over 1 year ago

#2 Updated by Andreas Müller over 1 year ago

  • Related to feature request #9080: Use detailElement of quantitative data in dialog of character matrix added

#3 Updated by Andreas Müller 11 months ago

  • Target version changed from Release 5.18 to Release 5.19

#4 Updated by Andreas Müller 9 months ago

  • Target version changed from Release 5.19 to Release 5.21

#5 Updated by Andreas Müller 7 months ago

  • Target version changed from Release 5.21 to Release 5.22

#6 Updated by Andreas Müller 6 months ago

  • Target version changed from Release 5.22 to Release 5.29

#7 Updated by Andreas Müller 17 days ago

  • Status changed from New to In Progress
  • Target version changed from Release 5.29 to Release 5.28

There is a problem with average computing in aggregation. RoundingMode is missing.
Once this is fixed we need to check how to handle that rounding errors are not propagated etc.

#8 Updated by Andreas Müller 17 days ago

#9 Updated by Andreas Müller 16 days ago

  • % Done changed from 0 to 20

Rounding in aggregation is now done using MathContext.DECIMAL32 and stripTrailingZeros(). This avoids rounding errors when computing average. stripTrailingZeros() may sometimes reduce precision more then it should by it avoids having always a precision=7 once there was a single computation step that resulted in a rounding issue.
As average is not an important parameter for aggregation this should be sufficient.

#10 Updated by Andreas Müller 16 days ago

  • Target version changed from Release 5.28 to Release 5.27

#11 Updated by Andreas Müller 3 days ago

  • Copied from task #9810: Test if BigDecimal algebra is correct in PolytomousKey algorithms added

#12 Updated by Andreas Müller 3 days ago

  • Tags changed from additivity to additivity, aggregation
  • Subject changed from Test if BigDecimal algebra is correct in Aggregation and PolytomousKey algorithms to Fix BigDecimal algebra in aggregation algorithms
  • Status changed from In Progress to Closed
  • Priority changed from New to Priority14
  • % Done changed from 20 to 100

Moved polytomous key handling to new ticket #9810

Also available in: Atom PDF

Add picture from clipboard (Maximum size: 40 MB)