[OASIS Issue Tracker] (ODATA-784) Need to specify the behaviour of arithmetic operators on Decimal type

[OASIS Issues Tracker <workgroup_mailer@lists.oasis-open.org>]

    [ https://issues.oasis-open.org/browse/ODATA-784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=58652#comment-58652 ] 

Evan Ireland commented on ODATA-784:
------------------------------------

Since decimals are frequently used to avoid problems with rounding, it is best to avoid unexpected behaviour.

Suppose an implementation has maximum precision of 5 (just for the purpose of example, rathe it might be 28/29/34/36 etc).
Now consider 1.0 div 3. Is it 0.3 (my proposal) or 0.33333 ("sufficient scale").

In regard to a filter, (A div 3) gt 0.3. Is it true or false when A = 1.0?

Rounding rules need to be highly predictable with decimal.



> Need to specify the behaviour of arithmetic operators on Decimal type
> ---------------------------------------------------------------------
>
>                 Key: ODATA-784
>                 URL: https://issues.oasis-open.org/browse/ODATA-784
>             Project: OASIS Open Data Protocol (OData) TC
>          Issue Type: Improvement
>          Components: OData URL Conventions
>    Affects Versions: V4.0_OS
>            Reporter: Evan Ireland
>            Priority: Minor
>             Fix For: V4.0_ERRATA03
>
>
> The rules for scale of results of decimal arithmetic operators are not specified.



--
This message was sent by Atlassian JIRA
(v6.2.2#6258)