This is an archived snapshot of W3C's public bugzilla bug tracker, decommissioned in April 2019. Please see the home page for more details.

Bug 2816 - Precision on decimal values in XQTS
Summary: Precision on decimal values in XQTS
Status: RESOLVED FIXED
Alias: None
Product: XML Query Test Suite
Classification: Unclassified
Component: XML Query Test Suite (show other bugs)
Version: 0.8.4
Hardware: PC Linux
: P2 normal
Target Milestone: ---
Assignee: Ravindranath (Ravi) Chennoju
QA Contact:
URL:
Whiteboard:
Keywords:
Depends on:
Blocks:
 
Reported: 2006-02-09 01:55 UTC by Jerome Simeon
Modified: 2006-04-13 21:07 UTC (History)
0 users

See Also:

Attachments

Description Jerome Simeon 2006-02-09 01:55:45 UTC 
The test suite does not seem to be clear on which precision is
  assumed for decimal values.

  Some of the tests, truncate the result after the 18th digit. For
  instance:

    op-numeric-dividenint2args-3
    op-numeric-dividepint2args-5
    op-numeric-dividesht2args-5

  While some other tests seems to assume support for a precision
  beyond then 18th digit. For instance:

    fn-insert-before-mix-args-007
    fn-insert-before-mix-args-008

- Jerome
Comment 1 Jerome Simeon 2006-02-20 23:49:20 UTC 
There is a similar problem with VarDecl020, for which a 18th digit precision
should result in the integer 10.
- Jerome
Comment 2 Carmelo Montanez 2006-03-16 15:44:22 UTC 
Jerome:

I think, we decided that 18 is the magic number at one of the meetings.
Assigning this bug to Ravi as this affect his tests.

Thanks,
carmelo
Comment 3 Ravindranath (Ravi) Chennoju 2006-04-13 21:07:47 UTC 
Fixed fn-insert-before-mix-args-007, fn-insert-before-mix-args-008, and VarDecl020. Used <=18 digits after decimal point.