Conversation
Codecov Report❌ Patch coverage is Additional details and impacted files@@ Coverage Diff @@
## master #363 +/- ##
==========================================
+ Coverage 87.58% 88.06% +0.48%
==========================================
Files 52 54 +2
Lines 4606 4760 +154
Branches 1297 1327 +30
==========================================
+ Hits 4034 4192 +158
- Misses 359 372 +13
+ Partials 213 196 -17 ☔ View full report in Codecov by Sentry. 🚀 New features to boost your workflow:
|
lmd59
left a comment
There was a problem hiding this comment.
Looking good! The tests are very thorough and helpful for confirming successful implementation. I left a couple of small comments on tests. Most are just nitpick/optional, but I think a couple more aggregate tests wouldn't hurt.
I also wanted to ask about support for Long in the interval datatype
https://cql.hl7.org/04-logicalspecification.html#interval states that "An interval must be defined using a point type that supports comparison, as well as Successor and Predecessor operations, and Minimum and Maximum Value operations." Long seems like it would fit in this category. Is there any reason not to support Long as part of an interval?
|
Thanks for the excellent review! You uncovered some gaps in my implementation and also helped me to find more gaps on my own. But I will also note: be careful what you wish for! I just added a lot more changes and tests.
Thanks again for the great review. Sorry for adding a bunch more work for your review! |
- Add support for Long literal, ToLong conversion, min/max long values - Use JavaScript Number to represent Long (NOTE: this means that values are imprecise outside of the safe integer range in JS) - Add tests for literals, conversion, and other operations that accept Long arguments - Improve underflow/overflow tests to test boundaries more carefully - Added .skip to tests that fail due to Number imprecision for high values - Unskipped Long tests in the spec tests that now pass
Update support for Long to use BigInt so we can distinguish between decimal/integer (JS Number) and long (JS BigInt).
- support for <, <=, >=, > for long/bigint types - support for ConvertsToLong and Convert operator with Long
Co-authored-by: lmd59 <lmd59@cornell.edu>
- Add optional resultTypeName property to base Expression class
- Use resultTypeName when possible to distinguish between decimal and integer
- Use constants for ELM type strings (e.g., {urn:hl7-org:elm-types:r1}Decimal)
- Update spec-test-data generator CQL-to-ELM to produce resultTypes
- Unskip tests that are now passing
- Fix tests that were unintentionally incorrect based on previous incomplete type support
|
FYI: I rebased this branch on master to take in the latest |
lmd59
left a comment
There was a problem hiding this comment.
Excellent updates, and addressing a lot of new Long functionality and improved type handling!
I added some comments, but most of them are small!
| define longs_at_min_value_product: Product({-1L, 2L, 4611686018427387904L}) // -9223372036854775808 | ||
| define longs_below_min_value_product: Product({-1L, 3L, 3074457345618258603L}) // -9223372036854775809 | ||
| define decimal_product: Product({1.0, 2.0, 3.0, 4.0}) | ||
| define decimals_at_max_value_product: Product({99999999999999999999.99999999}) |
There was a problem hiding this comment.
| define decimals_at_max_value_product: Product({99999999999999999999.99999999}) | |
| define decimals_at_max_value_product: Product({99999999999999999999.99999999, 1.0}) |
Optional: Not really necessary, but might make the test a little clearer
There was a problem hiding this comment.
Yeah, it's probably better to have at least two arguments. Good catch.
| define decimal_product: Product({1.0, 2.0, 3.0, 4.0}) | ||
| define decimals_at_max_value_product: Product({99999999999999999999.99999999}) | ||
| define decimals_above_max_value_product: Product({99999999999999999999.99999999, 2.0}) | ||
| define decimals_at_min_value_product: Product({-99999999999999999999.99999999}) |
There was a problem hiding this comment.
| define decimals_at_min_value_product: Product({-99999999999999999999.99999999}) | |
| define decimals_at_min_value_product: Product({-99999999999999999999.99999999, 1.0}) |
Optional
| define decimals_at_min_value_product: Product({-99999999999999999999.99999999}) | ||
| define decimals_below_min_value_product: Product({-99999999999999999999.99999999, 2.0}) | ||
| define quantity_product: Product({1.0 'g', 2.0 'g', 3.0 'g', 4.0 'g'}) | ||
| define quantities_at_max_value_product: Product({99999999999999999999.99999999 'g'}) |
There was a problem hiding this comment.
| define quantities_at_max_value_product: Product({99999999999999999999.99999999 'g'}) | |
| define quantities_at_max_value_product: Product({99999999999999999999.99999999 'g', 1.0 'g'}) |
Optional
| if (typeof pointSize === 'number') { | ||
| pointSize = new Quantity(pointSize, '1'); | ||
| if (typeof pointSize === 'number' || typeof pointSize === 'bigint') { | ||
| pointSize = new Quantity(Number(pointSize), '1'); |
There was a problem hiding this comment.
I think ideally we'd want the pointsize for bigint to be 1n. The value and unit for a Quantity both seem to be of type any. Is there a reason not to make the pointsize into a bigint value?
There was a problem hiding this comment.
You know, I feel like I had a good reason for this -- like the spec didn't define a Long return type for size. But I'm looking at it again and most of the spec stuff around this uses <T>, so 1n seems appropriate.
Or maybe this was just a straight-up mistake. Anyway, I agree with you.
| } else if (this.high.isQuantity) { | ||
| pointSize = doSubtraction(successor(this.high), this.high); | ||
| } else { | ||
| pointSize = successor(this.high) - this.high; |
There was a problem hiding this comment.
| pointSize = this.high - predecessor(this.high); |
can overflow as is
There was a problem hiding this comment.
Woah. This bug is ancient. Git blame shows it was carried over in the conversion from .coffee to .js, which was 6 years ago, but who knows how long it was in the .coffee before that). Excellent find!
| if (b.low - a.high <= perWidth.value) { | ||
| const distance = b.low - a.high; | ||
| const comparablePerWidth = | ||
| typeof distance === 'bigint' && Number.isInteger(perWidth.value) |
There was a problem hiding this comment.
A little confused about this section. What if perWidth is a decimal? Could casting Number(b.low) below produce a precision issue?
There was a problem hiding this comment.
Since the perWidth argument is a Quantity, then the perWidth.value is a Decimal (in terms of CQL). But JS doesn't allow us to compare number w/ bigint, so we need to convert the distance and perWidth to like types.
When perWidth is an integer (no decimal component), then it's safest to convert the perWidth to a bigint and compare bigint to bigint -- because integer always converts cleanly to bigint.
But if perWidth has decimal components, then it can't be converted to bigint. The only choice we have is to convert bigint to a number. This could introduce precision issues for Longs that are greater than the max safe integer representation in JS, but there's very little we could do. So we're doing the best we can. I guess the alternative would be to throw an error if we detect that we'll lose precision, but the CQL spec doesn't indicate that collapse can throw, so this very well might take implementers by surprise.
That said, it might be safer to do Number(distance) on line 793 rather than Number(b.low) - Number(a.high) since the difference is likely to be a smaller number than b.low or b.high -- and therefore less likely to run into precision issues. So, yeah, we probably should do that at least.
| define NegInfBegContainsLong: Interval[null, 5L] contains -7L | ||
| define NegInfBegNotContainsLong: Interval[null, 5L] contains 7L | ||
| define UnknownOpenBegContainsLong: Interval(null, 5L] contains 5L | ||
| define UnknownClosedBegContainsLong: Interval[null, 5L] contains 5L |
There was a problem hiding this comment.
Isn't this neg infinity closed beginning (rather than unknown)?
There was a problem hiding this comment.
Same for all other define statements in this file starting with UnknownClosed
There was a problem hiding this comment.
Yeah. Probably a bad copy/paste exacerbated by a series of copy/pastes after.
I think that line 111 should be UnknownBegContainsLong and line 112 can be removed completely since we already have a NegInfContainsLong case. And similar changes should be made in all the other places with was copy/pasted.
| @@ -833,6 +1005,7 @@ define DateTimeIntervalEndsStartsFalse: Interval[DateTime(2012, 1, 5), DateTime( | |||
|
|
|||
| // @Test: IntegerIntervalUnion | |||
There was a problem hiding this comment.
Superoptional, but since "Integer" test sets (i.e. IntegerIntervalUnion) now include Long tests, is it worth a slight rename (or separating out Long tests) for clarity? Longs are Integers in reality, so also feel free to ignore this comment
There was a problem hiding this comment.
We should probably separate the Long tests out.
Co-authored-by: lmd59 <lmd59@cornell.edu>
|
Fantastic feedback again, @lmd59. You're making me feel like I'm getting sloppy. Thanks for the thorough review and great finds. I'll fix these soon (but probably not today). |
This PR introduces support for CQL Long, represented using
BigIntin JavaScript. Since Integer and Decimal are represented using Number, we can easily distinguish CQL Longs from Integers and Decimals by their type (typeof var === 'bigint'). This actually made implementation easier (and more correct) compared to my initial implementation using Number (which I thought would be easier since it was more of an incremental change, but maybe not).You can test this by building and running a CQL library that uses Long types -- or you can just review the unit tests and trust that they are properly exercising the capability.
Submitter:
npm run test:plusto run tests, lint, and prettier)cql4browsers.jsbuilt withnpm run build:browserifyif source changed.Reviewer:
Name: