Add a way to set input parameters for test case evaluation.
Need a generic structure for test cases, that generalizes the existing test cases in use for knowledge artifacts, which include:
- Library test cases, expressed as an Parameters-expected-results resource, defaulting to "true"
- PlanDefinition test cases, expressed as an expected GuidanceResponse resource
- Measure test cases, expressed as an expected MeasureReport resource
Need the ability to specify, for each test case:
- The artifact to be tested
- The operation to be performed
- The input parameters
- The input test data
- The expected output resource(s)
Need the ability to specify groups of test cases associated with a particular artifact
Need the ability to specify suites of test case groups across artifacts
Need the ability to specify common/shared data among test cases at any level
Proposed structure:
Test case:
Library/$evaluate test case:
- Parameters-input.json
- Parameters-expected.json
Measure/$evaluate test case:
- Parameters-input.json
- MeasureReport-expected.json
Simplest approach is just to expect the presence of a Parameters-input resource that, if present, is used to provide parameters.
This resource can be in the input/tests, input/tests/[artifact] or input/tests/[artifact]/[case] folders
Add a way to set input parameters for test case evaluation.
Need a generic structure for test cases, that generalizes the existing test cases in use for knowledge artifacts, which include:
Need the ability to specify, for each test case:
Need the ability to specify groups of test cases associated with a particular artifact
Need the ability to specify suites of test case groups across artifacts
Need the ability to specify common/shared data among test cases at any level
Proposed structure:
Test case:
Library/$evaluate test case:
Measure/$evaluate test case:
Simplest approach is just to expect the presence of a Parameters-input resource that, if present, is used to provide parameters.
This resource can be in the input/tests, input/tests/[artifact] or input/tests/[artifact]/[case] folders