Skip to content

remove file extension#38

Open
SFJohnson24 wants to merge 2 commits into
mainfrom
file_extension
Open

remove file extension#38
SFJohnson24 wants to merge 2 commits into
mainfrom
file_extension

Conversation

@SFJohnson24
Copy link
Copy Markdown
Collaborator

  • updates all results.csv for non-usdm data
  • updates the results script that produces the csv for nonusdm data

header = ["Dataset", "Record", "Variable", "Value"]
rows = []
for issue in issue_details:
dataset = issue.get("dataset", "")
Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Where is the csv coming from in the first place? The data in sharepoint doesn't have csv extensions...

Copy link
Copy Markdown
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

convert() on line 58 in this file--takes the json results output, converts to csv

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

instead of adding logic here, can you update the logic at the source that converts these from ae.xpt to ae.csv?

Comment thread Published/CORE-000001/negative/01/results/results.csv Outdated
@SFJohnson24 SFJohnson24 requested a review from gerrycampion May 18, 2026 19:51
Copy link
Copy Markdown
Collaborator

@gerrycampion gerrycampion left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I also looked at some of the usdm files and I see the path value is messed up. For example, see this file:
https://github.com/cdisc-org/cdisc-open-rules/blob/main/Published/CORE-000940/negative/01/results/results.csv

@gerrycampion gerrycampion self-requested a review May 19, 2026 17:01
Copy link
Copy Markdown
Collaborator

@gerrycampion gerrycampion left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

it looks like at one point we were using 0-indexing for results, but now we are using 1-indexing. this is throwing off a bunch of the open rules test results.
We don't know which ones have 0-indexing and which ones have 1-indexing, so I'm not sure the best way to fix this. 2 ideas:

  • compare the row numbers between sharepoint results and the engine results and replace where all numbers are off by 1.
  • figure out the date at which we made the switch and use the file timestamps.

@SFJohnson24 SFJohnson24 requested a review from gerrycampion May 22, 2026 00:26
@SFJohnson24
Copy link
Copy Markdown
Collaborator Author

I also looked at some of the usdm files and I see the path value is messed up. For example, see this file: https://github.com/cdisc-org/cdisc-open-rules/blob/main/Published/CORE-000940/negative/01/results/results.csv

see: #40 for USDM fix

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants