Fix final matrix schema

[piotrkan]

Describe the bug
Our pipeline is producing matrix with source_ec_id as col name for ec ids. Orchard is expecting ec_drug_id so there is divergence there

We should modify the schema of full_matrix_output dataset to have matrix compatible schema

Expected behavior
A clear and concise description of what you expected to happen.

Screenshots
If applicable, add screenshots to help explain your problem.

Additional context
Add any other context about the problem here.

[IamMikeHelsel]

Describe the bug
Our pipeline is producing matrix with source_ec_id as col name for ec ids. Orchard is expecting ec_drug_id so there is divergence there

So far have you see any other variations? Trying to understand the level of drift over time (still ramping up on dataflow and whether this drift is internal or external to the project.

[piotrkan]

@IamMikeHelsel this is external to the matrix project, the final output of the pipeline is ingested by a different (internal) pipeline which plugs into orchard (internal web platform for reviewing drug-disease candidates). So this is not really a matrix project bug but inconsistency across different workflows. We had some other variations of the matrix schema over time (eg in #1885) - hope that explains it a bit more, I think this might be a tricky one for non-internal contributor

also thanks for reaching out on this one and some other issues, much appreciated🚀
can I ask - how did you stumble upon the matrix project? Was it by accident or through Every Cure? and would be great to understand your motivation a bit more!

[IamMikeHelsel]

Listened to the Freakonomics episode and looked the team up to see how I could get involved. I have a volunteer app in with the website