-
Notifications
You must be signed in to change notification settings - Fork 0
Roadmap
Saif Shabou edited this page Jun 16, 2021
·
37 revisions
This document provides a global view of the OpenGeoScales project features and status with respect to its different dimensions.
Nomenclature:
- To do: π΄
- In progress: π§
- Done: βοΈ
Explore ghg emissions data provided by various data sources and share data analysis notebooks.
| Tasks | Responsible | Status | Delivery |
|---|---|---|---|
| Explore GCP | Yann | βοΈ | Raw Data Exploration |
| Explore CDP | Florestan | βοΈ | Raw Data Exploration |
| Explore WRI-CAIT | Clement | βοΈ | Raw Data Exploration |
| Explore WRI-UNFCCC | Lara | βοΈ | Raw Data Exploration |
| Explore OWID | Line, Jinqi | βοΈ | Raw Data Exploration |
| Explore PRIMAP-HIST | Sebastien | βοΈ | Raw Data Exploration |
| Explore OECD | Ernesto | βοΈ | Raw Data Exploration |
| Explore CDIAC | Diem, Antoine H | βοΈ | Raw Data Exploration |
| Explore EDGAR | David | π§ | |
| Explore ADEME | Saif, Gael | π§ | Raw Data Exploration |
Document data sources by referencing metadata and providing a json file synthesizing data secription (spatial and temporal converage, resolution, completeness...)
| Takss | Responsible | Status | Delivery |
|---|---|---|---|
| GCP dataset description | Yann | π΄ | |
| CDP dataset description | Florestan | π΄ | |
| WRI-CAIT dataset description | Clement | βοΈ | Data Catalog |
| WRI-UNFCCC dataset description | Lara | π΄ | |
| OWID dataset description | Line, Jinqi | βοΈ | Data catalog |
| PRIMAP-HIST dataset description | Sebastien | βοΈ | Data catalog |
| OECD dataset description | Ernesto | βοΈ | Data catalog |
| CDIAC dataset description | Diem, Antoine H | βοΈ | Data catalog |
| EDGAR dataset description | David | π§ | |
| ADEME dataset description | Saif, Gael | π§ | Data catalog |
| Combine Data catalog | Line, Saif | π΄ |
The goal of this phase consists of testing the integration data model schema and producing for each data source:
- Necessary fields and cotegories mapping based on this document: https://docs.google.com/spreadsheets/d/1CnTpHjZZZepgJ1o1VuQUN61ZaLLRtM1OhZzJU9HCPaY/edit#gid=2038606787
- Notebook for mapping data source with the defiend data model
- A json file containing the mapped data source and stored in a
data source name/mapped/Mappaed_datasourcename.json
| Tasks | Responsibles | Status | Delivery |
|---|---|---|---|
| Staging data model | Rafael, Gilles | βοΈ | Staging data model doc |
| Staging data mapping | Saif | βοΈ | Staging data mapping doc |
| S3 storage structure | Saif | βοΈ | S3 storage doc |
| S3 copying raw data | Saif | βοΈ | S3 storage doc |
| GCP - Mapping test | Yann | βοΈ | Mapping script, Mapped data |
| OWID - Mapping test | Line | βοΈ | Mapping script, Mapped data |
| WRI-CAIT - Mapping test | Clement | βοΈ | Mapping script, Mapped data |
| WRI-UNFCCC - Mapping test | Lara | βοΈ | Mapping script, Mapped data |
| PRIMAP-HIST - Mapping test | Sebastien | βοΈ | Mapping script, Mapped data |
| EDGAR - Mapping test | David, Yann | βοΈ | Mapping script, Mapped data |
| OECD - Mapping test | Ernesto | βοΈ | |
| CDP - Mapping test | Florestan | π§ | |
| CDIAC - Mapping test | Diem | π§ | Mapping script, Mapped data |
| ADEME - Mapping test | Gael | π΄ | |
| Cross-datasource Mapping validation | Yann | π§ |
| Tasks | Responsibles | Status | Delivery |
|---|---|---|---|
| Building connector framework | Rafael | βοΈ | Connectors Tutorial doc |
| GCP - Integration | Rafael Yann | βοΈ | GCP connector |
| OWID - Integration | Rafael Line | π΄ | |
| WRI-CAIT - Integration | Rafael Clement | π΄ | |
| WRI-UNFCCC - Integration | Rafael Lara | βοΈ | |
| CDP - Integration | Rafael Florestan | π΄ | |
| PRIMAP-HIST - Integration | Rafael Sebastien | π΄ | |
| OECD - Integration | Rafael Ernesto | π΄ | |
| EDGAR - Integration | Rafael Yann David | π΄ | |
| CDIAC - Integration | Diem | π΄ | |
| ADEME - Integration | Rafael | π§ | ADEME connector |
| Tasks | Responsibles | Status | Delivery |
|---|---|---|---|
| Storage data model | Rafael, Gilles, Diem, David | π§ | Storage data model doc |
| Database building | Rafael | π§ | |
| geo_component table validation | π΄ | ||
| emissions table validation | π΄ | ||
| sectors table validation | π΄ | ||
| gas table validation | π΄ |
| Tasks | Responsibles | Status | Delivery |
|---|---|---|---|
| Exposure data model | Rafael, Gilles, Saif | π§ | Exposure data model doc |
| API filters specification | Saif | π§ | Filters sepcificationl doc |
| API - country root | Gilles | βοΈ | API repository |
| API - city root | π΄ | ||
| API - grid root | π΄ |
| data source | raw exploration | staging - mapping testing | mapped - integration fwk | aggregated - mongodb storage | exposed - mongodb vue | visualized - Shiny web app |
|---|---|---|---|---|---|---|
| gcp | βοΈ | βοΈ | βοΈ | βοΈ | βοΈ | βοΈ |
| ademe | βοΈ | βοΈ | βοΈ | π§ | π§ | π΄ |
| wri-cait | βοΈ | βοΈ | π΄ | π΄ | π΄ | π΄ |
| wri-unfccc | βοΈ | βοΈ | βοΈ | βοΈ | βοΈ | βοΈ |
| owid | βοΈ | βοΈ | π΄ | π΄ | π΄ | π΄ |
| oecd | βοΈ | βοΈ | π΄ | π΄ | π΄ | π΄ |
| edgar | βοΈ | π§ | π΄ | π΄ | π΄ | π΄ |
| cdp | βοΈ | π§ | π΄ | π΄ | π΄ | π΄ |
| cdiac | βοΈ | π§ | π΄ | π΄ | π΄ | π΄ |
| Tasks | Responsibles | Status | Delivery |
|---|---|---|---|
| Access management | Saif | βοΈ | S3 access management |
| Billing management | Gilles, Saif | π§ |
| Tasks | Responsibles | Status | Delivery |
|---|---|---|---|
| Logo creation | Antoine P | βοΈ | Logo visuals |
| Graphical charter | Antoine P | βοΈ | Graphical template |
| Website v0 repository | Saif | βοΈ | Repos website |
| Website v0 content | Saif, Antoine B, Antoine P | π§ | website |
| Website v1 template | Antoine P | βοΈ | website templates benchmark |
| Website v1 repository | Saif | π΄ | |
| Website v1 building | Saif, Antoine P | π΄ | |
| Website v1 content | Saif, Antoine B | π§ |
| Tasks | Responsibles | Status | Delivery |
|---|---|---|---|
| Economic Activities referentials | Antoine B | π§ | Economic Activities referentials |
| Emissions estimation concepts | Antoine B | π§ | Emissions estimation concepts |
| Project description article | Saif, Antoine B | βοΈ | Synthesis article |
| Tasks | Responsibles | Status | Delivery |
|---|---|---|---|
| Linked'in page | Saif | βοΈ | Linked'in page |
| twitter account | Antoine B | βοΈ | twitter account > follow it! |
| Partners referencing | Saif, Antoine B | π§ | potential partners |
| Partnerships - Open Knowledge Foundation | Saif, | π§ | |
| Partnerships - GCP | Saif, | π§ | |
| Partnerships - WRI | Saif, | π§ | |
| Partnerships - IGE | Saif, | π§ | |
| Partnerships - Carbone4 | Saif, Antoine B | π§ |
| Tasks | Responsibles | Status | Delivery |
|---|---|---|---|
| Events referencing | Saif | π§ | Events inventory |
| Net Zero Challenge | Saif | βοΈ | |
| Open data Days | Saif, Antoine B | βοΈ | |
| Cop26 |
| Tasks | Responsibles | Status | Delivery |
|---|---|---|---|
| Short term Roadmap management | Saif | π§ | |
| Long term Roadmap management | Antoine B | π§ | long term roadmap |
| Contribution rules | |||
| Issue template | |||
| Use cases definition | Antoine B, Line | π§ | Target users and Uses cases |
| Tasks | Responsibles | Status | Delivery |
|---|---|---|---|
| Association building | Saif, David, Sophie | βοΈ | Official declaration |
| Bank account | Sophie | π§ | |
| SIREN number | Saif | βοΈ | SIREN |
| Tasks | Responsibles | Status | Delivery |
|---|---|---|---|
| Funding referencing | Saif | π§ | Funding inventory |
| Net Zero Challenge Price | Saif | βοΈ | |
| European Open Data Days Price | Saif, Antoine B | π§ | |
| AWS credits | Saif | π΄ | |
| Microsoft Azure credits | Saif | π΄ |