Skip to content

Add Central Model demo on SMAP data #16

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
Shadow-AI wants to merge 101 commits into
base: main
Choose a base branch
from
Open

Add Central Model demo on SMAP data #16

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
101 commits
Select commit Hold shift + click to select a range
cc87302
add demo2
Shadow-AI Sep 20, 2024
7ba4492
add demo1
Shadow-AI Sep 20, 2024
c6a2180
update locations, adn remove the postamplify
Shadow-AI Sep 20, 2024
c71994c
push py file
Shadow-AI Sep 23, 2024
3fb53ad
fix py file; ipynb file was testing on trained data. is wrong. py fil…
Shadow-AI Sep 23, 2024
766ea9d
save model
Shadow-AI Sep 23, 2024
c3a8cf5
...
Shadow-AI Sep 24, 2024
b6db80d
add a template of sorts for demos.
Shadow-AI Sep 24, 2024
cfefe6a
add a template of sorts for demos.
Shadow-AI Sep 24, 2024
ed77174
Add template
amad-person Sep 25, 2024
a572bd2
Add comments
amad-person Sep 25, 2024
eef4aa3
Add comments to generate
amad-person Sep 25, 2024
5bed2d6
Add comments to train
amad-person Sep 25, 2024
4d0c998
Add instructions for standardizing
amad-person Sep 25, 2024
a4805bc
insert shinan stuff into this demo
Shadow-AI Sep 26, 2024
095985e
add data files
Shadow-AI Sep 26, 2024
790bcaa
Convert product demo finance to follow template
amad-person Sep 27, 2024
c7b7024
Close session
amad-person Sep 27, 2024
212558d
boom
Shadow-AI Sep 27, 2024
d030a34
boom
Shadow-AI Sep 30, 2024
8bda802
Init plot
amad-person Sep 30, 2024
5027901
Update plot
amad-person Sep 30, 2024
369a09b
Update pred
amad-person Sep 30, 2024
d4ce3c1
Add comments after feedback
amad-person Sep 30, 2024
fcb691f
Refactor to use multiple downstream model types
amad-person Sep 30, 2024
c1c4523
Add window forecasting
amad-person Sep 30, 2024
fe5a53c
blah
Shadow-AI Oct 1, 2024
3e113b0
Add neural_prophet and kalman model types
amad-person Oct 1, 2024
1e40e6f
Update
amad-person Oct 1, 2024
533c98c
commit stuff
Shadow-AI Oct 2, 2024
fa65dda
Print all metrics
amad-person Oct 2, 2024
001990b
Merge remote branch into local
amad-person Oct 2, 2024
27695e5
commit stuff
Shadow-AI Oct 2, 2024
cb04bdb
Merge branch 'refs/heads/main' into demos
Shadow-AI Oct 2, 2024
d54b988
Update template
amad-person Oct 3, 2024
9614f62
Update scripts after new data preprocessing
amad-person Oct 3, 2024
53b4d1b
Save syn for data quality checks
amad-person Oct 3, 2024
614443b
Merge remote-tracking branch 'origin/demos' into demos
Shadow-AI Oct 3, 2024
f629f19
Merge branch 'refs/heads/main' into demos
Shadow-AI Oct 3, 2024
4f6416f
woah
Shadow-AI Oct 3, 2024
3b62ed8
fix seed
Shadow-AI Oct 3, 2024
e187cfc
change limit
Shadow-AI Oct 3, 2024
c418f25
:)
Shadow-AI Oct 3, 2024
dde7cba
Update scripts
amad-person Oct 3, 2024
43652db
Merge branch 'demos' of https://github.com/Rockfish-Data/public_tutor…
amad-person Oct 3, 2024
a5dd48d
entire kitchen sink
Shadow-AI Oct 3, 2024
f1ba53b
plots
Shadow-AI Oct 3, 2024
adb176e
Update scripts
amad-person Oct 3, 2024
fb84228
Clean up
amad-person Oct 3, 2024
1cea1b4
Demos t (#15)
Shadow-AI Oct 4, 2024
5b3765a
update template to allow for the fidelity_requirements
Shadow-AI Oct 7, 2024
48c859b
remove import
Shadow-AI Oct 7, 2024
305d2f5
refactor
Shadow-AI Oct 7, 2024
7266e9b
add netflow
Shadow-AI Oct 7, 2024
eee4b67
add netflow
Shadow-AI Oct 7, 2024
6630092
Update product demo to use new data
amad-person Oct 7, 2024
fc07b69
Merge branch 'demos' of https://github.com/Rockfish-Data/public_tutor…
amad-person Oct 7, 2024
373c1d8
Fix imports
amad-person Oct 7, 2024
fec2229
Update onboard dq checks
amad-person Oct 7, 2024
ef29e1e
Refactor
amad-person Oct 7, 2024
b5829d3
push demo-able changes
Shadow-AI Oct 7, 2024
25d607a
push demo-able changes: uncomment labels
Shadow-AI Oct 7, 2024
50476f5
await close
Shadow-AI Oct 8, 2024
733203c
Update product demo train.py
amad-person Oct 8, 2024
0739638
Update product demo train.py
amad-person Oct 8, 2024
b083ed3
Update onboard.py
amad-person Oct 9, 2024
8b9b0d7
Update template, rename files
amad-person Oct 9, 2024
3265f6c
Update onboard for demo
amad-person Oct 9, 2024
f2f2b4b
Use simpler data quality checks
amad-person Oct 10, 2024
bbf5899
Update
amad-person Oct 10, 2024
84b00c1
Update
amad-person Oct 10, 2024
2db1917
Update all train.py to not show async warnings
amad-person Oct 11, 2024
54296f5
Update generate
amad-person Oct 11, 2024
b80ad58
Update generate for product demo
amad-person Oct 11, 2024
f36434c
clean downstream
Shadow-AI Oct 16, 2024
9a199b9
clean onboard
Shadow-AI Oct 16, 2024
52453b1
clean train
Shadow-AI Oct 16, 2024
6d4e734
update datafiles
Shadow-AI Oct 16, 2024
08abd6d
clean generate
Shadow-AI Oct 16, 2024
b5b6368
clean downstream
Shadow-AI Oct 16, 2024
6c9dac4
remove processing [pre/post]
Shadow-AI Oct 16, 2024
773a118
remove items other than relevant demos
Shadow-AI Oct 16, 2024
95e5e38
remove fidelity_compute.ipynb
Shadow-AI Oct 16, 2024
6d552ca
remove confs
Shadow-AI Oct 16, 2024
d205de1
remove product_demo
Shadow-AI Oct 16, 2024
ae54e15
remove tempalte
Shadow-AI Oct 16, 2024
ff8764c
update graphs
Shadow-AI Oct 16, 2024
3283957
pull out sample_syn.csv and update onboard to reflect
Shadow-AI Oct 16, 2024
20fe68a
comment out file write for forecasted files
Shadow-AI Oct 16, 2024
849a007
remove extraneous data
Shadow-AI Oct 16, 2024
4293cd0
add note for connection object usage
Shadow-AI Oct 16, 2024
5168551
add notebook for the same demo
Shadow-AI Oct 18, 2024
7ef60c6
add download to file
Shadow-AI Dec 2, 2024
ba2fe18
add downstream utils
Shadow-AI Dec 2, 2024
4ccc1b6
fix path links
Shadow-AI Dec 2, 2024
59dee35
minor fix
Shadow-AI Dec 2, 2024
d7fc320
follow aadyaa format
Shadow-AI Dec 18, 2024
446b211
instruction for prophet installation
Shadow-AI Dec 18, 2024
4329715
scikit
Shadow-AI Dec 18, 2024
72fdb12
fix for silly connection change i accidentally pushed
Shadow-AI Dec 18, 2024
c81d08e
update connection object, explicitly setting api url
Shadow-AI Jan 3, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
The table of contents is too big for display.
Diff view
Diff view
  •  
  •  
  •  
2,821 changes: 2,821 additions & 0 deletions Demos/Central_Model_SMAP/central_model_smap.ipynb
View file
Open in desktop

Large diffs are not rendered by default.

12,961 changes: 12,961 additions & 0 deletions Demos/Central_Model_SMAP/datafiles/location1.csv
View file
Open in desktop

Large diffs are not rendered by default.

12,960 changes: 12,960 additions & 0 deletions Demos/Central_Model_SMAP/datafiles/location2.csv
View file
Open in desktop

Large diffs are not rendered by default.

12,899 changes: 12,899 additions & 0 deletions Demos/Central_Model_SMAP/datafiles/location3.csv
View file
Open in desktop

Large diffs are not rendered by default.

59 changes: 59 additions & 0 deletions Demos/Central_Model_SMAP/datafiles/location3_hours/location3_2023-08-05_hour00.csv
View file
Open in desktop

Large diffs are not rendered by default.

59 changes: 59 additions & 0 deletions Demos/Central_Model_SMAP/datafiles/location3_hours/location3_2023-08-05_hour00_timestamp.csv
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,59 @@
timestamp
2023-08-05 00:02:00
2023-08-05 00:03:00
2023-08-05 00:04:00
2023-08-05 00:05:00
2023-08-05 00:06:00
2023-08-05 00:07:00
2023-08-05 00:08:00
2023-08-05 00:09:00
2023-08-05 00:10:00
2023-08-05 00:11:00
2023-08-05 00:12:00
2023-08-05 00:13:00
2023-08-05 00:14:00
2023-08-05 00:15:00
2023-08-05 00:16:00
2023-08-05 00:17:00
2023-08-05 00:18:00
2023-08-05 00:19:00
2023-08-05 00:20:00
2023-08-05 00:21:00
2023-08-05 00:22:00
2023-08-05 00:23:00
2023-08-05 00:24:00
2023-08-05 00:25:00
2023-08-05 00:26:00
2023-08-05 00:27:00
2023-08-05 00:28:00
2023-08-05 00:29:00
2023-08-05 00:30:00
2023-08-05 00:31:00
2023-08-05 00:32:00
2023-08-05 00:33:00
2023-08-05 00:34:00
2023-08-05 00:35:00
2023-08-05 00:36:00
2023-08-05 00:37:00
2023-08-05 00:38:00
2023-08-05 00:39:00
2023-08-05 00:40:00
2023-08-05 00:41:00
2023-08-05 00:42:00
2023-08-05 00:43:00
2023-08-05 00:44:00
2023-08-05 00:45:00
2023-08-05 00:46:00
2023-08-05 00:47:00
2023-08-05 00:48:00
2023-08-05 00:49:00
2023-08-05 00:50:00
2023-08-05 00:51:00
2023-08-05 00:52:00
2023-08-05 00:53:00
2023-08-05 00:54:00
2023-08-05 00:55:00
2023-08-05 00:56:00
2023-08-05 00:57:00
2023-08-05 00:58:00
2023-08-05 00:59:00
61 changes: 61 additions & 0 deletions Demos/Central_Model_SMAP/datafiles/location3_hours/location3_2023-08-05_hour01.csv
View file
Open in desktop

Large diffs are not rendered by default.

61 changes: 61 additions & 0 deletions Demos/Central_Model_SMAP/datafiles/location3_hours/location3_2023-08-05_hour01_timestamp.csv
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,61 @@
timestamp
2023-08-05 01:00:00
2023-08-05 01:01:00
2023-08-05 01:02:00
2023-08-05 01:03:00
2023-08-05 01:04:00
2023-08-05 01:05:00
2023-08-05 01:06:00
2023-08-05 01:07:00
2023-08-05 01:08:00
2023-08-05 01:09:00
2023-08-05 01:10:00
2023-08-05 01:11:00
2023-08-05 01:12:00
2023-08-05 01:13:00
2023-08-05 01:14:00
2023-08-05 01:15:00
2023-08-05 01:16:00
2023-08-05 01:17:00
2023-08-05 01:18:00
2023-08-05 01:19:00
2023-08-05 01:20:00
2023-08-05 01:21:00
2023-08-05 01:22:00
2023-08-05 01:23:00
2023-08-05 01:24:00
2023-08-05 01:25:00
2023-08-05 01:26:00
2023-08-05 01:27:00
2023-08-05 01:28:00
2023-08-05 01:29:00
2023-08-05 01:30:00
2023-08-05 01:31:00
2023-08-05 01:32:00
2023-08-05 01:33:00
2023-08-05 01:34:00
2023-08-05 01:35:00
2023-08-05 01:36:00
2023-08-05 01:37:00
2023-08-05 01:38:00
2023-08-05 01:39:00
2023-08-05 01:40:00
2023-08-05 01:41:00
2023-08-05 01:42:00
2023-08-05 01:43:00
2023-08-05 01:44:00
2023-08-05 01:45:00
2023-08-05 01:46:00
2023-08-05 01:47:00
2023-08-05 01:48:00
2023-08-05 01:49:00
2023-08-05 01:50:00
2023-08-05 01:51:00
2023-08-05 01:52:00
2023-08-05 01:53:00
2023-08-05 01:54:00
2023-08-05 01:55:00
2023-08-05 01:56:00
2023-08-05 01:57:00
2023-08-05 01:58:00
2023-08-05 01:59:00
61 changes: 61 additions & 0 deletions Demos/Central_Model_SMAP/datafiles/location3_hours/location3_2023-08-05_hour02.csv
View file
Open in desktop

Large diffs are not rendered by default.

61 changes: 61 additions & 0 deletions Demos/Central_Model_SMAP/datafiles/location3_hours/location3_2023-08-05_hour02_timestamp.csv
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,61 @@
timestamp
2023-08-05 02:00:00
2023-08-05 02:01:00
2023-08-05 02:02:00
2023-08-05 02:03:00
2023-08-05 02:04:00
2023-08-05 02:05:00
2023-08-05 02:06:00
2023-08-05 02:07:00
2023-08-05 02:08:00
2023-08-05 02:09:00
2023-08-05 02:10:00
2023-08-05 02:11:00
2023-08-05 02:12:00
2023-08-05 02:13:00
2023-08-05 02:14:00
2023-08-05 02:15:00
2023-08-05 02:16:00
2023-08-05 02:17:00
2023-08-05 02:18:00
2023-08-05 02:19:00
2023-08-05 02:20:00
2023-08-05 02:21:00
2023-08-05 02:22:00
2023-08-05 02:23:00
2023-08-05 02:24:00
2023-08-05 02:25:00
2023-08-05 02:26:00
2023-08-05 02:27:00
2023-08-05 02:28:00
2023-08-05 02:29:00
2023-08-05 02:30:00
2023-08-05 02:31:00
2023-08-05 02:32:00
2023-08-05 02:33:00
2023-08-05 02:34:00
2023-08-05 02:35:00
2023-08-05 02:36:00
2023-08-05 02:37:00
2023-08-05 02:38:00
2023-08-05 02:39:00
2023-08-05 02:40:00
2023-08-05 02:41:00
2023-08-05 02:42:00
2023-08-05 02:43:00
2023-08-05 02:44:00
2023-08-05 02:45:00
2023-08-05 02:46:00
2023-08-05 02:47:00
2023-08-05 02:48:00
2023-08-05 02:49:00
2023-08-05 02:50:00
2023-08-05 02:51:00
2023-08-05 02:52:00
2023-08-05 02:53:00
2023-08-05 02:54:00
2023-08-05 02:55:00
2023-08-05 02:56:00
2023-08-05 02:57:00
2023-08-05 02:58:00
2023-08-05 02:59:00
61 changes: 61 additions & 0 deletions Demos/Central_Model_SMAP/datafiles/location3_hours/location3_2023-08-05_hour03.csv
View file
Open in desktop

Large diffs are not rendered by default.

61 changes: 61 additions & 0 deletions Demos/Central_Model_SMAP/datafiles/location3_hours/location3_2023-08-05_hour03_timestamp.csv
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,61 @@
timestamp
2023-08-05 03:00:00
2023-08-05 03:01:00
2023-08-05 03:02:00
2023-08-05 03:03:00
2023-08-05 03:04:00
2023-08-05 03:05:00
2023-08-05 03:06:00
2023-08-05 03:07:00
2023-08-05 03:08:00
2023-08-05 03:09:00
2023-08-05 03:10:00
2023-08-05 03:11:00
2023-08-05 03:12:00
2023-08-05 03:13:00
2023-08-05 03:14:00
2023-08-05 03:15:00
2023-08-05 03:16:00
2023-08-05 03:17:00
2023-08-05 03:18:00
2023-08-05 03:19:00
2023-08-05 03:20:00
2023-08-05 03:21:00
2023-08-05 03:22:00
2023-08-05 03:23:00
2023-08-05 03:24:00
2023-08-05 03:25:00
2023-08-05 03:26:00
2023-08-05 03:27:00
2023-08-05 03:28:00
2023-08-05 03:29:00
2023-08-05 03:30:00
2023-08-05 03:31:00
2023-08-05 03:32:00
2023-08-05 03:33:00
2023-08-05 03:34:00
2023-08-05 03:35:00
2023-08-05 03:36:00
2023-08-05 03:37:00
2023-08-05 03:38:00
2023-08-05 03:39:00
2023-08-05 03:40:00
2023-08-05 03:41:00
2023-08-05 03:42:00
2023-08-05 03:43:00
2023-08-05 03:44:00
2023-08-05 03:45:00
2023-08-05 03:46:00
2023-08-05 03:47:00
2023-08-05 03:48:00
2023-08-05 03:49:00
2023-08-05 03:50:00
2023-08-05 03:51:00
2023-08-05 03:52:00
2023-08-05 03:53:00
2023-08-05 03:54:00
2023-08-05 03:55:00
2023-08-05 03:56:00
2023-08-05 03:57:00
2023-08-05 03:58:00
2023-08-05 03:59:00
Loading