You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: docs/getting-started/index.md
+1-1Lines changed: 1 addition & 1 deletion
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -1,6 +1,6 @@
1
1
# Quick Start
2
2
3
-
This guide is for administrators setting up and running the Source Data Proxy. If you're a user looking to access data through an existing proxy, see the [User Guide](/guide/).
3
+
This guide is for administrators setting up and running their own Source Data Proxy. If you're a user looking to access data through an existing proxy, see the [User Guide](/guide/).
4
4
5
5
The Source Data Proxy is a multi-runtime S3 gateway that proxies requests to backend object stores. This guide gets you running locally in minutes.
Copy file name to clipboardExpand all lines: docs/index.md
+15-5Lines changed: 15 additions & 5 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -3,8 +3,8 @@ layout: home
3
3
4
4
hero:
5
5
name: Source Data Proxy
6
-
text: Multi-runtime S3 gateway proxy
7
-
tagline: A Radiant Earth project. Stream S3-compatible requests to backend object stores with authentication, authorization, and zero-copy passthrough.
6
+
text: A multi-runtime S3 gateway proxy with authentication, authorization, and zero-copy passthrough.
7
+
tagline: 'Built for reuse. the Source Data Proxy is the backend API powering <a href="https://source.coop">source.coop</a>'
8
8
actions:
9
9
- theme: brand
10
10
text: User Guide
@@ -33,15 +33,15 @@ features:
33
33
34
34
## Why a Proxy?
35
35
36
-
Source Cooperative hosts open data from researchers and organizations around the world. That data lives on object storage — but object storage alone doesn't solve the problems that come with making data truly accessible.
36
+
[Source Cooperative](https://source.coop) hosts open data from researchers and organizations around the world. That data lives on object storage — but object storage alone doesn't solve the problems that come with making data truly accessible.
37
37
38
38
### One URL, any backend
39
39
40
-
A dataset might start on AWS S3, move to Cloudflare R2 to reduce egress costs, or get mirrored across providers for redundancy. The proxy gives every data product a stable URL (`data.source.coop/{account}/{dataset}/...`) regardless of where the bytes actually live. Backend migrations are invisible to consumers — no broken links, no client reconfiguration.
40
+
A dataset might start on AWS S3, move to Cloudflare R2 to reduce egress costs, or get mirrored across providers for redundancy. The proxy gives every data product a stable URL (`data.source.coop/{virtual-bucket}...`) regardless of where the bytes actually live. Backend migrations are invisible to consumers — no broken links, no client reconfiguration.
41
41
42
42
### Native S3 compatibility
43
43
44
-
Rather than inventing a new API, the proxy speaks the S3 protocol. This means the entire ecosystem of existing tools — `aws-cli`, `boto3`, DuckDB, the Rust `object_store` crate, GDAL, and hundreds of others — works out of the box. Users don't install a custom client or learn a new SDK. They just set an endpoint URL.
44
+
Rather than inventing a new API, the proxy speaks the S3 protocol. This means the entire ecosystem of existing tools — `aws-cli`, `boto3`, DuckDB, the Rust `object_store` crate, the Python `obstore` module, GDAL, and hundreds of others — work out of the box. Users don't install a custom client or learn a new SDK. They just set an endpoint URL.
45
45
46
46
### Metered access
47
47
@@ -77,3 +77,13 @@ flowchart LR
77
77
```
78
78
79
79
The proxy sits between S3-compatible clients and backend object stores. It authenticates incoming requests, authorizes them against configured scopes, and forwards them to the appropriate backend using presigned URLs for zero-copy streaming.
80
+
81
+
## Get Started
82
+
83
+
### Access data on Source Cooperative
84
+
85
+
The [User Guide](/guide/) covers how to interact with Source Cooperative's hosted data proxy at `data.source.coop` — browsing datasets, authenticating, and using standard S3 clients to read and write data.
86
+
87
+
### Build your own data proxy
88
+
89
+
The [Administration](/getting-started/) section covers how to deploy and configure the Source Data Proxy for your own project — setting up backends, defining buckets and roles, configuring authentication, and extending the proxy with custom resolvers and providers.
0 commit comments