(if S3V configured to serve vol1) | | s3v/s3bucket/file.txt | `/s3v/s3bucket/file.txt` | `ofs://
`/ozone_recon_derby.db` | Recon SQL database jdbc url. | -| `ozone.recon.sql.db.username` | none | Recon SQL database username. | -| `ozone.recon.sql.db.password` | none | Recon SQL database password. | -| `ozone.recon.sql.db.driver` | `org.apache.derby.jdbc.EmbeddedDriver` | Recon SQL database jdbc driver. | -| `ozone.recon.prometheus.http.endpoint` | none | Prometheus HTTP endpoint URL for Recon to integrate with Prometheus. Enables display of metrics in Recon UI and exposes a proxy endpoint to query Prometheus. Example: `http://prometheus:9090`. | -| `ozone.recon.scmconfig` | none | Prefix for SCM configuration. | -| `ozone.recon.db.dirs.permissions` | `750` | Permissions for the metadata directories for Recon. The permissions can either be octal or symbolic. If the default permissions are not set then the default value of 750 will be used. | -| `ozone.recon.datanode.address` | none | Datanode address for Recon. | -| `ozone.recon.heatmap.enable` | `false` | To enable/disable Recon heatmap feature. Along with this config, user must also provide the implementation of `org.apache.hadoop.ozone.recon.heatmap.IHeatMapProvider` interface and configure in `ozone.recon.heatmap.provider` configuration. | -| `ozone.recon.https-address` | `0.0.0.0:9889` | The address and the base port where the Recon web UI will listen on using HTTPS. If the port is 0 then the server will start on a free port. | -| `ozone.recon.datanode.bind.host` | `0.0.0.0` | Bind host for Datanode address. | +| Key | Default | Description | +| --------------------------------------------- | ---------------------------------------------------------------------------- | ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- | +| `ozone.recon.http-address` | 0.0.0.0:9888 | The address and the base port where the Recon web UI will listen on. | +| `ozone.recon.address` | 0.0.0.0:9891 | RPC address of the Recon. | +| `ozone.recon.heatmap.provider` | none | HeatMapProvider for Recon. | +| `ozone.recon.db.dir` | none | Directory where the Recon Server stores its metadata. | +| `ozone.recon.om.db.dir` | none | Directory where the Recon Server stores its OM snapshot DB. | +| `ozone.recon.om.snapshot.task.interval.delay` | 10m | Interval in MINUTES by Recon to request OM DB Snapshot / delta updates. | +| `ozone.recon.task.missingcontainer.interval` | 300s | Time interval of the periodic check for Unhealthy Containers in the cluster. | +| `ozone.recon.task.safemode.wait.threshold` | 300s | Max time for Recon to wait before it exits out of safe or warmup mode. | +| `ozone.recon.sql.db.jooq.dialect` | DERBY | Please refer to [SQL Dialect](https://www.jooq.org/javadoc/latest/org.jooq/org/jooq/SQLDialect.html) to specify a different dialect. | +| `ozone.recon.sql.db.jdbc.url` | `jdbc:derby:${ozone.recon.db.dir}`
`/ozone_recon_derby.db` | Recon SQL database jdbc url. | +| `ozone.recon.sql.db.username` | none | Recon SQL database username. | +| `ozone.recon.sql.db.password` | none | Recon SQL database password. | +| `ozone.recon.sql.db.driver` | `org.apache.derby.jdbc.EmbeddedDriver` | Recon SQL database jdbc driver. | +| `ozone.recon.prometheus.http.endpoint` | none | Prometheus HTTP endpoint URL for Recon to integrate with Prometheus. Enables display of metrics in Recon UI and exposes a proxy endpoint to query Prometheus. Example: `http://prometheus:9090`. | +| `ozone.recon.scmconfig` | none | Prefix for SCM configuration. | +| `ozone.recon.db.dirs.permissions` | `750` | Permissions for the metadata directories for Recon. The permissions can either be octal or symbolic. If the default permissions are not set then the default value of 750 will be used. | +| `ozone.recon.datanode.address` | none | Datanode address for Recon. | +| `ozone.recon.heatmap.enable` | `false` | To enable/disable Recon heatmap feature. Along with this config, user must also provide the implementation of `org.apache.hadoop.ozone.recon.heatmap.IHeatMapProvider` interface and configure in `ozone.recon.heatmap.provider` configuration. | +| `ozone.recon.https-address` | `0.0.0.0:9889` | The address and the base port where the Recon web UI will listen on using HTTPS. If the port is 0 then the server will start on a free port. | +| `ozone.recon.datanode.bind.host` | `0.0.0.0` | Bind host for Datanode address. | diff --git a/docs/03-core-concepts/01-architecture/README.mdx b/docs/03-core-concepts/01-architecture/README.mdx index a556727d3c..7dcaafad61 100644 --- a/docs/03-core-concepts/01-architecture/README.mdx +++ b/docs/03-core-concepts/01-architecture/README.mdx @@ -4,8 +4,8 @@ sidebar_label: Architecture # Architecture -import DocCardList from '@theme/DocCardList'; +import DocCardList from "@theme/DocCardList"; This section describes the architecture and components within Ozone. -
`fileTable`
`directoryTable`
`deletedTable`
`deletedDirectoryTable`
`multipartInfoTable` | A comma-separated list of column families to be compacted by the service. | +| Property | Default | Description | +| -------------------------------------------- | ---------------------------------------------------------------------------------------------------------------------------- | ---------------------------------------------------------------------------------------------------- | +| `ozone.om.db.max.open.files` | `-1` (unlimited) | The total number of files that a RocksDB can open in the OM. | +| `ozone.om.compaction.service.enabled` | `false` | Enable or disable a background job that periodically compacts RocksDB tables flagged for compaction. | +| `ozone.om.compaction.service.run.interval` | `6h` | The interval for the OM's compaction service. | +| `ozone.om.compaction.service.timeout` | `10m` | Timeout for the OM's compaction service. | +| `ozone.om.compaction.service.columnfamilies` | `keyTable`
`fileTable`
`directoryTable`
`deletedTable`
`deletedDirectoryTable`
`multipartInfoTable` | A comma-separated list of column families to be compacted by the service. | ### Datanode-Specific Settings @@ -118,42 +118,42 @@ Key tuning parameters for the Datanode often involve: **Memory usage:** Configuring block cache, write buffer manager, and other memory-related settings. -| Property | Default | Description | -|----------|---------|-------------| -| `hdds.datanode.metadata.rocksdb.cache.size` | `1GB` | Configures the block cache size for RocksDB instances on Datanodes. | +| Property | Default | Description | +| ------------------------------------------- | ------- | ------------------------------------------------------------------- | +| `hdds.datanode.metadata.rocksdb.cache.size` | `1GB` | Configures the block cache size for RocksDB instances on Datanodes. | **Compaction strategies:** Optimizing how data is merged and organized on disk. For more details, refer to the [Datanode Container Schema v3 in DN Documentation](../../../system-internals/components/datanode/rocksdb-schema/). -| Property | Default | Description | -|----------|---------|-------------| -| `hdds.datanode.rocksdb.auto-compaction-small-sst-file` | `true` | Enables or disables auto-compaction for small SST files. | -| `hdds.datanode.rocksdb.auto-compaction-small-sst-file-size-threshold` | `1MB` | Threshold for small SST file size for auto-compaction. | -| `hdds.datanode.rocksdb.auto-compaction-small-sst-file-num-threshold` | `512` | Threshold for the number of small SST files for auto-compaction. | -| `hdds.datanode.rocksdb.auto-compaction-small-sst-file.interval.minutes` | `120` | Auto compact small SST files interval in minutes. | -| `hdds.datanode.rocksdb.auto-compaction-small-sst-file.threads` | `1` | Auto compact small SST files threads. | +| Property | Default | Description | +| ----------------------------------------------------------------------- | ------- | ---------------------------------------------------------------- | +| `hdds.datanode.rocksdb.auto-compaction-small-sst-file` | `true` | Enables or disables auto-compaction for small SST files. | +| `hdds.datanode.rocksdb.auto-compaction-small-sst-file-size-threshold` | `1MB` | Threshold for small SST file size for auto-compaction. | +| `hdds.datanode.rocksdb.auto-compaction-small-sst-file-num-threshold` | `512` | Threshold for the number of small SST files for auto-compaction. | +| `hdds.datanode.rocksdb.auto-compaction-small-sst-file.interval.minutes` | `120` | Auto compact small SST files interval in minutes. | +| `hdds.datanode.rocksdb.auto-compaction-small-sst-file.threads` | `1` | Auto compact small SST files threads. | **Write-ahead log (WAL) settings:** Balancing durability and write performance. -| Property | Default | Description | -|----------|---------|-------------| -| `hdds.datanode.rocksdb.log.max-file-size` | `32MB` | The max size of each user log file of RocksDB. O means no size limit. | -| `hdds.datanode.rocksdb.log.max-file-num` | `64` | The max user log file number to keep for each RocksDB. | +| Property | Default | Description | +| ----------------------------------------- | ------- | --------------------------------------------------------------------- | +| `hdds.datanode.rocksdb.log.max-file-size` | `32MB` | The max size of each user log file of RocksDB. O means no size limit. | +| `hdds.datanode.rocksdb.log.max-file-num` | `64` | The max user log file number to keep for each RocksDB. | **Logging:** -| Property | Default | Description | -|----------|---------|-------------| -| `hdds.datanode.rocksdb.log.level` | `INFO` | The user log level of RocksDB(DEBUG/INFO/WARN/ERROR/FATAL)). | +| Property | Default | Description | +| --------------------------------- | ------- | ------------------------------------------------------------ | +| `hdds.datanode.rocksdb.log.level` | `INFO` | The user log level of RocksDB(DEBUG/INFO/WARN/ERROR/FATAL)). | **Other Settings:** -| Property | Default | Description | -|----------|--------|------------| -| `hdds.datanode.db.config.path` | empty (not configured) | Path to an INI configuration file for advanced RocksDB tuning on Datanodes. | -| `hdds.datanode.container.schema.v3.enabled` | `true` | Enable container schema v3 (one RocksDB per disk). | -| `hdds.datanode.container.schema.v3.key.separator` | | | The separator between Container ID and container meta key name in schema v3. | -| `hdds.datanode.rocksdb.delete-obsolete-files-period` | `1h` | Periodicity when obsolete files get deleted. | -| `hdds.datanode.rocksdb.max-open-files` | `1024` | The total number of files that a RocksDB can open. | +| Property | Default | Description | +| ---------------------------------------------------- | ---------------------- | ---------------------------------------------------------------------------- | +| `hdds.datanode.db.config.path` | empty (not configured) | Path to an INI configuration file for advanced RocksDB tuning on Datanodes. | +| `hdds.datanode.container.schema.v3.enabled` | `true` | Enable container schema v3 (one RocksDB per disk). | +| `hdds.datanode.container.schema.v3.key.separator` | | | The separator between Container ID and container meta key name in schema v3. | +| `hdds.datanode.rocksdb.delete-obsolete-files-period` | `1h` | Periodicity when obsolete files get deleted. | +| `hdds.datanode.rocksdb.max-open-files` | `1024` | The total number of files that a RocksDB can open. | ## 4. Troubleshooting and repair tools relevant to RocksDB diff --git a/docs/05-administrator-guide/02-configuration/04-performance/08-fair-call-queue.md b/docs/05-administrator-guide/02-configuration/04-performance/08-fair-call-queue.md index 2a2cc58732..5902988094 100644 --- a/docs/05-administrator-guide/02-configuration/04-performance/08-fair-call-queue.md +++ b/docs/05-administrator-guide/02-configuration/04-performance/08-fair-call-queue.md @@ -102,8 +102,8 @@ Port used for below examples : 9862 ``` 2. **Verify Metrics**: Check that FCQ metrics are being collected (via JMX or metrics endpoint): - - `FairCallQueueSize_p
- Hostname (e.g., `DN-1`) - uses default CLIENT_RPC port (19864)
- Hostname with port (e.g., `DN-1:19864`)
- IP address (e.g., `192.168.1.10`)
- IP address with port (e.g., `192.168.1.10:19864`)
- Stdin (`-`) - reads Datanode addresses from standard input, one per line | `DN-1`
`DN-1:19864`
`192.168.1.10`
`-` | -| `--in-service-datanodes` | It queries SCM for all IN_SERVICE Datanodes and executes the command on all of them. | `--in-service-datanodes` | -| `--json` | Format output as JSON. | `--json` | -| `-t/--threshold-percentage` | Volume density threshold percentage (default: 10.0). Used with `start` and `update` commands. | `-t 5`
`--threshold-percentage 5.0` | -| `-b/--bandwidth-in-mb` | Maximum disk bandwidth in MB/s (default: 10). Used with `start` and `update` commands. | `-b 20`
`--bandwidth-in-mb 50` | -| `-p/--parallel-thread` | Number of parallel threads (default: 1). Used with `start` and `update` commands. | `-p 5`
`--parallel-thread 10` | -| `-s/--stop-after-disk-even` | Stop automatically after disks are balanced (default: true). Used with `start` and `update` commands. | `-s false`
`--stop-after-disk-even true` | +| Option | Description | Example | +| --------------------------- | -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- | ----------------------------------------------------- | +| `
- Hostname (e.g., `DN-1`) - uses default CLIENT_RPC port (19864)
- Hostname with port (e.g., `DN-1:19864`)
- IP address (e.g., `192.168.1.10`)
- IP address with port (e.g., `192.168.1.10:19864`)
- Stdin (`-`) - reads Datanode addresses from standard input, one per line | `DN-1`
`DN-1:19864`
`192.168.1.10`
`-` | +| `--in-service-datanodes` | It queries SCM for all IN_SERVICE Datanodes and executes the command on all of them. | `--in-service-datanodes` | +| `--json` | Format output as JSON. | `--json` | +| `-t/--threshold-percentage` | Volume density threshold percentage (default: 10.0). Used with `start` and `update` commands. | `-t 5`
`--threshold-percentage 5.0` | +| `-b/--bandwidth-in-mb` | Maximum disk bandwidth in MB/s (default: 10). Used with `start` and `update` commands. | `-b 20`
`--bandwidth-in-mb 50` | +| `-p/--parallel-thread` | Number of parallel threads (default: 1). Used with `start` and `update` commands. | `-p 5`
`--parallel-thread 10` | +| `-s/--stop-after-disk-even` | Stop automatically after disks are balanced (default: true). Used with `start` and `update` commands. | `-s false`
`--stop-after-disk-even true` | ### Examples @@ -223,15 +223,15 @@ ozone admin datanode diskbalancer report --in-service-datanodes --json The DiskBalancer's behavior can be controlled using the following configuration properties in `ozone-site.xml`. -| Property | Default | Purpose | -|----------|--------------------------------------------------------------------------------------------------|---------------------------------------------------------------------------------------------------------------------------------------------------------------------------| -| `hdds.datanode.disk.balancer.enabled` | `false` | If false, the DiskBalancer service on the Datanode is disabled. Configure it to true for diskBalancer to be enabled. | -| `hdds.datanode.disk.balancer.volume.density.threshold.percent` | `10.0` | A percentage (0-100). A Datanode is considered balanced if for each volume, its utilization differs from the average Datanode utilization by no more than this threshold. | -| `hdds.datanode.disk.balancer.max.disk.throughputInMBPerSec` | `10` | The maximum bandwidth (in MB/s) that the balancer can use for moving data, to avoid impacting client I/O. | -| `hdds.datanode.disk.balancer.parallel.thread` | `5` | The number of worker threads to use for moving containers in parallel. | -| `hdds.datanode.disk.balancer.service.interval` | `60s` | The time interval at which the Datanode DiskBalancer service checks for imbalance and updates its configuration. | -| `hdds.datanode.disk.balancer.stop.after.disk.even` | `true` | If true, the DiskBalancer will automatically stop its balancing activity once disks are considered balanced (i.e., all volume densities are within the threshold). | -| `hdds.datanode.disk.balancer.volume.choosing.policy` | `org.apache.hadoop.`
`ozone.container.`
`diskbalancer.policy.`
`DefaultVolumeChoosingPolicy` | The policy class for selecting source and destination volumes for balancing. | -| `hdds.datanode.disk.balancer.container.choosing.policy` | `org.apache.hadoop.`
`ozone.container.`
`diskbalancer.policy.`
`DefaultContainerChoosingPolicy` | The policy class for selecting which containers to move from a source volume to destination volume. | -| `hdds.datanode.disk.balancer.service.timeout` | `300s` | Timeout for the Datanode DiskBalancer service operations. | -| `hdds.datanode.disk.balancer.should.run.default` | `false` | If the balancer fails to read its persisted configuration, this value determines if the service should run by default. | +| Property | Default | Purpose | +| -------------------------------------------------------------- | ---------------------------------------------------------------------------------------------------------------- | ------------------------------------------------------------------------------------------------------------------------------------------------------------------------- | +| `hdds.datanode.disk.balancer.enabled` | `false` | If false, the DiskBalancer service on the Datanode is disabled. Configure it to true for diskBalancer to be enabled. | +| `hdds.datanode.disk.balancer.volume.density.threshold.percent` | `10.0` | A percentage (0-100). A Datanode is considered balanced if for each volume, its utilization differs from the average Datanode utilization by no more than this threshold. | +| `hdds.datanode.disk.balancer.max.disk.throughputInMBPerSec` | `10` | The maximum bandwidth (in MB/s) that the balancer can use for moving data, to avoid impacting client I/O. | +| `hdds.datanode.disk.balancer.parallel.thread` | `5` | The number of worker threads to use for moving containers in parallel. | +| `hdds.datanode.disk.balancer.service.interval` | `60s` | The time interval at which the Datanode DiskBalancer service checks for imbalance and updates its configuration. | +| `hdds.datanode.disk.balancer.stop.after.disk.even` | `true` | If true, the DiskBalancer will automatically stop its balancing activity once disks are considered balanced (i.e., all volume densities are within the threshold). | +| `hdds.datanode.disk.balancer.volume.choosing.policy` | `org.apache.hadoop.`
`ozone.container.`
`diskbalancer.policy.`
`DefaultVolumeChoosingPolicy` | The policy class for selecting source and destination volumes for balancing. | +| `hdds.datanode.disk.balancer.container.choosing.policy` | `org.apache.hadoop.`
`ozone.container.`
`diskbalancer.policy.`
`DefaultContainerChoosingPolicy` | The policy class for selecting which containers to move from a source volume to destination volume. | +| `hdds.datanode.disk.balancer.service.timeout` | `300s` | Timeout for the Datanode DiskBalancer service operations. | +| `hdds.datanode.disk.balancer.should.run.default` | `false` | If the balancer fails to read its persisted configuration, this value determines if the service should run by default. | diff --git a/docs/05-administrator-guide/03-operations/05-data-balancing/README.mdx b/docs/05-administrator-guide/03-operations/05-data-balancing/README.mdx index a38839d8f5..f9e84f6c2f 100644 --- a/docs/05-administrator-guide/03-operations/05-data-balancing/README.mdx +++ b/docs/05-administrator-guide/03-operations/05-data-balancing/README.mdx @@ -2,8 +2,8 @@ sidebar_label: Data Balancing --- -import DocCardList from '@theme/DocCardList'; +import DocCardList from "@theme/DocCardList"; This section documents about balancing data across Datanodes (Container Balancer) as well as within Datanodes (DiskBalancer) in an Ozone cluster. -
S3 Gateway
(Port: 9878)"] recon["Recon
Monitoring Service
(Port: 9888)"] httpfs["HttpFS
HTTP FileSystem
(Port: 14000)"] - + subgraph "Data Nodes" dn1["DataNode 1
(Port: 19864, 9882)"] dnN["DataNode N
(Port: 19864, 9882)"] end - + %% Connections scm --> dn1 scm --> dnN @@ -93,7 +93,7 @@ graph TB classDef default fill:#f9f9f9,stroke:#333,stroke-width:2px; classDef datanode fill:#e1f5fe,stroke:#0288d1,stroke-width:2px; classDef manager fill:#e8f5e9,stroke:#388e3c,stroke-width:2px; - + class dn1,dnN datanode; class scm,om manager; ``` @@ -153,7 +153,7 @@ The compose directory includes several specialized configurations for different | Configuration | Purpose | -|----------------|-----------------------------------------| +| -------------- | --------------------------------------- | | ozone-ha | High availability deployment setup | | ozonesecure | Security features with SSL and Kerberos | | ozone-topology | Rack-aware deployment configuration | diff --git a/docs/08-developer-guide/02-run/README.mdx b/docs/08-developer-guide/02-run/README.mdx index ac95aa4f04..162c0f55cb 100644 --- a/docs/08-developer-guide/02-run/README.mdx +++ b/docs/08-developer-guide/02-run/README.mdx @@ -4,8 +4,8 @@ sidebar_label: Run # Running a Custom Ozone Build -import DocCardList from '@theme/DocCardList'; +import DocCardList from "@theme/DocCardList"; This section documents various ways to run a custom build of Ozone on a local machine. -
-
+ Ask a Question
+
+
);
-}
\ No newline at end of file
+}
diff --git a/src/components/AskQuestionForm/styles.module.css b/src/components/AskQuestionForm/styles.module.css
index 1fe64d8b20..80086fa62f 100644
--- a/src/components/AskQuestionForm/styles.module.css
+++ b/src/components/AskQuestionForm/styles.module.css
@@ -101,8 +101,8 @@
.formContainer {
padding: 15px;
}
-
+
.button {
width: 100%;
}
-}
\ No newline at end of file
+}
diff --git a/src/css/custom.css b/src/css/custom.css
index 7c7f82b06c..90b7acff8d 100644
--- a/src/css/custom.css
+++ b/src/css/custom.css
@@ -24,7 +24,7 @@
*/
/* Import Google Fonts */
-@import url('https://fonts.googleapis.com/css2?family=Inter:wght@400;500;600;700&family=Open+Sans:wght@400;500;600;700&family=JetBrains+Mono:wght@400;500&display=swap');
+@import url("https://fonts.googleapis.com/css2?family=Inter:wght@400;500;600;700&family=Open+Sans:wght@400;500;600;700&family=JetBrains+Mono:wght@400;500&display=swap");
/* Infima colors generated from --ifm-color-primary using https://docusaurus.io/docs/styling-layout#styling-your-site-with-infima */
:root {
@@ -37,16 +37,26 @@
--ifm-color-primary-lightest: #459800;
--ozone-hero-background: #e0edd2; /* Slightly darker background for better contrast */
--ozone-hero-text: #1a1a1a; /* Darker text for increased contrast */
- --ozone-hero-gradient: linear-gradient(135deg, #d1e4bc, #e0edd2); /* Darker gradient for better contrast */
+ --ozone-hero-gradient: linear-gradient(
+ 135deg,
+ #d1e4bc,
+ #e0edd2
+ ); /* Darker gradient for better contrast */
--ifm-background-color: #f5f5f0; /* Even softer background color with slight warm tone */
-
+
/* Custom font settings */
- --ifm-font-family-base: 'Open Sans', system-ui, -apple-system, BlinkMacSystemFont, 'Segoe UI', Roboto, Oxygen, Ubuntu, Cantarell, sans-serif;
- --ifm-heading-font-family: 'Inter', system-ui, -apple-system, BlinkMacSystemFont, 'Segoe UI', Roboto, sans-serif;
- --ifm-font-family-monospace: 'JetBrains Mono', SFMono-Regular, Menlo, Monaco, Consolas, 'Liberation Mono', 'Courier New', monospace;
+ --ifm-font-family-base:
+ "Open Sans", system-ui, -apple-system, BlinkMacSystemFont, "Segoe UI",
+ Roboto, Oxygen, Ubuntu, Cantarell, sans-serif;
+ --ifm-heading-font-family:
+ "Inter", system-ui, -apple-system, BlinkMacSystemFont, "Segoe UI", Roboto,
+ sans-serif;
+ --ifm-font-family-monospace:
+ "JetBrains Mono", SFMono-Regular, Menlo, Monaco, Consolas,
+ "Liberation Mono", "Courier New", monospace;
}
-[data-theme='dark'] {
+[data-theme="dark"] {
--ifm-color-primary: #96d26e;
--ifm-color-primary-dark: #84ca56;
--ifm-color-primary-darker: #7bc749;
@@ -56,7 +66,11 @@
--ifm-color-primary-lightest: #cbe9b7;
--ozone-hero-background: #324d20; /* Darker green background in dark mode for better contrast */
--ozone-hero-text: #f0f6eb; /* Light text for contrast on darker background */
- --ozone-hero-gradient: linear-gradient(135deg, #2b4218, #324d20); /* Gradient for hero section in dark mode */
+ --ozone-hero-gradient: linear-gradient(
+ 135deg,
+ #2b4218,
+ #324d20
+ ); /* Gradient for hero section in dark mode */
}
/* Custom hero styling to maintain consistent colors in both light and dark modes */
@@ -73,18 +87,27 @@
}
/* Additional typography improvements */
-h1, h2, h3, h4, h5, h6 {
+h1,
+h2,
+h3,
+h4,
+h5,
+h6 {
font-family: var(--ifm-heading-font-family);
letter-spacing: -0.02em;
}
-pre, code {
+pre,
+code {
font-family: var(--ifm-font-family-monospace);
font-size: 14px;
}
/* Improve body text readability */
-p, li, td, th {
+p,
+li,
+td,
+th {
font-family: var(--ifm-font-family-base);
line-height: 1.6;
}
@@ -118,7 +141,7 @@ p, li, td, th {
}
/* Dark mode integration items styled to match the primary button */
-html[data-theme='dark'] .integration-item {
+html[data-theme="dark"] .integration-item {
background-color: var(--ifm-color-primary);
border: 1px solid var(--ifm-color-primary-darker);
color: var(--ifm-color-white);
@@ -127,20 +150,22 @@ html[data-theme='dark'] .integration-item {
box-shadow: 0 2px 5px rgba(0, 0, 0, 0.2);
}
-html[data-theme='dark'] .integration-item:hover {
+html[data-theme="dark"] .integration-item:hover {
background-color: var(--ifm-color-primary-darker);
box-shadow: 0 4px 10px rgba(0, 0, 0, 0.3);
transform: translateY(-2px);
}
/* Make integration names light in dark mode cards to match primary button text */
-html[data-theme='dark'] .integration-item .integration-name {
+html[data-theme="dark"] .integration-item .integration-name {
color: #ffffff;
font-weight: 500;
}
/* Adjust SVG icons for better visibility against primary button */
-html[data-theme='dark'] .integration-icon-container svg:not([data-logo="kerberos-icon"]) {
+html[data-theme="dark"]
+ .integration-icon-container
+ svg:not([data-logo="kerberos-icon"]) {
color: #ffffff;
filter: drop-shadow(0 1px 2px rgba(0, 0, 0, 0.2));
}
diff --git a/src/css/footer.css b/src/css/footer.css
index 63c2633106..52916041fc 100644
--- a/src/css/footer.css
+++ b/src/css/footer.css
@@ -21,14 +21,14 @@
:root {
--footer-background-color: #202020;
--footer-foreground-color: #ccc;
- --copyright-link-color: #96d26e
+ --copyright-link-color: #96d26e;
}
-html[data-theme='dark'] .footer {
+html[data-theme="dark"] .footer {
background-color: var(--footer-background-color);
}
-html[data-theme='light'] .footer {
+html[data-theme="light"] .footer {
background-color: var(--footer-background-color);
}
@@ -56,10 +56,9 @@ footer.footer .footer__copyright {
/* Keep copyright links in the footer the same color regardless of light or dark theme. */
.copyright-link {
- color: var(--copyright-link-color)
+ color: var(--copyright-link-color);
}
.copyright-link:hover {
- color: var(--copyright-link-color)
+ color: var(--copyright-link-color);
}
-
diff --git a/src/css/header.css b/src/css/header.css
index 1edd326eb3..fb8facf51f 100644
--- a/src/css/header.css
+++ b/src/css/header.css
@@ -27,19 +27,19 @@
}
.header-github-link:before {
- content: '';
+ content: "";
width: 24px;
height: 24px;
display: flex;
background: url("data:image/svg+xml,%3Csvg viewBox='0 0 24 24' xmlns='http://www.w3.org/2000/svg'%3E%3Cpath d='M12 .297c-6.63 0-12 5.373-12 12 0 5.303 3.438 9.8 8.205 11.385.6.113.82-.258.82-.577 0-.285-.01-1.04-.015-2.04-3.338.724-4.042-1.61-4.042-1.61C4.422 18.07 3.633 17.7 3.633 17.7c-1.087-.744.084-.729.084-.729 1.205.084 1.838 1.236 1.838 1.236 1.07 1.835 2.809 1.305 3.495.998.108-.776.417-1.305.76-1.605-2.665-.3-5.466-1.332-5.466-5.93 0-1.31.465-2.38 1.235-3.22-.135-.303-.54-1.523.105-3.176 0 0 1.005-.322 3.3 1.23.96-.267 1.98-.399 3-.405 1.02.006 2.04.138 3 .405 2.28-1.552 3.285-1.23 3.285-1.23.645 1.653.24 2.873.12 3.176.765.84 1.23 1.91 1.23 3.22 0 4.61-2.805 5.625-5.475 5.92.42.36.81 1.096.81 2.22 0 1.606-.015 2.896-.015 3.286 0 .315.21.69.825.57C20.565 22.092 24 17.592 24 12.297c0-6.627-5.373-12-12-12'/%3E%3C/svg%3E")
- no-repeat;
+ no-repeat;
}
-html[data-theme='dark'] .header-github-link:before {
- content: '';
+html[data-theme="dark"] .header-github-link:before {
+ content: "";
width: 24px;
height: 24px;
display: flex;
background: url("data:image/svg+xml,%3Csvg viewBox='0 0 24 24' xmlns='http://www.w3.org/2000/svg'%3E%3Cpath fill='white' d='M12 .297c-6.63 0-12 5.373-12 12 0 5.303 3.438 9.8 8.205 11.385.6.113.82-.258.82-.577 0-.285-.01-1.04-.015-2.04-3.338.724-4.042-1.61-4.042-1.61C4.422 18.07 3.633 17.7 3.633 17.7c-1.087-.744.084-.729.084-.729 1.205.084 1.838 1.236 1.838 1.236 1.07 1.835 2.809 1.305 3.495.998.108-.776.417-1.305.76-1.605-2.665-.3-5.466-1.332-5.466-5.93 0-1.31.465-2.38 1.235-3.22-.135-.303-.54-1.523.105-3.176 0 0 1.005-.322 3.3 1.23.96-.267 1.98-.399 3-.405 1.02.006 2.04.138 3 .405 2.28-1.552 3.285-1.23 3.285-1.23.645 1.653.24 2.873.12 3.176.765.84 1.23 1.91 1.23 3.22 0 4.61-2.805 5.625-5.475 5.92.42.36.81 1.096.81 2.22 0 1.606-.015 2.896-.015 3.286 0 .315.21.69.825.57C20.565 22.092 24 17.592 24 12.297c0-6.627-5.373-12-12-12'/%3E%3C/svg%3E")
- no-repeat;
+ no-repeat;
}
diff --git a/src/pages/community/ask-a-question.md b/src/pages/community/ask-a-question.md
index 28eb1b2f6f..b1c39f6c52 100644
--- a/src/pages/community/ask-a-question.md
+++ b/src/pages/community/ask-a-question.md
@@ -1,6 +1,7 @@
# Ask a Question About Apache Ozone
+
import AskQuestionForm from '@site/src/components/AskQuestionForm';
Have a question about Apache Ozone? Use the form below to submit your question to our GitHub Discussions. The form will redirect you to GitHub with your question pre-filled.
diff --git a/src/pages/community/events-and-media.md b/src/pages/community/events-and-media.md
index 309cd99504..cfdbc435af 100644
--- a/src/pages/community/events-and-media.md
+++ b/src/pages/community/events-and-media.md
@@ -1,5 +1,6 @@
---
---
+
# Ozone Events
import Tabs from '@theme/Tabs';
diff --git a/src/pages/community/report-an-issue.md b/src/pages/community/report-an-issue.md
index 3db8b64f36..6112653c26 100644
--- a/src/pages/community/report-an-issue.md
+++ b/src/pages/community/report-an-issue.md
@@ -8,7 +8,7 @@ import AskQuestionForm from '@site/src/components/AskQuestionForm';
If you have a question about Apache Ozone, you can use the form below to submit it to our GitHub Discussions. This will redirect you to GitHub where you can continue the conversation with the community.
-{/*We're using a special Docusaurus comment style to allow the React component*/}
+{/_We're using a special Docusaurus comment style to allow the React component_/}
Ask a Question
-Have a question about Apache Ozone? Fill out this form and we'll redirect you to GitHub Discussions with your question pre-filled.
- ++ Have a question about Apache Ozone? Fill out this form and we'll + redirect you to GitHub Discussions with your question pre-filled. +
+
-
- );
-}
-
-// Import additional Bootstrap icons for use cases
-import { Water, Bucket, Folder2 } from 'react-bootstrap-icons';
-
-function UseCases() {
- const useCases = [
- {
- title: 'Data Lakes',
- description: 'Build cost-effective, scalable data lakes for analytics workloads with tiered storage support.',
- icon: Water,
- iconSize: 30,
- },
- {
- title: 'Object Storage',
- description: 'S3-compatible storage for applications, backups, and unstructured data at any scale.',
- icon: Bucket,
- iconSize: 30,
- },
- {
- title: 'Big Data Storage',
- description: 'Reliable storage foundation for Hadoop, Spark, and other data processing frameworks.',
- icon: Folder2,
- iconSize: 30,
- },
- ];
-
- return (
-
-
-
-
- {title}
-{description}
-
-
-
-
-
-
- Use Cases
-
- {useCases.map((useCase, idx) => (
-
-
-
- ))}
-
-
-
-
- {useCase.title}
-{useCase.description}
-
-
-
-
-
-
-
- 
,
- link: '/docs/user-guide/integrations/hive'
- },
- {
- name: 'Spark',
- icon: () => 
,
- link: '/docs/user-guide/integrations/spark'
- },
- {
- name: 'Iceberg',
- icon: () => 
,
- link: '/docs/user-guide/integrations/iceberg'
- },
- {
- name: 'Trino',
- icon: () => 
,
- link: '/docs/user-guide/integrations/trino'
- },
- {
- name: 'Impala',
- icon: () => 
,
- link: '/docs/user-guide/integrations/impala'
- },
- {
- name: 'Ranger',
- icon: () => 
,
- link: '/docs/administrator-guide/configuration/security/ranger'
- },
- {
- name: 'Knox',
- icon: () => 
,
- link: '/docs/administrator-guide/configuration/security/knox'
- },
- {
- name: 'Kerberos',
- icon: props => 
,
- link: '/docs/administrator-guide/operations/observability/prometheus'
- },
- {
- name: 'Grafana',
- icon: () => 
,
- link: '/docs/administrator-guide/operations/observability/grafana'
- },
- {
- name: 'Oozie',
- icon: () => 
,
- link: '/docs/user-guide/integrations/oozie'
- },
- {
- name: 'Hue',
- icon: () => 
,
- link: '/docs/user-guide/integrations/hue'
- },
- ];
-
- return (
-
-
-
-
-
-
- Integrations
-
- {integrations.map((integration, idx) => (
-
-
-
-
- ))}
-
-
- {integration.name}
-
-
-
-
- {/* Use Cases section moved before Features as recommended */}
-
-
-
-
-
-
- {siteConfig.title}
-- {siteConfig.tagline} -
-
-
-
-
-
-
-
-
-
- {/* Logo with increased size and positioned more to the right */}
-
-
-
-
-
-
-
- Features
-
- {features.map((feature, idx) => (
-
-
-
-
-
-
-
- Ready to Get Started?
-- Deploy Apache Ozone in minutes with Docker, or explore our comprehensive documentation for other deployment options. -
-
-
-
-
-
-
-
-
-
+
+ );
+}
+
+function UseCases() {
+ const useCases = [
+ {
+ title: "Data Lakes",
+ description:
+ "Build cost-effective, scalable data lakes for analytics workloads with tiered storage support.",
+ icon: Water,
+ iconSize: 30
+ },
+ {
+ title: "Object Storage",
+ description:
+ "S3-compatible storage for applications, backups, and unstructured data at any scale.",
+ icon: Bucket,
+ iconSize: 30
+ },
+ {
+ title: "Big Data Storage",
+ description:
+ "Reliable storage foundation for Hadoop, Spark, and other data processing frameworks.",
+ icon: Folder2,
+ iconSize: 30
+ }
+ ];
+
+ return (
+
+ {title}
+
+
+
+ {description}
+
+
+
+
+
+
+ Use Cases
+
+
+
+ {useCases.map((useCase, idx) => (
+
+
+
+ ))}
+
+ {useCase.title}
+
+
+
+ {useCase.description}
+
+
+
+
+
+
+
+
+ ),
+ link: "/docs/user-guide/integrations/hive"
+ },
+ {
+ name: "Spark",
+ icon: () => (
+
+ ),
+ link: "/docs/user-guide/integrations/spark"
+ },
+ {
+ name: "Iceberg",
+ icon: () => (
+
+ ),
+ link: "/docs/user-guide/integrations/iceberg"
+ },
+ {
+ name: "Trino",
+ icon: () => (
+
+ ),
+ link: "/docs/user-guide/integrations/trino"
+ },
+ {
+ name: "Impala",
+ icon: () => (
+
+ ),
+ link: "/docs/user-guide/integrations/impala"
+ },
+ {
+ name: "Ranger",
+ icon: () => (
+
+ ),
+ link: "/docs/administrator-guide/configuration/security/ranger"
+ },
+ {
+ name: "Knox",
+ icon: () => (
+
+ ),
+ link: "/docs/administrator-guide/configuration/security/knox"
+ },
+ {
+ name: "Kerberos",
+ icon: (props) => (
+
+ ),
+ link: "/docs/administrator-guide/operations/observability/prometheus"
+ },
+ {
+ name: "Grafana",
+ icon: () => (
+
+ ),
+ link: "/docs/administrator-guide/operations/observability/grafana"
+ },
+ {
+ name: "Oozie",
+ icon: () => (
+
+ ),
+ link: "/docs/user-guide/integrations/oozie"
+ },
+ {
+ name: "Hue",
+ icon: () => (
+
+ ),
+ link: "/docs/user-guide/integrations/hue"
+ }
+ ];
+
+ return (
+
+
+
+
+
+
+ Integrations
+
+
+
+ {integrations.map((integration, idx) => (
+
+
+
+
+ ))}
+
+
+ {integration.name}
+
+
+
+
+ {/* Use Cases section moved before Features as recommended */}
+
+
+
+
+
+
+ {siteConfig.title}
+
+
+ {siteConfig.tagline}
+
+
+
+
+
+
+
+
+
+ {/* Logo with increased size and positioned more to the right */}
+
+
+
+
+
+
+
+ Features
+
+
+
+ {features.map((feature, idx) => (
+
+
+
+
+
+
+
+ Ready to Get Started?
+
+
+ + Deploy Apache Ozone in minutes with Docker, or explore our + comprehensive documentation for other deployment options. +
+
+
+
+
+
+
+
+
+ Load Balancer Deployments for S3 Gateway
Using NFS gateway from HDFS for Ozone
Truncate support
Rolling upgrades | Run Ozone tests with multiple SCM
This will allow HDFS clusters to upgrade to Ozone without data copies.
Native CSI support (ozone specific daemon)
Security is on by default, TDE, and Security testing with different applications.
Test and Document different load balancers that can with S3 Gateway.
Test with NFS client | +| Release | Tag | Feature | Exit criteria | +| :------ | :--- | :----------------------------------------------------------------------------------------------------------------------------------------------------- | :-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- | +| TODO | TODO | HDFS to Ozone upgrade
Load Balancer Deployments for S3 Gateway
Using NFS gateway from HDFS for Ozone
Truncate support
Rolling upgrades | Run Ozone tests with multiple SCM
This will allow HDFS clusters to upgrade to Ozone without data copies.
Native CSI support (ozone specific daemon)
Security is on by default, TDE, and Security testing with different applications.
Test and Document different load balancers that can with S3 Gateway.
Test with NFS client | ## Upcoming Releases -| Release | Tag | Features | Exit criteria | -| :--- | :--- | :--- | :--- | -| 3.0.0 | | [HDDS-11415](https://issues.apache.org/jira/browse/HDDS-11415) Leader Execution at Leader | | -| 2.2.0 | Katmai | [HDDS-5713](https://issues.apache.org/jira/browse/HDDS-5713) Disk balancer
[HDDS-8342](https://issues.apache.org/jira/browse/HDDS-8342) S3 Lifecycle Configurations - Object Expiration
[HDDS-13323](https://issues.apache.org/jira/browse/HDDS-13323) STS - temporary, limited-privilege credentials service | | -| 2.0.1 | ? | Critical bugs fixed found after 2.0.0 | | +| Release | Tag | Features | Exit criteria | +| :------ | :----- | :-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- | :------------ | +| 3.0.0 | | [HDDS-11415](https://issues.apache.org/jira/browse/HDDS-11415) Leader Execution at Leader | | +| 2.2.0 | Katmai | [HDDS-5713](https://issues.apache.org/jira/browse/HDDS-5713) Disk balancer
[HDDS-8342](https://issues.apache.org/jira/browse/HDDS-8342) S3 Lifecycle Configurations - Object Expiration
[HDDS-13323](https://issues.apache.org/jira/browse/HDDS-13323) STS - temporary, limited-privilege credentials service | | +| 2.0.1 | ? | Critical bugs fixed found after 2.0.0 | | ## Past Releases Ozone releases can be downloaded from https://ozone.apache.org/downloads/ -| Release | Tag | Features | Exit criteria | -| :--- | :--- | :--- | :--- | -| 2.1.0 | Joshua Tree
RELEASED | [HDDS-10239](https://issues.apache.org/jira/browse/HDDS-10239) Storage Container Reconciliation
[HDDS-12940](https://issues.apache.org/jira/browse/HDDS-12940) Ozone Snapshot Phase 3: Scale up Snapshot Operations
[HDDS-8387](https://issues.apache.org/jira/browse/HDDS-8387) Container and volume scanners phase II
[HDDS-12564](https://issues.apache.org/jira/browse/HDDS-12564) Handling disk issues in Datanodes - Phase II
| | -| 2.0.0 | Indiana Dunes
RELEASED | [HDDS-7593](https://issues.apache.org/jira/browse/HDDS-7593) Supporting HSync and lease recovery
[HDDS-7852](https://issues.apache.org/jira/browse/HDDS-7852) SCM Decommissioning Support
[HDDS-8829](https://issues.apache.org/jira/browse/HDDS-8829) Symmetric Keys for Delegation Tokens
[HDDS-10656](https://issues.apache.org/jira/browse/HDDS-10656) Atomic Key Overwrite and Key Replacement
**Other noteworthy changes:**
[HDDS-6263](https://issues.apache.org/jira/browse/HDDS-6263) ARM64 support
[HDDS-8246](https://issues.apache.org/jira/browse/HDDS-8246) Java 11/17/21 Support and Testing
[HDDS-11577](https://issues.apache.org/jira/browse/HDDS-11577) AWS SDK v2 client support | | -| 1.4.1 | Hot Springs
RELEASED | Stability improvements. For a detailed list, please refer to [Changes between Ozone-1.4.0 and Ozone-1.4.1 on GitHub)](https://github.com/apache/ozone/compare/ozone-1.4.0...ozone-1.4.1) | | -| 1.4.0 | Hot Springs
RELEASED | Ozone Snapshot feature
Erasure Coding - V2 support (offline reconstruction)
Container balancer support for Erasure Coding
Heat map support, more diagnose info on Recon
Certificate auto rotation
SCM Decommission support
OM Decommission improvement
New symmetric key based block/container token implementation
Quota on FSO bucket support | | -| 1.3.0 | Grand Canyon
RELEASED | Erasure Coding - V1 support (Online reconstruction support)
Container balancer
Limit number of RocksDB instances to 1 per disk on high-density Datanodes
Ozone S3 Multi-tenancy Support
S3 gRPC improvements for metadata path
Filesystem Optimized and Object Store bucket layout types | | -| 1.2.0 | Glacier
RELEASED | SCM HA support for fresh installations
Non-rolling upgrade and downgrade support
Optimized filesystem (prefix) support for fresh installations
Transparent data encryption for S3 buckets | | -| 1.1.0 | Everglades
RELEASED | Volume/Bucket Quota Support
ofs/o3fs performance improvements with Teragen and Spark
[Ozone FS namespace](https://issues.apache.org/jira/browse/HDDS-2939) | | -| 1.0.0 | Denali
[RELEASED](http://hadoop.apache.org/ozone/release/1.0.0/) | Security Phase II
HA support for Ozone Manager
ofs ([HDDS-2665](https://issues.apache.org/jira/browse/HDDS-2665)), new scheme: ofs://OM/volume/bucket/key
Ozone Filesystem performance improvement ([HDDS-2939](https://issues.apache.org/jira/browse/HDDS-2939))
Ozone support security enabled Hadoop 2.x
S3 volume/bucket mapping changes and bind mounted buckets ([HDDS-3385](https://issues.apache.org/jira/browse/HDDS-3385))
Hadoop 2.7 support / remove of Isolated class loader ([HDDS-3458](https://issues.apache.org/jira/browse/HDDS-3458))
Recon / Recon UI improvements (new management / debug screens)
| Support upgrading / persist current versions metadata
Support MR jobs with the new scheme
Support fast directory list with 1 billion keys and deep hierarchy
**Testing integrations with other projects**
Hive LLAP
Impala
Spark (TPC-DS) | -| 0.5.0 | Crater Lake
[RELEASED](http://hadoop.apache.org/ozone/release/0.5.0/) | Stability improvements
Performance and Scale
High Availability
Topology awareness.
Management Console
Disk Scanner
Centralized Management UI updates to SCM and OM.
Decommissioning
| Long-running tests based on Apache NIFI, Hive, and Spark. Able to handle 1 Billion objects.
GDPR Right to Erasure
Network Topology awareness for block placement.
Recon Server V1
Disk scanner and ability to detect block corruptions.
Hadoop Configurations are hard to manage, make it easy for Ozone.
Support Decommission. | -| 0.4.1 | Biscayne
[RELEASED](http://hadoop.apache.org/ozone/release/0.4.1/) | Stability improvements
Ozone Native ACL support
First class K8s support
| Support Native ACLs in Ozone.
Ozone becomes K8s aware. | -| 0.4.0 | Badlands
[RELEASED](http://hadoop.apache.org/ozone/release/0.4.0/) | **Security**
| Hadoop Delegation Tokens and Block Tokens supported for Ozone.
Transparent Data Encryption (TDE) Support - Allows data blocks to be encrypted-at-rest.
Kerberos support for Ozone.
Certificate Infrastructure for Ozone - Tokens use PKI instead of shared secrets. to communication secured via mutual TLS.
Ability secure Ozone cluster that works with Yarn, Hive, and Spark.
Helm/ support to deploy Ozone clusters on K8s.
Support S3 Authentication Mechanisms like - S3 v4 Authentication protocol.
S3 Gateway supports upload.
Support S3A file system
Support for Tracing and Profiling for all Ozone components.
Audit Support - including Audit Parser tools.
Apache Ranger Support in Ozone. | -| 0.3.0 | Arches
[RELEASED](http://hadoop.apache.org/ozone/release/0.3.0/) | S3 Protocol head
| Create an S3 protocol head that can work with Ozone.
Ingest via S3 protocol head, process data via Ozone FS.
Support a minimally complete S3 API set.
Make sure that AWS CLI and AWS Java SDK works correctly against the protocol head
Large Scale and complete testing of Application Stack. YARN, Hive, and Spark. | -| 0.2.1 | Acadia
[RELEASED](http://hadoop.apache.org/ozone/release/0.2.1/) | Basic Ozone functionality
Ozone FS Command Shell
Java SDK.
| Be able to create Ozone volumes, buckets, and Keys.
Create a large number of keys.
Millions of keys tested.
Write large single key – 50GBs +
Support Ozone REST and RPC protocols.
User facing documentation
Ship Java client Libraries for Ozone supporting both RPC and REST.
Meet Apache Release criteria.
Make sure YARN, Hive, and Spark applications can work against Ozone FS. | +| Release | Tag | Features | Exit criteria | +| :------ | :------------------------------------------------------------------------ | :------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- | :--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- | +| 2.1.0 | Joshua Tree
RELEASED | [HDDS-10239](https://issues.apache.org/jira/browse/HDDS-10239) Storage Container Reconciliation
[HDDS-12940](https://issues.apache.org/jira/browse/HDDS-12940) Ozone Snapshot Phase 3: Scale up Snapshot Operations
[HDDS-8387](https://issues.apache.org/jira/browse/HDDS-8387) Container and volume scanners phase II
[HDDS-12564](https://issues.apache.org/jira/browse/HDDS-12564) Handling disk issues in Datanodes - Phase II
| | +| 2.0.0 | Indiana Dunes
RELEASED | [HDDS-7593](https://issues.apache.org/jira/browse/HDDS-7593) Supporting HSync and lease recovery
[HDDS-7852](https://issues.apache.org/jira/browse/HDDS-7852) SCM Decommissioning Support
[HDDS-8829](https://issues.apache.org/jira/browse/HDDS-8829) Symmetric Keys for Delegation Tokens
[HDDS-10656](https://issues.apache.org/jira/browse/HDDS-10656) Atomic Key Overwrite and Key Replacement
**Other noteworthy changes:**
[HDDS-6263](https://issues.apache.org/jira/browse/HDDS-6263) ARM64 support
[HDDS-8246](https://issues.apache.org/jira/browse/HDDS-8246) Java 11/17/21 Support and Testing
[HDDS-11577](https://issues.apache.org/jira/browse/HDDS-11577) AWS SDK v2 client support | | +| 1.4.1 | Hot Springs
RELEASED | Stability improvements. For a detailed list, please refer to [Changes between Ozone-1.4.0 and Ozone-1.4.1 on GitHub)](https://github.com/apache/ozone/compare/ozone-1.4.0...ozone-1.4.1) | | +| 1.4.0 | Hot Springs
RELEASED | Ozone Snapshot feature
Erasure Coding - V2 support (offline reconstruction)
Container balancer support for Erasure Coding
Heat map support, more diagnose info on Recon
Certificate auto rotation
SCM Decommission support
OM Decommission improvement
New symmetric key based block/container token implementation
Quota on FSO bucket support | | +| 1.3.0 | Grand Canyon
RELEASED | Erasure Coding - V1 support (Online reconstruction support)
Container balancer
Limit number of RocksDB instances to 1 per disk on high-density Datanodes
Ozone S3 Multi-tenancy Support
S3 gRPC improvements for metadata path
Filesystem Optimized and Object Store bucket layout types | | +| 1.2.0 | Glacier
RELEASED | SCM HA support for fresh installations
Non-rolling upgrade and downgrade support
Optimized filesystem (prefix) support for fresh installations
Transparent data encryption for S3 buckets | | +| 1.1.0 | Everglades
RELEASED | Volume/Bucket Quota Support
ofs/o3fs performance improvements with Teragen and Spark
[Ozone FS namespace](https://issues.apache.org/jira/browse/HDDS-2939) | | +| 1.0.0 | Denali
[RELEASED](http://hadoop.apache.org/ozone/release/1.0.0/) | Security Phase II
HA support for Ozone Manager
ofs ([HDDS-2665](https://issues.apache.org/jira/browse/HDDS-2665)), new scheme: ofs://OM/volume/bucket/key
Ozone Filesystem performance improvement ([HDDS-2939](https://issues.apache.org/jira/browse/HDDS-2939))
Ozone support security enabled Hadoop 2.x
S3 volume/bucket mapping changes and bind mounted buckets ([HDDS-3385](https://issues.apache.org/jira/browse/HDDS-3385))
Hadoop 2.7 support / remove of Isolated class loader ([HDDS-3458](https://issues.apache.org/jira/browse/HDDS-3458))
Recon / Recon UI improvements (new management / debug screens)
| Support upgrading / persist current versions metadata
Support MR jobs with the new scheme
Support fast directory list with 1 billion keys and deep hierarchy
**Testing integrations with other projects**
Hive LLAP
Impala
Spark (TPC-DS) | +| 0.5.0 | Crater Lake
[RELEASED](http://hadoop.apache.org/ozone/release/0.5.0/) | Stability improvements
Performance and Scale
High Availability
Topology awareness.
Management Console
Disk Scanner
Centralized Management UI updates to SCM and OM.
Decommissioning
| Long-running tests based on Apache NIFI, Hive, and Spark. Able to handle 1 Billion objects.
GDPR Right to Erasure
Network Topology awareness for block placement.
Recon Server V1
Disk scanner and ability to detect block corruptions.
Hadoop Configurations are hard to manage, make it easy for Ozone.
Support Decommission. | +| 0.4.1 | Biscayne
[RELEASED](http://hadoop.apache.org/ozone/release/0.4.1/) | Stability improvements
Ozone Native ACL support
First class K8s support
| Support Native ACLs in Ozone.
Ozone becomes K8s aware. | +| 0.4.0 | Badlands
[RELEASED](http://hadoop.apache.org/ozone/release/0.4.0/) | **Security**
| Hadoop Delegation Tokens and Block Tokens supported for Ozone.
Transparent Data Encryption (TDE) Support - Allows data blocks to be encrypted-at-rest.
Kerberos support for Ozone.
Certificate Infrastructure for Ozone - Tokens use PKI instead of shared secrets. to communication secured via mutual TLS.
Ability secure Ozone cluster that works with Yarn, Hive, and Spark.
Helm/ support to deploy Ozone clusters on K8s.
Support S3 Authentication Mechanisms like - S3 v4 Authentication protocol.
S3 Gateway supports upload.
Support S3A file system
Support for Tracing and Profiling for all Ozone components.
Audit Support - including Audit Parser tools.
Apache Ranger Support in Ozone. | +| 0.3.0 | Arches
[RELEASED](http://hadoop.apache.org/ozone/release/0.3.0/) | S3 Protocol head
| Create an S3 protocol head that can work with Ozone.
Ingest via S3 protocol head, process data via Ozone FS.
Support a minimally complete S3 API set.
Make sure that AWS CLI and AWS Java SDK works correctly against the protocol head
Large Scale and complete testing of Application Stack. YARN, Hive, and Spark. | +| 0.2.1 | Acadia
[RELEASED](http://hadoop.apache.org/ozone/release/0.2.1/) | Basic Ozone functionality
Ozone FS Command Shell
Java SDK.
| Be able to create Ozone volumes, buckets, and Keys.
Create a large number of keys.
Millions of keys tested.
Write large single key – 50GBs +
Support Ozone REST and RPC protocols.
User facing documentation
Ship Java client Libraries for Ozone supporting both RPC and REST.
Meet Apache Release criteria.
Make sure YARN, Hive, and Spark applications can work against Ozone FS. | diff --git a/src/theme/DocSidebar/index.js b/src/theme/DocSidebar/index.jsx similarity index 57% rename from src/theme/DocSidebar/index.js rename to src/theme/DocSidebar/index.jsx index a237b85545..9cb2f5e193 100644 --- a/src/theme/DocSidebar/index.js +++ b/src/theme/DocSidebar/index.jsx @@ -17,22 +17,25 @@ * under the License. */ -import React from 'react'; -import DocSidebar from '@theme-original/DocSidebar'; -import DocsVersionDropdownNavbarItem from '@theme-original/NavbarItem/DocsVersionDropdownNavbarItem'; -import styles from './index.module.css'; +import DocSidebar from "@theme-original/DocSidebar"; +import DocsVersionDropdownNavbarItem from "@theme-original/NavbarItem/DocsVersionDropdownNavbarItem"; +import styles from "./index.module.css"; export default function DocSidebarWrapper(props) { return ( - <> -
- 
}
-
- {label}
- {href && !isInternalUrl(href) &&
-
);
}
diff --git a/src/theme/DocSidebar/index.module.css b/src/theme/DocSidebar/index.module.css
index c3d7447af4..60177d5bb7 100644
--- a/src/theme/DocSidebar/index.module.css
+++ b/src/theme/DocSidebar/index.module.css
@@ -22,32 +22,33 @@
*/
.scrollCustom {
- height: 100%;
- overflow-y: auto;
- overflow-x: hidden;
- margin-top: var(--ifm-navbar-height);
+ height: 100%;
+ overflow-y: auto;
+ overflow-x: hidden;
+ margin-top: var(--ifm-navbar-height);
}
#sidebarCssSelector > div {
- padding-top: 0 !important;
+ padding-top: 0 !important;
}
aside .customSidebarVersion {
- padding: 0.5rem 0 0 0.5rem;
+ padding: 0.5rem 0 0 0.5rem;
}
aside .customSidebarInner {
- align-items: center;
- border: 1px solid #eee;
- border-radius: 0.5rem;
- box-shadow: 0 1px 2px 0 rgba(0,0,0,.03);
- display: flex;
- margin: 1rem;
- padding: 4px 1rem;
+ align-items: center;
+ border: 1px solid #eee;
+ border-radius: 0.5rem;
+ box-shadow: 0 1px 2px 0 rgba(0, 0, 0, 0.03);
+ display: flex;
+ margin: 1rem;
+ padding: 4px 1rem;
}
aside .customSidebarVersion p {
- margin-bottom: 0;
- font-size: var(--fbc-font-size: 13px;);
- padding: var(--ifm-menu-link-padding-vertical) var(--ifm-menu-link-padding-horizontal);
+ margin-bottom: 0;
+ font-size: var(--fbc-font-size, 13px);
+ padding: var(--ifm-menu-link-padding-vertical)
+ var(--ifm-menu-link-padding-horizontal);
}
diff --git a/src/theme/Footer/LinkItem/index.js b/src/theme/Footer/LinkItem/index.js
deleted file mode 100644
index 3d9ebc18a6..0000000000
--- a/src/theme/Footer/LinkItem/index.js
+++ /dev/null
@@ -1,58 +0,0 @@
-/*
- * Licensed to the Apache Software Foundation (ASF) under one
- * or more contributor license agreements. See the NOTICE file
- * distributed with this work for additional information
- * regarding copyright ownership. The ASF licenses this file
- * to you under the Apache License, Version 2.0 (the
- * "License"); you may not use this file except in compliance
- * with the License. You may obtain a copy of the License at
- *
- * http://www.apache.org/licenses/LICENSE-2.0
- *
- * Unless required by applicable law or agreed to in writing,
- * software distributed under the License is distributed on an
- * "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
- * KIND, either express or implied. See the License for the
- * specific language governing permissions and limitations
- * under the License.
- */
-
-import React from 'react';
-import Link from '@docusaurus/Link';
-import useBaseUrl from '@docusaurus/useBaseUrl';
-import isInternalUrl from '@docusaurus/isInternalUrl';
-import IconExternalLink from '@theme/Icon/ExternalLink';
-
-const iconMapping = {
- 'GitHub Discussions': '/img/social/github.svg',
- 'Jira Issues': '/img/social/jira.svg',
- 'Slack': '/img/social/slack.svg',
- 'Mailing List': '/img/social/mail.svg',
- 'YouTube': '/img/social/youtube.svg',
- 'Twitter': '/img/social/twitter-x.svg'
-};
-export default function FooterLinkItem({item}) {
- const {to, href, label, prependBaseUrlToHref, ...props} = item;
- const toUrl = useBaseUrl(to);
- const normalizedHref = useBaseUrl(href, {forcePrependBaseUrl: true});
- const iconPath = iconMapping[label]; // Get icon path from mapping
-
- return (
-
-
- {iconPath && Version:
+
+
+
+
+
-
+
+ Version:{" "}
+
-
-