This documentation describes the details and parameters required to create a Google Composer Workload within the Witboost platform.
A System should already exist in order to attach the new components to it.
The Creation Wizard allows you to create a new Google Composer Workload.
This section covers the basic information that any component must have.
- Name: Required. The name of the component.
- Description: Required. Help others understand what this component is for.
- Data Product: Required. The System this Workload belongs to. Be sure to choose the right one as it cannot be changed.
- Identifier: Autogenerated from the information above. A unique identifier for the component. It will not be editable after creation and is a string composed of [a-zA-Z] separated by any of [-_].
- Owner: Automatically selected from the System metadata. System owner.
- Reads From: A workload could read from other components in other Systems or external components. This information will be used for lineage reasons.
- Depends On: A component could depend on other components in the same System. This information will be used to deploy the components in such an order that their dependencies already exist.
- Tags: Tags for the component.
Example:
| Field name | Example value |
|---|---|
| Name | Cloud Vaccinations Workload |
| Description | Contains data on COVID-19 Vaccinations |
| Domain | domain:healthcare |
| Parent | system:healthcare.vaccinationsdp.0 |
| Identifier | Will look something like this: healtchare.vaccinationsdp.0.vaccinations-workload. Depends on the name you gave to the component and the System it belongs to. |
| Owner | Will look something like this: group:datameshplatform. Depends on the System owner. |
| Depends On | |
| Reads From | |
| Tags |
This section covers specific information related to the Google Composer Workload Template.
| Field name | Description |
|---|---|
| Artifact Name | The name of the artifact containing the Airflow DAG. |
| Artifact Version | The version of the artifact containing the Airflow DAG. |