Skip to content

Create / publish guidance & examples for calling a source connector via a workflow #339

@jaydubb12

Description

@jaydubb12

Feature

Create / generate sample(s) that provide a contextual overview of the process / pattern a developer would utilize to call / reference a Source Connector within a TD Workflow.

Tasks

Create universal example

  1. Create an example and complimentary README.md to provide an overview of how a developer can leverage a Source configuration's uniqueID as a step within a TD workflow
+import_task:
      td_load>: {source_unique_id}

Create practical examples

  1. Create a revised example of the S3 v2 Import workflows to depict an example of how the solution can be utilized to realize the benefit / simplicity of the GUI configuration to setup a scheduled ingestion, and to then utilize a custom workflow to support failure / exception handling as well as downstream tasks such as data quality management or unification.

Deprecate legacy / outdated workflows

  1. Deprecate legacy example, that is annotated as an approach that is not recommended, and replace it with an example such as this, and potentially a secondary example that calls / references a workflow UUID, which is similar, but different than the Source uniqueID

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions