Skip to content

Text Pipeline 增加 Toxicity, NSFW 检测,并且适当合并不同的 stage #41

@chtlp

Description

@chtlp

System Info

https://open-dataflow.github.io/DataFlow-Doc/en/guide/textpipeline/

Text Pipeline 需要加上 Toxicity, NSFW 检测,参考如下:
Image

利用内存直接输出的模式,适当合并算子,参考 #40

Others

No response

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementNew feature or request

    Type

    No type

    Projects

    No projects

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions