feature/onnx/com.shifthackz.aisdv1.feature.onnx.ai.tokenizer/EnglishTextTokenizer/Companion/TOKENIZER_REGEX

TOKENIZER_REGEX

private const val TOKENIZER_REGEX: String(source)

Exposes the TOKENIZER_REGEX value used by the SDAI ONNX local diffusion feature layer.

Author

Dmitriy Moroz