correct CLIP tokenizer name (#526)
This commit is contained in:
Родитель
029a2aac14
Коммит
ee14fbe48e
|
@ -11,7 +11,7 @@
|
|||
2. Support for pre-processing and post-processing of the Whisper model, inclusive of Audio and Tokenizer decoding operators.
|
||||
3. Extends support for pre-processing and post-processing of object-detection models, including a new DrawBoundingBoxes operator. Pre/post processing tools can add non-max-suppression to the model to select the best bounding boxes, and scale those to the original image. See the end-to-end example in yolo_e2e.py.
|
||||
4. Introduces the Audio Domain, complemented with AudioCodec and optimized STFT Operators, enhancing audio processing capabilities.
|
||||
5. Enabled optional input/output support for some operators such as GPT2Tokenizer, ClipTokenizer, and RobertaTokenizer.
|
||||
5. Enabled optional input/output support for some operators such as GPT2Tokenizer, CLIPTokenizer, and RobertaTokenizer.
|
||||
6. Refined the implementation of offset mapping for BBPE-style tokenizers for more operators and efficiency improvement.
|
||||
7. Other bug and security fixes.
|
||||
</releaseNotes>
|
||||
|
|
|
@ -135,7 +135,7 @@ _PROCESSOR_DICT = {
|
|||
'BertDecoder', HFTokenizerConverter.bpe_decoder, None),
|
||||
"GPT2Tokenizer": TokenOpParam('GPT2Tokenizer', HFTokenizerConverter.bpe_tokenizer,
|
||||
'BpeDecoder', HFTokenizerConverter.bpe_decoder, None),
|
||||
"ClipTokenizer": TokenOpParam('ClipTokenizer', HFTokenizerConverter.clip_tokenizer,
|
||||
"CLIPTokenizer": TokenOpParam('CLIPTokenizer', HFTokenizerConverter.clip_tokenizer,
|
||||
'BpeDecoder', HFTokenizerConverter.bpe_decoder, None),
|
||||
"RobertaTokenizer": TokenOpParam("RobertaTokenizer", HFTokenizerConverter.roberta_tokenizer,
|
||||
None, None, None),
|
||||
|
|
|
@ -1 +1 @@
|
|||
com.microsoft.extensions;1;DecodeImage,EncodeImage,BertTokenizer,ClipTokenizer,BpeDecoder,DrawBoundingBoxes,OpenAIAudioToText
|
||||
com.microsoft.extensions;1;DecodeImage,EncodeImage,BertTokenizer,CLIPTokenizer,BpeDecoder,DrawBoundingBoxes,OpenAIAudioToText
|
||||
|
|
|
@ -1 +1 @@
|
|||
com.microsoft.extensions;1;DecodeImage,EncodeImage,BertTokenizer,ClipTokenizer,BpeDecoder,DrawBoundingBoxes
|
||||
com.microsoft.extensions;1;DecodeImage,EncodeImage,BertTokenizer,CLIPTokenizer,BpeDecoder,DrawBoundingBoxes
|
||||
|
|
Загрузка…
Ссылка в новой задаче