ort-customops/test
Sayan Shaw 8bc8e43da1
Add C++ regex support for Llama3, Standard Library, and Custom Cases (#804)
* add C++ standard library regex support for GPT2 case

* reorder regex handling

* try without STL

* missing case

* add llama3 regex support

* add custom regex impl

* change regex based on model

* modify tests, add docs, and code cleanup

* add regex test and const strings

---------

Co-authored-by: Sayan Shaw <sayanshaw@microsoft.com>
2024-09-10 23:17:49 -07:00
..
cuda
data Remove OpenCV dependency from C_API mode (#800) 2024-09-04 16:50:05 -07:00
ios
pp_api_test Add C++ regex support for Llama3, Standard Library, and Custom Cases (#804) 2024-09-10 23:17:49 -07:00
shared_test
static_test
unittest_main
codeconv.runsettings
packages.config
test_audio_codec.py
test_audio_signal.py
test_autotokenizer.py
test_azure_ops.py
test_bert_tokenizer.py
test_bert_tokenizer_decoder.py
test_bert_tokenizer_op.py
test_blingfire_sentencebreaker.py
test_bpe_tokenizer.py
test_cliptok.py
test_cv2.py
test_fast_tokenizer.py
test_gpt2tok.py
test_masked_fill.py
test_math_ops.py
test_onnxprocess.py
test_processing.py
test_pyops.py
test_robertatok.py
test_segment_extraction.py
test_sentencepiece_ops.py
test_string_concat.py
test_string_ecma_regex.py
test_string_length.py
test_string_mapping.py
test_string_ops.py
test_string_to_vector.py
test_tools_add_pre_post_processing_to_model.py
test_tools_customop_template.py
test_torch_ops.py
test_trie_tokenizer.py
test_vector_to_string.py
test_whisper.py