Wenbing Li 5104bb9897 fix the win32 macro usage (#844)		2024-11-15 11:26:37 -08:00
..
cuda	Add custom ops ReplaceZero (#739)	2024-06-18 11:36:14 +02:00
data	Load the tokenizer data from the memory (#836)	2024-11-09 10:15:21 -08:00
ios	…
pp_api_test	fix the win32 macro usage (#844)	2024-11-15 11:26:37 -08:00
shared_test	Refactor the unit tests and cmake build script (#726)	2024-05-30 14:16:14 -07:00
static_test	Add a decoder for Unigram tokenizer and unify some classes among tokenizers (#816)	2024-09-25 10:25:06 -07:00
unittest_main	Add the tokenizer C ABI (#693)	2024-04-29 16:45:49 -07:00
codeconv.runsettings	…
packages.config	…
test_audio_codec.py	…
test_audio_signal.py	…
test_autotokenizer.py	…
test_azure_ops.py	…
test_bert_tokenizer.py	…
test_bert_tokenizer_decoder.py	…
test_bert_tokenizer_op.py	…
test_blingfire_sentencebreaker.py	…
test_bpe_tokenizer.py	…
test_cliptok.py	Fix the Unicode code discrepency on CLIP model (#814)	2024-09-23 16:49:24 -07:00
test_cv2.py	Unify the image operations in extensions library (#831)	2024-10-30 09:17:06 -07:00
test_fast_tokenizer.py	Optimize the tokenizer for efficiency (#797)	2024-08-27 18:57:50 -07:00
test_gpt2tok.py	…
test_masked_fill.py	…
test_math_ops.py	Add the tokenizer C ABI (#693)	2024-04-29 16:45:49 -07:00
test_onnxprocess.py	…
test_pp_api.py	Add the MLlama Imaging Processing Support (#823)	2024-10-22 14:24:09 -07:00
test_processing.py	Fix the CI pipeline for the latest PyTorch release. (#759)	2024-07-08 16:21:48 -07:00
test_pyops.py	…
test_robertatok.py	…
test_segment_extraction.py	…
test_sentencepiece_ops.py	…
test_string_concat.py	…
test_string_ecma_regex.py	…
test_string_length.py	…
test_string_mapping.py	…
test_string_ops.py	…
test_string_to_vector.py	…
test_tools_add_pre_post_processing_to_model.py	…
test_tools_customop_template.py	…
test_torch_ops.py	…
test_trie_tokenizer.py	…
test_vector_to_string.py	…
test_whisper.py	using the huggingface whisper config instead of fixed numbers (#667)	2024-03-06 14:29:49 -08:00