Wenbing Li d1148aea4e Support 'added_token' attribute for BPE tokenizer and some code refactoring. (#591) ... * Fix CodeGenTokenizer issues and the related code refactoring. * refactor the trie-tree * temp check-ins * code complete * correctness fixing * Update _hf_cvt.py * more test cases fixing * more refinement * linux crash fixing * Update test_autotokenizer.py		2023-11-04 22:56:26 -07:00
..
audio	Refactor String and Audio operators with status-return prototype. (#576)	2023-10-19 10:40:58 -07:00
azure	Enable using system certs on Android. (#543)	2023-08-24 12:17:07 +10:00
cv2	add more hf models into converter APIs (#562)	2023-09-18 14:38:32 -07:00
math	Add CUDA build support and some code refinements (#581)	2023-10-30 21:06:30 -07:00
text	Add CUDA build support and some code refinements (#581)	2023-10-30 21:06:30 -07:00
tokenizer	Support 'added_token' attribute for BPE tokenizer and some code refactoring. (#591)	2023-11-04 22:56:26 -07:00
vision	Make kernel Compute method implementations const (#500)	2023-07-28 09:25:36 +10:00
ocos_operators_placeholder.cc	Ensure noexcep_operators and ocos_operators get built always (#570)	2023-10-09 18:29:02 -07:00