Wenbing Li 2d02a687be Optimize the tokenizer for efficiency (#797) ... * optimize the tokenizer for efficiency * fix the unit test failures. * fix the api test case failures * removed the unused code. * More test cases fixings * One more fixing * fix macOS build issues * refine the test * add more diagnosis info. * fix unit test in CI Linux * fix the pp_api test failure		2024-08-27 18:57:50 -07:00
..
python	Add initial API docs generation and publishing (#540)	2023-08-29 20:28:48 -07:00
How_to_write_custom_op.md	sync to flash attention kernel 2.5.9 and add document of how to write custom op (#757)	2024-07-10 07:09:40 -07:00
c_api.md	Add more tests for pre-processing C APIs (#793)	2024-08-21 16:48:39 -07:00
ci_matrix.md	upgrade all dependency versions (#466)	2023-06-03 20:09:41 -07:00
custom_build.md	the doc for android/java custom build. (#260)	2022-07-08 10:26:00 -07:00
custom_ops.md	Add more tests for pre-processing C APIs (#793)	2024-08-21 16:48:39 -07:00
development.md	Optimize the tokenizer for efficiency (#797)	2024-08-27 18:57:50 -07:00
new_operator.md	Add a new API for building data processing graph from Huggingface transformers processor/tokenizer (#482)	2023-07-17 16:50:58 -07:00
pyop.md	PyOp attribute supports int and float data type (#425)	2023-05-05 19:35:59 -07:00