ColossalAI/examples/tutorial/sequence_parallel/data/tokenizer
Hongxin Liu 079bf3cb26
[misc] update pre-commit and run all files (#4752)
* [misc] update pre-commit

* [misc] run pre-commit

* [misc] remove useless configuration files

* [misc] ignore cuda for clang-format
2023-09-19 14:20:26 +08:00
..
__init__.py [misc] update pre-commit and run all files (#4752) 2023-09-19 14:20:26 +08:00
bert_tokenization.py [misc] update pre-commit and run all files (#4752) 2023-09-19 14:20:26 +08:00
tokenizer.py [misc] update pre-commit and run all files (#4752) 2023-09-19 14:20:26 +08:00