github
/
InternLM
mirror of https://github.com/InternLM/InternLM
1
0
Fork 0
Code Issues Projects Releases Wiki Activity

update get_train_data_loader, del old doc

pull/498/head
YWMditto 2023-11-14 16:36:18 +08:00
parent f656ff08a6
commit e5a1ff2336
1 changed files with 0 additions and 2 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
internlm/train/training_internlm.py
View File

@ -208,8 +208,6 @@ def get_train_data_loader(num_worker: int = 0, dataset_generate_func: Optional[C
Args: Args:
num_worker (:class:`int`): number of subprocesses used for dataloader. num_worker (:class:`int`): number of subprocesses used for dataloader.
dataset_generate_func (:class:`Callable`, optional): generate function for dataset. dataset_generate_func (:class:`Callable`, optional): generate function for dataset.
train_sampler (:class:`torch.utils.data.sampler`, optional): dataset sampler for training dataloader.
train_collate_fn (:class:`Callable`, optional): collate function for training dataloader.
Returns: Returns:
A tuple of (train_dl, dataset_types). A tuple of (train_dl, dataset_types).