mirror of https://github.com/InternLM/InternLM
697 B
697 B
InternLM Transformers
This folder contains the InternLM model in transformers format.
Weight Conversion
convert2hf.py can convert saved training weights into the transformers format with a single command.
python convert2hf.py --src_folder origin_ckpt/ --tgt_folder hf_ckpt/ --tokenizer ../v7_sft.model
Then, you can load it using the from_pretrained interface:
from modeling_internlm import InternLMForCausalLM
model = InternForCausalLM.from_pretrained("hf_ckpt/")
intern_moss_example.py demonstrates an example of how to use LoRA for fine-tuning on the fnlp/moss-moon-002-sft dataset.