Mirror library: mindformers

1. Differences between mindformers0.8 and mindformers-llm

mindfomers-llm is a slimmed down version of mindformers0.8 for the large language model, with the imagenet dataset and image quickstart script removed.

2. Quickstart

(1) Go to the mindformers directory:

cd /home/mindspore/mindformers

(2) Generate the rank_table file:

python mindformers/tools/hccl_tools.py --device_num [0,8]

(3) Go to the scripts directory:

cd /scripts

(4) Execute the quickstart script:

bash run_xxx_xxx.sh

Note

Scripts with model names under scripts.

For example: run_gpt2_lora.sh is the quick start script, run_standalone.sh and run_distribute.sh are generic startup scripts.