Pangu-Alpha for Transformers
Usage
- Download MindSpore FP32 weights for GPU from here to
data/Pangu-alpha_2.6B.ckpt
- Activate MindSpore environment and export weights to NumPy
python convert_mindspore_to_numpy.py
- Activate PyTorch environment and convert NumPy weights to Transformers
python convert_numpy_to_transformers.py
- Transformers model can be load from
data/transformers