Skip to main content

Setup

Requirements:

  • PyTorch >= 1.11 (PyTorch 2.x in progress)
  • Python >= 3.7
  • CUDA >= 11.0

If you encounter any problem about installation, you may want to raise an issue in this repository.

Download From PyPI​

You can install Colossal-AI with

pip install colossalai

Note: only Linux is supported for now

If you want to build PyTorch extensions during installation, you can use the command below. Otherwise, the PyTorch extensions will be built during runtime.

CUDA_EXT=1 pip install colossalai

Download From Source​

The version of Colossal-AI will be in line with the main branch of the repository. Feel free to raise an issue if you encounter any problem. :)

git clone https://github.com/hpcaitech/ColossalAI.git
cd ColossalAI

# install dependency
pip install -r requirements/requirements.txt

# install colossalai
pip install .

If you don't want to install and enable CUDA kernel fusion (compulsory installation when using fused optimizer):

CUDA_EXT=1 pip install .