An implementation of model parallel autoregressive transformers on GPUs, based on the DeepSpeed library..
Eleuther AI
top of page
bottom of page
An implementation of model parallel autoregressive transformers on GPUs, based on the DeepSpeed library..