MegaTrain: Full Precision Training
MegaTrain enables full precision training of large language models on a single GPU. It stores parameters in host memory and uses GPUs as compute engines.
#training
Training
25 stories tagged Training · page 2 of 2
25 stories tagged Training · page 2 of 2
MegaTrain enables full precision training of large language models on a single GPU. It stores parameters in host memory and uses GPUs as compute engines.