You can now train a 70b language model at home (if you have a dual-3090 or better)

unkz
2024-03-08T16:36:02Z

Link URL: https://www.answer.ai/posts/2024-03-06-fsdp-qlora.html

Comments URL: https://tildes.net/~tech/1esd/you_can_now_train_a_70b_language_model_at_home_if_you_have_a_dual_3090_or_better

Votes: 11

Comments: 1