sylv avatar
closes Sep 15
an LLM as capable as GPT-4 will run on a 3090 before Sept 14th

e.g. WinoGrande >= 87.5%

Sort by:
cherrvak avatar
Konstantine Sadov

Would offloading part of the model to CPU count satisfy the resolution criteria?

hekatonsure avatar
Hekis predicting YES at 35%

@cherrvak I assume "run on a 3090" means "run on a consumer PC with a single 3090 and a cpu, primarily using the gpu"