Zartbot
@zartbotF
but there is a hard limit on training / inference GPU cluster's VRAM...
jietang@jietang · Sep 10Are you sure? Finding the optimal model size is tricky: data volume, active parameter count, the number of environments, and the target inference cost. Model performance also depends on many other factors, each introducing its own variability.
Open quoted post → 0 12