Arya Kanna
@aryakanna9
spent the week profiling a training job. expected to find a slow kernel.
found this instead. the GPU was barely the bottleneck. it spent most of its time waiting on the data path. orange is idle time.
found this instead. the GPU was barely the bottleneck. it spent most of its time waiting on the data path. orange is idle time.
0 2