Paolo Rosson
@redp314
Tested @ashxhart's TensorFold v0.3.6.3 on one DGX Spark with Qwen3.8-Flash-Next (NVFP4, MTP-6).
Fixed 2,048-token code task:
74.8 tok/s single-stream decode,
313 tok/s across 8 streams.
Context sweep: 56–65 tok/s through 132k input;
50.8 at 260k (one run).
Cold TTFT at
Fixed 2,048-token code task:
74.8 tok/s single-stream decode,
313 tok/s across 8 streams.
Context sweep: 56–65 tok/s through 132k input;
50.8 at 260k (one run).
Cold TTFT at
0 3