Patrick C Toulme
@PatrickToulme
I was at an AI dinner last night in NYC.
Some interesting topics discussed
1. Performance engineers now spend most of their time managing agents and RSI loops. Most perf opts at major inference providers (together, fireworks) are found by agents.
2. RLing too much on code and
Some interesting topics discussed
1. Performance engineers now spend most of their time managing agents and RSI loops. Most perf opts at major inference providers (together, fireworks) are found by agents.
2. RLing too much on code and
142 3.6K