Ryan Brooks
@rbro112
Real good post here. This is what our evals at Sentry have naturally converged to - guardrails, goals and metrics - each serving a slightly different purpose.
Figuring out how to get devs to use the results is the tougher problem
Figuring out how to get devs to use the results is the tougher problem
Lotte@lotte_verheyden · Aug 18Before you write good evals, you have to pick the right things to evaluate. Main take-aways:
- source metrics from failures you see in traces
- keep the set small and maintainable
- only keep a metric if you'd take action when it moves x.com/i/article/2089…
Open quoted post →- source metrics from failures you see in traces
- keep the set small and maintainable
- only keep a metric if you'd take action when it moves x.com/i/article/2089…
0 6