Marco De Rossi
@marco_derossi
Chatbots, old way:
Every message goes to the LLM, and you wait.
New way:
A decision model reads the intent in milliseconds, your code handles it, and the LLM is only the fallback.
More of our clients are doing this. The K12 Edu app Leap is a nice example.
Every message goes to the LLM, and you wait.
New way:
A decision model reads the intent in milliseconds, your code handles it, and the LLM is only the fallback.
More of our clients are doing this. The K12 Edu app Leap is a nice example.
Levanto Labs@levantolabs · Oct 2People don’t like talking to chatbots that take more than 3 seconds to respond. Can decision models help solve this?
Let's look at a tool-calling case study.
A student on Leap types "make me flashcards."
The usual path: send the request to an LLM, wait 3–4 seconds, read a
Let's look at a tool-calling case study.
A student on Leap types "make me flashcards."
The usual path: send the request to an LLM, wait 3–4 seconds, read a
0:26 1 10