Tommy on X: “Where to these probabilities come from? ChatGPT is a model that lets p…”

A fast, private reader for public X posts. No account, no tracking, no pop-ups.

PeekX is an independent tool and is not affiliated with, endorsed by or sponsored by X Corp. “X” and “Twitter” are trademarks of their respective owners. We only show posts that their authors made public and never access private or protected accounts. Downloaded media belongs to its creators — please respect their rights.

Tommy on X: “Where to these probabilities come from? ChatGPT is a model that lets p…” | PeekX

Username or post link

Home / @Shaughnessy119 / Post

Tommy

@Shaughnessy119

May 28, 2023

The goal of a large language model is to reasonably continue the text it already has

ChatGPT's LLM estimates these probabilities

Temperature is a parameter that determines how often lower ranked words are used, adding randomness.

LLM's are trained on vast amounts of human text

3 16 209

Tommy

@Shaughnessy119

Replying to @Shaughnessy119

Where to these probabilities come from?

ChatGPT is a model that lets people estimate the probabilities which sequences of words should occur.

Stephen adds an interesting walk through demonstrating the probability of how often letters occur, and then pairs of letters and beyond

May 28, 2023, 8:09 PM UTC

1 128

Download media

Every quality X serves, straight from X's media CDN. No watermark, no wait.

OriginalBEST

Photo · 872×795

Save & share

Turn this post into a clean image, or copy it as text or Markdown.

Open on X