Tommy on X: “Transformers are a breakthrough for LLMs. An analogy is they allow the…”

A fast, private reader for public X posts. No account, no tracking, no pop-ups.

PeekX is an independent tool and is not affiliated with, endorsed by or sponsored by X Corp. “X” and “Twitter” are trademarks of their respective owners. We only show posts that their authors made public and never access private or protected accounts. Downloaded media belongs to its creators — please respect their rights.

Tommy on X: “Transformers are a breakthrough for LLMs. An analogy is they allow the…” | PeekX

Username or post link

Home / @Shaughnessy119 / Post

Tommy

@Shaughnessy119

May 28, 2023

ChatGPT's Process

- Takes text
- Finds embeddings (numbers to represent text)
- Processes (values go through layers of the NN)
- New embedding produced (new number array)
- Takes array and generates 50,000 values for next possible tokens
- Highest prob produces text (I think)

2 7 61

Tommy

@Shaughnessy119

Replying to @Shaughnessy119

Transformers are a breakthrough for LLMs.

An analogy is they allow the model to understand the context of words and the relationship between words that are far apart

Transformers can read all text at once vs one at a time so are much more efficient and scalable

Thanks ChatGPT!

May 28, 2023, 8:09 PM UTC

1 78

Download media

Every quality X serves, straight from X's media CDN. No watermark, no wait.

OriginalBEST

Photo · 798×1014

Save & share

Turn this post into a clean image, or copy it as text or Markdown.

Open on X