Tommy on X: “ChatGPT's Process - Takes text - Finds embeddings (numbers to represen…”

A fast, private reader for public X posts. No account, no tracking, no pop-ups.

PeekX is an independent tool and is not affiliated with, endorsed by or sponsored by X Corp. “X” and “Twitter” are trademarks of their respective owners. We only show posts that their authors made public and never access private or protected accounts. Downloaded media belongs to its creators — please respect their rights.

Tommy on X: “ChatGPT's Process - Takes text - Finds embeddings (numbers to represen…” | PeekX

Username or post link

Home / @Shaughnessy119 / Post

Tommy

@Shaughnessy119

May 28, 2023

An interesting side note for the Crypto audience.

Crypto's own @ilblackdragon, the co-founder of @NEARProtocol, is one of the authors on the original Transformers Paper

arxiv.org/abs/1706.03762

First let's recap ChatGPT's process:

arxiv.orgAttention Is All You Need

3 20 102

Tommy

@Shaughnessy119

Replying to @Shaughnessy119

ChatGPT's Process

- Takes text
- Finds embeddings (numbers to represent text)
- Processes (values go through layers of the NN)
- New embedding produced (new number array)
- Takes array and generates 50,000 values for next possible tokens
- Highest prob produces text (I think)

May 28, 2023, 8:09 PM UTC

2 61

Downloads

This post has no photos or videos. You can still save it as an image or copy its text below.

Save & share

Turn this post into a clean image, or copy it as text or Markdown.

Open on X