Jim Fanさんのイラストまとめ

Let's talk about the elephant in the room - will LLM take your job?

OpenAI & UPenn conclude that ~80% of the U.S. workforce could have > 10% of work affected, and 19% of workers may see > 50% of work impacted. GPT-4 *itself* actively helps in this study.

What to make of it?🧵

A treasure trove just dropped.

Transformer family V2: a very comprehensive survey of the latest and greatest in modern LLM’s backbone.

Covers lots of advanced features like longer context memory, external memory, recurrence, adaptive & efficient attention, and Transformer+RL.