Very nice write-up: The GPT-3 Architecture, on a Napkin
Got to be careful with its output though! I asked to generate a false proof and got a legit-sounding answer which is of course totally untrue
