Working Notes: a commonplace notebook for recording & exploring ideas.
Home. Site Map. Subscribe. More at expLog.

[Wip] Numbers Every Ai Engineer Needs To Know

• An article I've always wanted to have, if not write

• Make it easy to build simulations and have Fermi numbers at the back of my head

• Order of magnitudes

Collecting numbers

• GPU specs | GPU Type | FLOPS | Memory Bandwidth | | GB200 | | | | H100 | | | | A100 | | |

References

• Tom's Hardware

— Kunal