Working Notes: a commonplace notebook for recording & exploring ideas.
Home. Site Map. Subscribe. More at expLog.

2024-02-04

Trying out something new this week; today's letter is written in VSCode web and I have a GitHub Action to publish. Things mostly seem to work; to mimic auto-fill-mode in emacs I'm using gq from Vim emulation in VSCode.

Revisiting Building Developer Tools

This is something I've been thinking about for some time: I wrote Building Developer Tools a lifetime ago, and have since updated some of my beliefs and approaches; most of my opinions are unchanged -- some I'm doubling down on -- and some I've added since.

Better resources

Doubling down on

Adding

Mechanical Sympathy

While I haven't been able to make as much progress as I would have liked, I wanted to explicitly list out all the books, libraries to explore, test programs to write, and resources to use. I'll tentatively keep coming back and updating this specific entry as I find new resources, but to just have a sense of what I'd need a little more formally than last week's entry.

Books to work through:

Libraries to use

Missing topics to add: something aroud better understanding of network limitations, bandwidth, communication mechanisms and HPC. General understanding of data centers, disk, file systems.

And of course, getting better at Transformer architectures and the models -- including the linear algebra. I still can't really visualize K/Q/V etc. straight in my head, and must generally work things out slowly and manually.

Kunal