Working Notes: a commonplace notebook for recording & exploring ideas.
Home. Site Map. Subscribe. More at expLog.

2024-03-10

I'm taking a week off from work, and planning to use that time to read interesting papers, dig into the LLaMa models, and catch up on learning and exploring things I generally don't get time to. I'll keep a daily entry for summarizing the day's explorations as I go.

If things go well, by the end of the week I'll have played a little bit with cuda, inference, understanding some model dimensions, fine tuning, etc.

Emacs, Tramp & SSH

Emacs surpassed my expectations yet again by supporting ssh'ing with multiple hops transparently. The trick to setting this up is to use a file path like sshx:dev1|sshx:dev2:~/ and it Just Works. I could even use a shell over this smoothly.

For using Tramp comfortably (as it spawns multiple sessions) I find it extremely valuable to use ControlMaster to share SSH connections and skip authenticating repeatedly. The .ssh/config additions to enable this are:

  ControlMaster auto
  ControlPersist yes
  ControlPath /home/kunalb/.ssh/multiplex/%C

A quick Google search and reading a couple of articles shows this one from CyberCiti which covers the bits I use, and several bits I don't.

Abstraction vs Illusion

From a video that floated across my YouTube recommendations: Abstractions remove/generalize details to focus attention on important details instead. Illusions accidentally remove important details... confusing end users. This is clearly a goldilocks zone, and the decision of important is a matter of taste and experience.

The speaker also calls out the risk of the uncanny valley where an abstraction is almost like another platform you're used to -- it becomes much harder to use, because you're not sure which bits are missing.

Kunal