Working Notes: a commonplace notebook for recording & exploring ideas.
Home. Site Map. Subscribe. More at expLog.

Llm Related Projects I Want To Try

• minimal llm model that predicts look and say with a small context window to build intuition
  • see how many layers it takes to do it right
  • try other patterns too
  • implement with numpy/jax
• read and interact with full laptop, also use voice
• have a small llm that interacts with the web and googles & summarizes for me
• train an llm from scratch for a purpose
• train an english only llm
• extract a program from an llm
• social media, hacker news consumer and summarizer
• cli command generator that understands history, man pages, locally run help, etc.
• compose UIs using LLM results (webpage + llm to extract contents)

— Kunal