Working Notes: a commonplace notebook for recording & exploring ideas.
Home. Site Map. Subscribe. More at expLog.
Sitemap
Recent updates
Alphabetical
- ./index (1,159b)
- books/adeepnessinthesky (1,145b)
- books/antimemetics (2,484b)
- books/backofthenapkin (356b)
- books/crucial_conversations (5,420b)
- books/designing_machine_learning_systems (360b)
- books/dragon_fired (170b)
- books/emotional (1,168b)
- books/ergodocity (550b)
- books/fastai (7,080b)
- books/good_with_words (336b)
- books/goodbadstrategy (340b)
- books/ml_qai (205b)
- books/notthinking (1,913b)
- books/oncharacter (889b)
- books/parallel_programming (11,264b)
- books/pearls (60b)
- books/platformeng (393b)
- books/scout_mindset (1,714b)
- books/soundtracks (1,517b)
- books/taoteching (1,225b)
- books/the_crux (781b)
- books/the_mathematical_theory_of_communication (506b)
- books/thinking_better (130b)
- books/thinkingonpaper (1,155b)
- essays/ai_numbers (638b)
- essays/debug_almanac (279b)
- essays/prototyping (484b)
- logs/aidev (1,885b)
- logs/bhack36 (3,995b)
- logs/langchoice (24,965b)
- logs/notebook (1,717b)
- logs/panopticon (2,624b)
- logs/termdex (1,384b)
- logs/transformers (4,525b)
- notes/3b1b_essence (238b)
- notes/a_public_slipbox (6,213b)
- notes/abelian (136b)
- notes/about (1,168b)
- notes/adjacency_matrix (251b)
- notes/advent_of_code_2021 (11,907b)
- notes/aikido_tests (1,244b)
- notes/algorithm_cascading (75b)
- notes/amazon_sagemaker_debugger (2,437b)
- notes/android_atrace (134b)
- notes/android_binder (191b)
- notes/android_doze (967b)
- notes/android_traceview (295b)
- notes/android_useslibrary (705b)
- notes/asyncio (3,229b)
- notes/backprop (203b)
- notes/basic_variables (164b)
- notes/basis_vectors (471b)
- notes/branches (756b)
- notes/brml (38b)
- notes/building_developer_tools (191b)
- notes/buildingllms (877b)
- notes/c (2,664b)
- notes/chord (95b)
- notes/circuits (7,291b)
- notes/clib (151b)
- notes/clique (123b)
- notes/clique_matrix (105b)
- notes/cliquo (63b)
- notes/cliquo_matrix (138b)
- notes/code (420b)
- notes/column_space (88b)
- notes/communications (1,880b)
- notes/communities_programming (1,578b)
- notes/configs_keyboards (1,085b)
- notes/configurations (156b)
- notes/connected_components (143b)
- notes/connected_graph (109b)
- notes/contents (100b)
- notes/coordinate_system (71b)
- notes/cost_efficient (163b)
- notes/cpp (4,946b)
- notes/cross_product (503b)
- notes/cuda (2,809b)
- notes/cuda_devtools (175b)
- notes/cycle (94b)
- notes/data (2,822b)
- notes/debugging (626b)
- notes/deep_learning_nyu (36b)
- notes/deep_learning_nyu_week_1 (2,311b)
- notes/deep_learning_nyu_week_2 (3,888b)
- notes/deep_learning_nyu_week_3 (3,812b)
- notes/deep_learning_nyu_week_4 (602b)
- notes/deep_learning_nyu_week_5 (6,271b)
- notes/deep_learning_nyu_week_6 (1,111b)
- notes/deepseekv3 (5,271b)
- notes/designing_ml_systems (264b)
- notes/detectron (99b)
- notes/determinant (437b)
- notes/directed_acyclic_graph (330b)
- notes/dl_intro (9,765b)
- notes/dot_product (145b)
- notes/duality (191b)
- notes/edge_list (106b)
- notes/eigenbasis (73b)
- notes/eigenvalues (111b)
- notes/eigenvectors (534b)
- notes/elm (1,893b)
- notes/emnist_comet (407b)
- notes/escape_codes (281b)
- notes/exploratory_programming (155b)
- notes/focus (683b)
- notes/forth (524b)
- notes/forth_starting_forth (8,343b)
- notes/full_rank (83b)
- notes/gpuproviders (181b)
- notes/gradient_descent (285b)
- notes/group (495b)
- notes/how_to_engineer (34b)
- notes/how_to_engineer_build_a_team (810b)
- notes/how_to_engineer_communicate (191b)
- notes/how_to_engineer_planning (708b)
- notes/how_to_engineer_program (212b)
- notes/how_to_engineer_program_write_extensible_code (1,731b)
- notes/how_to_engineer_run_a_meeting (847b)
- notes/how_to_not_engineer (1,781b)
- notes/how_to_play_beatsaber (3,734b)
- notes/how_to_read_a_book (1,068b)
- notes/how_to_read_a_paper (787b)
- notes/how_to_read_a_textbook (2,095b)
- notes/how_to_strategy (637b)
- notes/how_to_write_well (1,743b)
- notes/hrm (4,614b)
- notes/hydra (270b)
- notes/i-hat (51b)
- notes/iclr2019 (10,483b)
- notes/identity_transformation (59b)
- notes/improving_collaboration (408b)
- notes/inbox (336b)
- notes/incidence_matrix (194b)
- notes/installing_cuda (1,166b)
- notes/inverse_transformation (290b)
- notes/ipc (1,081b)
- notes/j-hat (52b)
- notes/jacobian_matrix (131b)
- notes/javascript (188b)
- notes/julia (919b)
- notes/kaggle (122b)
- notes/kaggle_time_series (497b)
- notes/linear_combination (39b)
- notes/linear_operators (66b)
- notes/linear_transformation (1,142b)
- notes/linearly_dependent (120b)
- notes/linearly_independent (67b)
- notes/linkers (422b)
- notes/llmprojects (687b)
- notes/logit (38b)
- notes/logseq (452b)
- notes/loop (152b)
- notes/loss_function (118b)
- notes/mathpy (213b)
- notes/matrix (114b)
- notes/matrix_multiplication (185b)
- notes/maximal_clique (108b)
- notes/maximal_weight_spanning_tree (277b)
- notes/memcached (1,108b)
- notes/micrograd (540b)
- notes/ml_debugging (773b)
- notes/ml_ops (2,100b)
- notes/mml-book (79b)
- notes/moore-penrose_pseudo-inverse (156b)
- notes/most_important (1,347b)
- notes/multiply_connected_graph (110b)
- notes/neighour (119b)
- notes/neural_nets (175b)
- notes/new_york_coffee_shops (1,192b)
- notes/nim (315b)
- notes/nix (84b)
- notes/nll (243b)
- notes/nonsquare_matrix (90b)
- notes/notebooks_ideal_experience (577b)
- notes/null_space (127b)
- notes/nvc (379b)
- notes/okrs (1,337b)
- notes/ooda_loops (1,355b)
- notes/pandora (12,161b)
- notes/parallel_programming (297b)
- notes/parallel_programming_lesson_3 (2,019b)
- notes/parallel_programming_lesson_4 (3,149b)
- notes/parallel_reduce (218b)
- notes/parametrized_models (409b)
- notes/path (96b)
- notes/pattern_recognition_&_machine_learning (221b)
- notes/perfetto (675b)
- notes/photographs (1,965b)
- notes/photographs_greg_williams (1,945b)
- notes/picolisp (345b)
- notes/pivot (121b)
- notes/positive_intelligence (1,358b)
- notes/power (179b)
- notes/probablistic_machine_learning (406b)
- notes/procrastination (303b)
- notes/python (988b)
- notes/pytorch (437b)
- notes/pytorch_tensorboard (114b)
- notes/pytorch_torchscript (1,637b)
- notes/pytorch_torchx (88b)
- notes/qualcomm (489b)
- notes/rank (241b)
- notes/rationaltherapy (15,757b)
- notes/repls (2,956b)
- notes/responsive_web (516b)
- notes/rlhf (1,493b)
- notes/rooflines (93b)
- notes/row_echelon_form (288b)
- notes/schrock (2,156b)
- notes/scrapbook_craftsmanship_in_developer_tools (825b)
- notes/segmenttree (120b)
- notes/selfawareness (3,946b)
- notes/shear (93b)
- notes/singly_connected_graph (100b)
- notes/singular_value_decomposition_(svd) (394b)
- notes/slipbox (2,000b)
- notes/smalltalk (2,427b)
- notes/softmax (512b)
- notes/software_design (1,014b)
- notes/span (241b)
- notes/spanning_tree (164b)
- notes/speed (280b)
- notes/ssh_tunnels (444b)
- notes/stats (1,419b)
- notes/stochastic_gradient_descent (948b)
- notes/strang_mit_ocw (97b)
- notes/tagtime (252b)
- notes/tech_talks_ideas (1,268b)
- notes/tech_talks_ideas_panopticon (377b)
- notes/to_explore (119b)
- notes/tools_for_thought (1,775b)
- notes/torch (836b)
- notes/transducers (1,017b)
- notes/transformers (620b)
- notes/ubuntu_power_management (793b)
- notes/vector (500b)
- notes/vector_space (490b)
- notes/vector_subspace (315b)
- notes/work_efficient (95b)
- notes/writing (3,914b)
- notes/writing_approaches (180b)
- notes/writing_common_errors (266b)
- notes/writing_insights (291b)
- notes/writing_mechanics (2,171b)
- notes/writing_outbox (368b)
- notes/gpumode/001_profilecuda (796b)
- notes/gpumode/002_bookch (152b)
- notes/gpumode/004_bookch (45b)
- notes/gpumode/012_flashattn (2,751b)
- notes/gpumode/017_nccl (1,748b)
- notes/gpumode/041_flashinfer (1,819b)
- notes/gpumode/067_ncclnvshmem (4,261b)
- notes/gpumode/068_gpulandscape (865b)
- notes/letters/2023-10-22 (5,992b)
- notes/letters/2023-10-29 (4,125b)
- notes/letters/2023-11-05 (2,804b)
- notes/letters/2023-11-12 (4,285b)
- notes/letters/2023-11-19 (4,856b)
- notes/letters/2023-11-26 (4,660b)
- notes/letters/2023-12-03 (7,191b)
- notes/letters/2023-12-10 (12,088b)
- notes/letters/2023-12-17 (1,390b)
- notes/letters/2023-12-24 (3,644b)
- notes/letters/2023-12-31 (1,276b)
- notes/letters/2024-01-07 (3,440b)
- notes/letters/2024-01-14 (4,225b)
- notes/letters/2024-01-21 (3,897b)
- notes/letters/2024-01-28 (2,263b)
- notes/letters/2024-02-04 (3,856b)
- notes/letters/2024-02-11 (1,327b)
- notes/letters/2024-02-18 (3,888b)
- notes/letters/2024-02-25 (1,836b)
- notes/letters/2024-03-03 (1,548b)
- notes/letters/2024-03-10 (1,843b)
- notes/letters/2024-03-17 (9,386b)
- notes/letters/2024-03-24 (2,751b)
- notes/letters/2024-03-31 (2,461b)
- notes/letters/2024-04-07 (4,661b)
- notes/letters/2024-04-14 (4,290b)
- notes/letters/2024-04-21 (5,196b)
- notes/letters/2024-04-28 (2,385b)
- notes/letters/2024-05-05 (8,363b)
- notes/letters/2024-05-12 (3,411b)
- notes/letters/2024-05-19 (5,557b)
- notes/letters/2024-05-26 (4,105b)
- notes/letters/2024-06-02 (4,084b)
- notes/letters/2024-06-23 (3,747b)
- notes/letters/2024-06-30 (3,514b)
- notes/letters/2024-07-07 (3,824b)
- notes/letters/2024-07-14 (2,793b)
- notes/letters/2024-09-01 (3,248b)
- notes/ml/factorization_machines (817b)
- notes/ml/flops (345b)
- notes/ml/fp8 (754b)
- notes/ml/parallelism (1,519b)
- notes/ml/te (335b)
- notes/ml/torch_dispatch (924b)
- notes/pm/prd (170b)
- notes/python/descriptors (780b)
- notes/python/hosting (622b)
- notes/python/hy (1,137b)
- notes/python/metaclass (412b)
- notes/python/repeated (212b)
- notes/python/rpc (742b)
- notes/python/setuptools (608b)
- notes/python/typing_cheatsheet (62b)
- notes/python/unit_tests_cheatsheet (709b)
- notes/strangeloop/2023/alex (1,778b)
- notes/strangeloop/2023/concatenative_pls (449b)
- notes/strangeloop/2023/experimentation (897b)
- notes/strangeloop/2023/geometric_algebra (744b)
- notes/strangeloop/2023/healthy_open_source (575b)
- notes/strangeloop/2023/making_hard_things_easy (1,560b)
- notes/strangeloop/2023/meaningful_career (1,084b)
- notes/strangeloop/2023/playing_with_engineering (669b)
- notes/strangeloop/2023/programming_and_go (1,102b)
- notes/strangeloop/2023/simulation_testing (2,587b)
- notes/strangeloop/2023/strange_llms (2,189b)
- notes/strangeloop/2023/systems (903b)
- notes/strangeloop/2023/tuning_threads (458b)
- notes/strangeloop/2023/war_time_proofs (1,017b)
- notes/strangeloop/2023/xkcd (763b)
- notes/transformers/attention (38b)
- notes/transformers/index (1,421b)
- notes/transformers/kqv (19b)
- notes/transformers/llama2 (1,698b)
- notes/transformers/log (435b)
- notes/transformers/nanogpt (7,545b)
- notes/transformers/thinkinglike (1,921b)
— Kunal