Goyalayus

Blog

Machine Learning

Jun 14, 2026Reinforcement Learning — A structured fundamentals note on Bellman equations, TD learning, Q-learning, DQN, policy gradients, PPO, RLHF, and GRPO.
Jun 14, 2026leanings from my first RL training run or maybe runs — A faithful Notion import of my first RL training run notes: SFT, Unsloth, Wordle RL, reward hacking, GRPO, evals, and lessons learned.
Dec 10, 2025Inference — Notes on inference-time optimization, distillation, quantization, and serving tradeoffs.
Dec 9, 2025BROADCASTING — A rigorous guide to tensor broadcasting, strides, expand, repeat, and PyTorch shape semantics.
Dec 8, 2025MY COMPLETE NOTES ON DISTRIBUTED TRAINING — Notes on tensor, data, and pipeline parallelism for training large models.
Dec 7, 2025COMPUTING GRADIENTS FOR THE SAKE OF IT — A worked intuition for computing gradients and why backprop is efficient.
Nov 16, 2025Mathematics behind Exploding and Vanishing Gradients — Why gradients explode or vanish in deep networks and recurrent models.
Aug 29, 2025Ensuring A Stable Pre-Train — Training stability notes for large models: data, optimization, and failure modes.
Aug 29, 2025You See Neural Nets Wrong — A matrix-first way to understand neural networks, forward passes, and backpropagation.
Aug 19, 2025How Multi-Model LLM's Work — How multimodal LLMs connect text, image, audio, and video representations.
Aug 19, 2025How LLM Tokenizers Work — A practical explanation of byte-pair encoding and why tokens are not words.
Aug 19, 2025How KV Caching Works in Attention — Why KV caching makes autoregressive decoding faster.
Aug 19, 2025Tell Me How You Work, GPT — A concise developer mental model for how GPT-style models work.
Aug 3, 2025The Counter-Intuitive Path to Machine Learning — A practical route into machine learning that starts with building real things.
Jul 18, 2025Netflix's Big Bet — One model to rule recommendations

Systems

Dec 7, 2025Block Matrix Multiplication — A deeper guide to block matrix multiplication: formulas, cache locality, GPU tiling, and a worked example.
Nov 29, 2025CUDA Kernels Zero to One — learn basics of gpu programming and writing custom cuda kernels
Oct 13, 2025Everyone is rewriting their C++ code into Rust. Why? No, It's Not Performance — Why teams move systems code to Rust for safety, tooling, and maintainability.
Sep 24, 2025the hitchhiker’s guide to working with Audio Data — A practical tour of audio data, spectrograms, and ML preprocessing.
Sep 24, 2025the hitchhiker’s guide to golang concurrency — A practical guide to goroutines, channels, and concurrency patterns in Go.
Sep 22, 2025Thread Synchronization in C — Mutexes, semaphores, and the synchronization primitives that keep C threads sane.

Blockchain

Aug 19, 2025How are Stable Coins Stable — The core algorithm behind Stable Coins easily explained
Aug 18, 2025so you want some ethereum — All about how Decentralized Exchanges really work
Aug 18, 2025NFT's are Okayish — all about non-fungible tokens
Aug 18, 2025why so many coins — Fungible Tokens and ERC - 20
Aug 18, 2025Layer 2 Network Internals On Blockchain — The incomplete solution to scale Blockchain
Aug 16, 2025How Ethereum Really Works — Ethereum internals from accounts and gas to consensus and execution.
Aug 15, 2025Blockchain Internals for Developers — worlds best blog for not-so-technical folks

Startups

Aug 20, 2025So, You Want To Make A Dating App... — Our efforts for an app, which apparently never made it to the 'peepl'
Aug 19, 2025How B2C Will Play Out After LLMS — How consumer products and distribution change when LLMs become the interface.
Aug 19, 2025Paras Chopra Saved My Failed Startup — My notes from paras Chopra's Mental Models
Aug 19, 2025Distribution for PMF — Distribution is part of product-market fit, not an afterthought.
Aug 19, 20252 Startups — Why startup advice often sounds contradictory, and how to know which advice applies.

Life

Jul 16, 2025Why death and taxes will soon be obsolete. — A speculative note on biotech, longevity, and changing assumptions about death.