nonlinearity, why it makes sense to think big
Thinking big has been vastly talked about from the "attitude" perspective. However, what fascinates me are some physical observations that show it actually makes sense to have big…
A notebook
Intuitions behind
the world.
Essays, notes, and experiments on machine learning, AI, and the non-linear nature of things — by Hamidreza Saghir.
Featured
All posts →Recent writing
Archive →
The pyramid principle for writing clearly
Barbara Minto's pyramid: put the answer at the top, let the reader's questions drive the hierarchy, and choose deduction or induction at each branch.
machine learning ·unified views
Similarity is (almost) all you need
From spectral clustering to Gaussian processes to transformer attention — the same primitive, a similarity matrix between points, keeps showing up as the load-bearing piece of very different models.
A unified view of graph traversal: BFS, Dijkstra, A\* are the same algorithm
BFS, Dijkstra, and A* differ by one line: the data structure you pop the next node from. A worked maze example that converts each into the next.
The many incarnations of computational graphs, linearization, and dynamic programming
Backpropagation, belief propagation, the Viterbi algorithm, and matrix-chain multiplication all solve the same problem: summing over exponentially many paths in a graph by reusing work.
An intuitive understanding of variational autoencoders without any formula
I love the simplicity of autoencoders as a very intuitive unsupervised learning method. They are in the simplest case, a three layer neural network. In the first layer the data…
An introduction to Neural Networks without any formula
What is a neural network? To get started, it's beneficial to keep in mind that modern neural network started as an attempt to model the way that brain performs computations. We…
How to work with Jupyter Notebook on a remote machine (Linux)
I typically use my computers at home to connect to my work computer. I setup xRDP to remote desktop into my work computer(Linux) which is OK but slow at times depending on the…