When starting this blog, I thought I would be writing a bit more than I am doing right now. What happened? One reason is that it’s not as rewarding as I initially thought. For instance, I used to t...

One of the most famous examples for introducing Lagrangian mechanics is deriving the dynamics of a pendulum. I was never taught d’Alembert’s principle, which is a crucial part of the derivation. T...

In this post, I summarize Ilya Sutskever’s talk titled “An Observation on Generalization.” The talk is about a general theory of unsupervised learning, based on algorithmic information theory (AIT)...