stochastic-approximation 2 Asymptotic Analysis of Q-Learning: A Complete Proof-Oriented Guide Aug 8, 2026 Why TD Learning Likes the 2-Norm: Mean Directions, Inner Products, and Bellman Geometry Jun 13, 2026