Nicolas Loizou on Twitter: "Characteristics of SPS: No hyper-parameter tuning, particularly effective when training over-parameterized models, cheap per-iteration cost. It comes with convergence guarantees for convex and non-convex problems. https://t ...