Second-Order Smooth Planning with Optimal-Transport Bellman Smoothing
Planning with a generative model aims to estimate the value of a state using as few simulator calls as possible. SmoothCruiser achieves problem-independent complexity $\widetilde O(\varepsilon^{-4})$ by exploiting the smoothness of the entropy-regularized Bellman backup, but its estimator is only first-order. We show that the sample-complexity exponent of SmoothCruiser-type planners is governed…
We haven't written up this one. arXiv cs.AI has the full story — the link below goes straight to it.