TrackEverything: Long Horizon Dense Tracking via De-Duplicating 3D Scene Representations
Existing point tracking models face a fundamental tradeoff: they can either track a sparse set of query points over long horizons, or track all points across only short clips. We introduce TrackEverything, a 3D point tracker that breaks this trade-off by representing videos as persistent 3D scene tracks in world coordinates. Grounded in the insight that videos are 2D projections of an underlying…
We haven't written up this one. arXiv cs.AI has the full story — the link below goes straight to it.