Closing the Modality Gap via Simplex-Constrained Representations
While multimodal contrastive models like CLIP and CLAP successfully learn shared representations, their embeddings typically exhibit a persistent \emph{modality gap}. We propose addressing this separation through a purely geometric approach: changing the embedding domain from the unit sphere, $S^{d-1}$, to the probability simplex, $Δ^{d-1}$. Although both manifolds share the same intrinsic…
We haven't written up this one. arXiv cs.AI has the full story — the link below goes straight to it.
