{
  "id": 5540342,
  "title": "Presentation: From S3 to GPU in One Copy: Rethinking Data Loading for ML Training",
  "url": "https://urgent.news/2026/09/04/presentation-from-s3-to-gpu-in-one-copy-rethinking-data-loading-for",
  "topic": "tech",
  "section": "Tech",
  "published": "2026-09-04T11:00:00.000Z",
  "source": {
    "name": "InfoQ",
    "slug": "infoq",
    "url": "https://www.infoq.com/presentations/vortex-columnar-file-format-gpu-streaming/"
  },
  "original_language": "en",
  "account": "Onur Satici, a Staff Engineer at SpiralDB and a core maintainer of Vortex, an open-source columnar file format now part of the Linux Foundation, presents his work on high-throughput data loading. He explains how Vortex revolutionizes the process, eliminating bottlenecks and streaming data directly to GPUs at speeds up to 60 Gbps without the need for upfront data reprocessing. Vortex achieves this by utilizing cascading lightweight encodings, layout-based segment pruning, and zero-copy memory pipelines.\n\nHe emphasizes the importance of GPU acceleration and optimizing data loading for ML training. Satici demonstrates how Vortex can process a 4K video, with data flowing from S3, through the network card, over the CPU, and to the GPU at around 13 gigabits per second. He showcases a visualization of this data flow and explains how selecting only one column in the projection expression keeps the same bandwidth and maintains the video quality.\n\nSatici discusses the two main taxes associated with GPU utilization: movement tax and decision tax. Movement tax refers to the time and resources spent moving data from the source to the GPU, primarily due to CPU decompression and NVMe throughput limitations. Decision tax arises when iterating on the training workload, requiring reprocessing of the entire dataset, which is time-consuming and inefficient.\n\nSatici concludes by highlighting the potential of Vortex to streamline high-throughput data loading, making GPUs more accessible and efficient for ML training.",
  "summary": "Onur Satici explains how Vortex, an open-source columnar file format under the Linux Foundation, revolutionizes high-throughput data loading. He details how cascading lightweight encodings, layout-based segment pruning, and zero-copy memory pipelines eliminate CPU/NVMe bottlenecks to stream S3 data straight to GPUs at speeds up to 60 Gbps without requiring upfront data reprocessing. By Onur Satici",
  "key_points": [],
  "editors_take": null,
  "illustration": null,
  "coverage": {
    "outlets": 1,
    "also_reported_by": []
  },
  "ai_generated": true,
  "disclaimer": "Summaries, key points and the editor’s take are written by software from other outlets’ reporting and may contain errors — always check the linked original."
}