Urgent.News

What's breaking now, across thousands of outlets.

AI

Hitachi Vantara bets smarter storage can close AI’s pilot-to-production gap

Enterprises pushing AI from pilot to production are learning that data, not GPUs, is the hardest part, and open table formats such as Apache Iceberg are part of the answer. Demand for AI infrastructure shows few signs of slowing, but much of the information companies need is still scattered, ungoverned and out of reach. That […] The post Hitachi Vantara bets smarter storage can close AI’s…

Hitachi Vantara bets smarter storage can close AI’s pilot-to-production gap

Enterprises seeking to transition AI from pilot to production are discovering that data, rather than graphics processing units (GPUs), presents the greatest challenge. Open table formats, such as Apache Iceberg, provide a potential solution. While demand for AI infrastructure remains robust, much of the necessary information is still fragmented, unstructured, and difficult to access.

Hitachi Vantara Corp.'s vice president of hybrid cloud and AI infrastructure, Arun Prasad Raman, described storage as an active layer that can classify, govern, and serve data to models, rather than merely storing it. "Storage is not seen as just storing the data," Raman stated. "You need to bring in more intelligence natively rather than moving the data to another replication and bringing it back for indexing."

Raman and Jeff Lundberg, principal product and solutions manager at Hitachi Vantara, discussed this topic with John Furrier and Gemma Allen at SC26. They emphasized that AI's pilot-to-production gap often stems from data being scattered across on-premises systems, SaaS applications, and the cloud, alongside challenges such as access control, governance, and shifting regulations.

Hitachi Vantara is addressing these issues through industry-specific solutions built on its Hitachi iQ stack and the expertise of its rail and energy businesses. "It's about the outcome more so than the technology that we're trying to put into place," Lundberg explained. "That's an enabler to get you to the solution you're trying to get to."

Recently, Hitachi Vantara expanded its VSP One platform with new object storage and data lakehouse capabilities. The object store includes a service that flags files containing personal information, such as Social Security numbers, allowing data scientists to exclude this data from certain models or prevent its replication to other countries.

Raman added, "That's the intelligence we are adding into the storage itself." Similarly, analytics can be performed directly on Apache Iceberg-formatted metadata, such as CT scans, without the need for extract, transform, and load (ETL) processes or separate databases. This enables applications to list every abdominal scan from the past year without additional data manipulation.

Raman noted, "Whether it's a backup or it's 10 years old, it still carries some intelligence. As long as it carries intelligence, it becomes important to AI." The interview was part of SiliconANGLE and theCUBE's coverage of SC26. The segment was sponsored by Hitachi Vantara Corp., and the content remained editorially independent.

Written by urgent.news from SiliconANGLE's reporting — not their text. Machine-written — may contain errors; check the original before relying on it.

Read the original at siliconangle.com →

More in AI

More from Thursday 19 November →