KIOXIA updates software with new vector search library

This new open-source release introduces flexible controls enabling system architects to define the balance point between search performance and the number of vectors, which are opposing factors in the fixed capacity of SSD storage in the system. The resulting benefit allows architects of RAG systems to fine tune the optimal balance of specific workloads and their requirements, without any hardware modifications.

First introduced in January 2025, KIOXIA AiSAQ software uses a novel approximate nearest neighbor search (ANNS) algorithm that is optimised for SSDs and eliminates the need to store index data in DRAM. By enabling vector searches directly on SSDs and reducing host memory requirements, KIOXIA AiSAQ technology allows vector databases to scale, largely without the restrictions caused by limited DRAM capacity.

When the installed capacity of the SSD in the system is fixed, increasing search performance (queries per second) requires more SSD capacity consumed per vector. This results in a smaller number of vectors. Conversely, to maximise the number of vectors, SSD capacity consumption per vector needs to be reduced, which results in lower performance. The optimal balance between these two opposing conditions varies depending on the specific workload. To find the appropriate balance, KIOXIA AiSAQ software introduces flexible configuration options. This latest update allows administrators to select the optimal balance for a variety of contrasting workloads among the RAG system. This update makes KIOXIA AiSAQ technology a suitable SSD-based ANNS for not only RAG applications but also other vector-hungry applications such as offline semantic searches.

With growing demand for scalable AI services, SSDs offer a practical alternative to DRAM for managing the high throughput and low latency that RAG systems require. KIOXIA AiSAQ software makes it possible to meet these demands efficiently, enabling large-scale generative AI without being constrained by limited memory resources.

By releasing KIOXIA AiSAQ software as open-source, KIOXIA strengthens its commitment to the AI community with the promotion of SSD-centric architectures for scalable AI.

"We are always looking to help developers and system architects to fine-tune performance and capacity in innovative new ways," said Axel Störmann, Vice President and Chief Technology Officer for Memory and SSD products, KIOXIA Europe. "Now, with the introduction of the latest version of KIOXIA AiSAQ software, end users can depend on the power of SSDs to build scalable RAG systems flexibly and efficiently. By open-sourcing our technology, we are reaffirming our unwavering commitment to the AI community and giving them solutions that are both powerful and accessible."