Page Not Found
Page not found. Your pixels are in another canvas.
Sitemap
A list of all the posts and pages found on the site. For you robots out there is an XML version available for digesting as well.
Pages
Hello, I'm Susav.
About me
Posts
projects
1
Short description of portfolio item number 1
2
Short description of portfolio item number 2
publications
ESPN: Memory Efficient Multi-Vector Information Retrieval
Published in , 2023
We introduce Embedding from Storage Pipelined Network (ESPN) where we offload the entire re-ranking embedding tables to SSDs and reduce the memory requirements by 5-16x. We design a software prefetcher with hit rates exceeding 90%, improving SSD based retrieval up to 6.4x, and demonstrate that we can maintain near memory levels of query latency even for large query batch sizes.
Download here