CV
Education
Texas A&M Unviersity
Doctor of Philosophy in Computer Engineering
College Station, TX, Aug 2021 - Est. 2025
Thesis: Hardware Efficient ML System Design in Knowledge Retrieval
University of Texas Arlington
Bachelor of Science in Electrical Engineering with Honors
Minor in Computer Science
Arlington, TX, Aug 2017 - May 2021
Honors Thesis: A novel remote sensing system for in-situ measurement of subsurface soil properties
Publications
- Shrestha, S., Annapareddy, N., & Li, Z. (2024). ESPN: Memory Efficient Multi-Vector Information Retrieval.
Honors
- Cambridge Learners Award 2015
- Academic Excellence Award 2016
- Dean’s List 2018-21
- Innovation Day Award 2021
Work Experience
Texas A&M University
Graduate Research Assistant
College Station, TX, Aug 2021 - Est. 2025
- Led efforts to develop more efficient systems for deep learning applications; Neural Information Retrieval (IR).
- Trained a BERT based model for IR using pytorch and knowledge distillation with Recall@1K of 96%.
- Developed a novel embedding processing system with Nvidia GDS & custom CUDA kernels achieving 23% speedup.
- Designed a flexible software prefetcher for Neural IR systems achieving hit rates exceeding 90%, allowing embeddings to be retrieved from storage with near memory latency with 16x less memory footprint.
Samsung Semiconductor Inc.
Machine Learning Systems Research
San Jose, CA, May 2022 - Aug 2022
- Developed a novel IR embedding retrieval and processing architecture, leveraging SmartSSD with custom similarity computation kernels (FPGA) to offload similarity processing close to storage.
- Reduced CPU workload by 4x, reduced memory usage by 82% without degrading retrieval quality of the IR model.
- Accelerated neural inference by 64% by compressing the model with knowledge distillation, pruning and quantization.
- Delivered 2 patents applications for efficient Neural Information Retrieval system design during the internship.
University of Texas Arlington
Undergraduate Research and Teaching Assistant
Arlington, TX, Aug 2019 - May 2021
- Developed signal processing algorithms to measure dynamic soil properties using a Radar system, simulated, designed, and fabricated electromagnetic sensors.
- Teaching assistant for EE2347, Mathematical Foundation of Electrical Engineering. Responsibilities: instructor for lab; taught sophomores algorithms and introduction to python, graded assignments.
- Teaching assistant for EE3407, Fundamentals of Electromagnetics. Responsibilites: conducted study sessions and exam reviews. Assisted in redesigning lab experiments with integration of new simulation tools like Ansys HFSS.
University of Texas Arlington
Academic Tutor, Supplimental Instructor and Mentor
Arlington, TX, Aug 2018 - May 2021
- 1 on 1 tutoring for UTSI. Academic tutor for Calculus I & II, Physcis I & II, Chemistry.
- Supplimental Instructor (SI Leader) for UTSI. SI leader for Calculus III, Differential Equation & Linear Algebra. Responsibilites: conducted biweekly study sessions, helped students learn course material and exam reviews.
- Supplimental Instructor Mentor for UTSI. Responsibilities: Managed and mentored 5-6 SI leaders per semester. Conducted training for SI leaders, hosted weekly mentoring sessions.
Skills
Relevant Coursework: Advance Computer Architecture, Parallel Computing, Distributed Processing, Deep Learning,Machine Learning, NLP, Information Retrieval, Memory & Storage Systems, Operating Systems, Advanced Algorithms.
Technical: C/C++, Python, Java, CUDA, MATLAB, OpenCL, OpenMP, Pthreads, MPI, Pytorch, Scikit-learn, gRPC, Hadoop, Azure, AWS, Spark, Verilog, VHDL, Vitis/Vivado HLS, Object Oriented Programming (OOP), GIT, Linux.