CV2
Education
- work in progress
Texas A&M University
Doctor of Philosophy in Computer Engineering
College Station, TX, Aug 2021 - Est. 2025
Thesis: Hardware Efficient ML System Design in Knowledge Retrieval
University of Texas Arlington
Bachelor of Science in Electrical Engineering with Honors
Arlington, TX, Aug 2017 - May 2021
Honors Thesis: A novel remote sensing system for in-situ measurement of subsurface soil properties
Publications
- Shrestha, S., Annapareddy, N., & Li, Z. (2024). ESPN: Memory Efficient Multi-Vector Information Retrieval.
Honors
- Cambridge Learners Award 2015
- Academic Excellence Award 2016
- Dean’s List 2018-21
- Innovation Day Award 2021
Work Experience
Texas A&M University
Graduate Research Assistant
College Station, TX, Aug 2021 - Est. 2025
- Led efforts to develop more efficient systems for deep learning applications; Neural Information Retrieval (IR).
- Trained a BERT based model for IR using pytorch and knowledge distillation with Recall@1K of 96%.
- Developed a novel embedding processing system with Nvidia GDS & custom CUDA kernels achieving 23% speedup.
- Designed a flexible software prefetcher for Neural IR systems achieving hit rates exceeding 90%, allowing embeddings to be retrieved from storage with near memory latency with 16x less memory footprint.
Samsung Semiconductor Inc.
Machine Learning Systems Research
San Jose, CA, May 2022 - Aug 2022
- Developed a novel IR embedding retrieval and processing architecture, leveraging SmartSSD with custom similarity computation kernels (FPGA) to offload similarity processing close to storage.
- Reduced CPU workload by 4x, reduced memory usage by 82% without degrading retrieval quality of the IR model.
- Accelerated neural inference by 64% by compressing the model with knowledge distillation, pruning and quantization.
- Delivered 2 patents applications for efficient Neural Information Retrieval system design during the internship.
University of Texas Arlington
Undergraduate Research and Teaching Assistant
Arlington, TX, Aug 2019 - May 2021
- Developed signal processing algorithms to measure dynamic soil properties using a Radar system, simulated, designed, and fabricated electromagnetic sensors.
- Teaching assistant for EE2347, Mathematical Foundation of Electrical Engineering. Responsibilities: instructor for lab; taught sophomores algorithms and introduction to python, graded assignments.
- Teaching assistant for EE3407, Fundamentals of Electromagnetics. Responsibilites: conducted study sessions and exam reviews. Assisted in redesigning lab experiments with integration of new simulation tools like Ansys HFSS.
Academic Tutor, Supplimental Instructor and Mentor
Arlington, TX, Aug 2018 - May 2021
- 1 on 1 tutoring for UTSI. Academic tutor for Calculus I & II, Physcis I & II, Chemistry.
- Supplimental Instructor (SI Leader) for UTSI. SI leader for Calculus III, Differential Equation & Linear Algebra. Responsibilites: conducted biweekly study sessions, helped students learn course material and exam reviews.
- Supplimental Instructor Mentor for UTSI. Responsibilities: Managed and mentored 5-6 SI leaders per semester. Conducted training for SI leaders, hosted weekly mentoring sessions.
Skills
Relevant Coursework: Advance Computer Architecture, Parallel Computing, Distributed Processing, Deep Learning,Machine Learning, NLP, Information Retrieval, Memory & Storage Systems, Operating Systems, Advanced Algorithms.
Technical: C/C++, Python, Java, CUDA, MATLAB, OpenCL, OpenMP, Pthreads, MPI, Pytorch, Scikit-learn, gRPC, Hadoop, Azure, AWS, Spark, Verilog, VHDL, Vitis/Vivado HLS, Object Oriented Programming (OOP), GIT, Linux.