Veraj Paruthi
Engineering
, Glean
About
Veraj Paruthi
Veraj Paruthi is a Software Engineer at Glean. They have been with Glean since 2022 and play a key role in the company’s engineering team. Veraj holds a Bachelor's degree in Computer Engineering from the University of Waterloo and has previously worked with several organizations, including Tophatter and the Royal Canadian Air Force.
Connect with
Veraj Paruthi

Recent posts from
Veraj Paruthi

July 23, 2024
How KV caches impact time to first token for LLMs
For part two of our series on LLM latency, we examined how KV caching impacts time to first token latency and throughput efficiency for calls.

Veraj Paruthi
Engineering
Enterprise Search + GenAI 101
Glean + Product
Industry Insights

July 2, 2024
How input token count impacts the latency of AI chat tools
Ever wonder what the impact of input token count is on the responsiveness of AI chat tools? We did—after some testing, here’s what we discovered regarding the correlation between input counts and time to first token.

Veraj Paruthi
Engineering
Glean + Product
Enterprise Search + GenAI 101