[short] HiRE: High Recall Approximate Top-k Estimation for Efficient LLM Inference

Arxiv Papers - [short] HiRE: High Recall Approximate Top-k Estimation for Efficient LLM Inference