arXiv.org / 2024

[CLS] Attention is All You Need for Training-Free Visual Token Pruning: Make VLM Inference Faster

Qizhe Zhang, Aosong Cheng, Ming Lu, Zhiyong Zhuo, Minqi Wang, Jiajun Cao, Shaobo Guo, Qi She, Shanghang Zhang

ML SystemsPopular and Landmark Papers

No abstract is available for this paper yet.

85 citations13 influential

Full paper

Read the original paper

A direct open-access PDF is not available in the database yet. Use the source page or learning resources below to open the complete paper from the publisher or index.

Learning resources

Google Scholar referencesGoogle Scholar Papers with Code searchPapers with Code Semantic Scholar paper pageSemantic Scholar YouTube explanationsYouTube

Reading state

Discuss in ChatGPT

Uses your own ChatGPT account. The paper context is copied into a tutor prompt before ChatGPT opens.

Preview prompt

You are my AI/ML research paper instructor. I want to deeply understand the paper below.

First, teach it in layers:
1. One-paragraph intuition.
2. Problem statement and why it mattered.
3. Key method, architecture, or algorithm.
4. Important equations or mechanisms, explained intuitively.
5. Experiments and evidence.
6. Limitations, assumptions, and failure modes.
7. How this paper influenced later AI/ML/Deep Learning/GenAI work.
8. A 30-minute study plan with checkpoints.
9. Quiz me with 5 questions and wait for my answers.

When something is not available in the attached context, say what is missing and infer carefully.

### Paper attached as context
Title: [CLS] Attention is All You Need for Training-Free Visual Token Pruning: Make VLM Inference Faster
Authors: Qizhe Zhang, Aosong Cheng, Ming Lu, Zhiyong Zhuo, Minqi Wang, Jiajun Cao, Shaobo Guo, Qi She, Shanghang Zhang
Year: 2024
Venue: arXiv.org
Categories: ML Systems, Popular and Landmark Papers
Citations: 85
Paper URL: https://www.semanticscholar.org/paper/b02159650df9813f25db4afd4f094e53bccd526c
Open PDF: Not available

Abstract:
No abstract is available in the app metadata.

Learning resources:
- Google Scholar: Google Scholar references (https://scholar.google.com/scholar?q=%5BCLS%5D%20Attention%20is%20All%20You%20Need%20for%20Training-Free%20Visual%20Token%20Pruning%3A%20Make%20VLM%20Inference%20Faster)
- Papers with Code: Papers with Code search (https://paperswithcode.com/search?q=%5BCLS%5D%20Attention%20is%20All%20You%20Need%20for%20Training-Free%20Visual%20Token%20Pruning%3A%20Make%20VLM%20Inference%20Faster)
- Semantic Scholar: Semantic Scholar paper page (https://www.semanticscholar.org/paper/b02159650df9813f25db4afd4f094e53bccd526c)
- YouTube: YouTube explanations (https://www.youtube.com/results?search_query=%5BCLS%5D%20Attention%20is%20All%20You%20Need%20for%20Training-Free%20Visual%20Token%20Pruning%3A%20Make%20VLM%20Inference%20Faster+paper+explained)