PROJECTS / FROM QUESTION TO EVIDENCE

Research is more than a paper title.

These case studies connect the problem, technical idea, contribution, result, and artifact behind each research thread.

Research lens
2026 Public preprint & code First author

ERA: logit-preserving visual token pruning

Preserve visual evidence—even after aggressively shortening the sequence.

DLUT · NTU S-Lab · OPPO Research Institute · PolyU

~5%tokens retained in extreme settings
5 familiesrepresentative MLLM families
vLLMserving-level verification
Explore the case study
Research problem

Training-free token pruning accelerates MLLMs, but replacing many visual tokens with a few representatives systematically suppresses accumulated visual attention.

Why it matters

Pruning is only useful when the reduced sequence preserves both the content and attention distribution of the original visual evidence.

Approach

Dual-view entropy pruning finds diverse, head-salient anchors; bias-aware token recycling records pruned evidence; logit-preserving rectification restores the missing attention mass.

Contribution

Identifies Attention Logit Collapse, gives it a principled treatment, and validates the approach across single-image, multi-image, video, multiple MLLM architectures, and a vLLM serving environment.

2025–now Research in progress Research & deployment

Training-free acceleration for on-device GUI agents

Remove redundant multimodal computation before it becomes device latency.

OPPO Y-Lab collaboration

2.5×faster time-to-first-token
30 msfirst-token latency in deployment
300 MBoptimized model package
Explore the case study
Research problem

High-resolution GUI observations generate substantial visual-token redundancy, while mobile devices impose strict latency, memory, and package-size constraints.

Why it matters

An agent that understands an interface but cannot respond within a practical device budget is not yet deployable.

Approach

A training-free large-model pruning strategy for GUI interfaces, paired with system-level optimization for terminal deployment.

Contribution

Connects model-side redundancy reduction with end-to-end deployment constraints, without requiring additional model training.

Selected implementation and evaluation details are described at a high level because this is ongoing collaborative research.

Visual overview for Text-enhanced multimodal object re-identification CVPR 2025 / MULTIMODAL PERCEPTION
2025 Published First author

Text-enhanced multimodal object re-identification

Use language to expose identity cues that visual fusion alone can miss.

3text-enhanced benchmarks
CVPRpeer-reviewed publication
Explore the case study
Research problem

Conventional multimodal ReID systems fuse heterogeneous visual features but underuse text semantics and retain redundant local observations.

Why it matters

Structured text can provide a shared semantic space for objects observed under different spectra and viewpoints.

Approach

IDEA combines an inverted multimodal feature extractor with cooperative deformable aggregation and text-enhanced benchmarks.

Contribution

Introduces semantic guidance from MLLM-generated captions and adaptive local aggregation for robust multimodal retrieval.

Visual overview for Efficient multimodal representation learning AAAI 2025 / EFFICIENT REPRESENTATION
2024–2025 Published First author

Efficient multimodal representation learning

Route, select, and aggregate the information that matters.

3connected methods
CVPR / AAAIresearch venues
Explore the case study
Research problem

Long multimodal sequences contain both modality-specific knowledge and substantial redundancy, making direct fusion brittle and expensive.

Why it matters

Efficiency should come from better information organization, not merely from shrinking the model.

Approach

A connected line of work spanning token selection, decoupled mixture-of-experts, synergistic prompting, and Mamba aggregation.

Contribution

Builds a progression from diverse token discovery to adaptive feature routing and scalable long-sequence interaction.

Visual overview for Multimodal identity under real-world variation RESEARCH PROGRAM / 2023–NOW
2023–now Active Lead & collaborator

Multimodal identity under real-world variation

A research program across spectra, semantics, architectures, and viewpoints.

Explore the case study
Research problem

Identity cues change across RGB, near-infrared, thermal, aerial, and text-enhanced observations.

Why it matters

Reliable retrieval requires both shared semantics and respect for modality-specific evidence.

Approach

Token permutation, diverse token selection, hybrid convolution–Transformer representation, Mamba aggregation, mixture-of-experts, and diffusion priors.

Contribution

A continuous body of work that connects foundational multimodal recognition with emerging vision-language and efficiency questions.

Ongoing Maintained Creator & maintainer

Making fast-moving research easier to enter

Curated maps of multimodal ReID and efficient MLLM research.

Explore the case study
Research problem

Fast-moving research areas are difficult to navigate when methods, datasets, and resources are scattered.

Why it matters

Good research infrastructure begins with a legible map of the field.

Approach

Continuously organized paper lists, datasets, taxonomies, and implementation resources.

Contribution

Two community-facing knowledge bases connecting multimodal perception and efficient multimodal foundation models.

Evidence policy. Links and detailed claims are shown only when the corresponding material is public. Ongoing collaborative work is intentionally described at a higher level.