RESEARCH / ONE CONNECTED PROGRAM

Perceive broadly.
Compute deliberately.
Act reliably.

My research begins with a simple systems question: how can multimodal intelligence preserve the right evidence, spend computation where it matters, and remain useful under real-world constraints?

INTERACTIVE RESEARCH MAP

A research system, not a keyword list.

Select a node to trace its questions, methods, papers, and projects.

Research field / interactive map

Multimodal Intelligence

Select a direction or a keyword to inspect its evidence.

3 areas 18 terms 25 works
Perception focus
Efficient MLLMs focus
Agent Systems focus
One connected program
01 Perceive 02 Interpret 03 Compress 04 Act
Heterogeneous evidence becomes efficient, deployable intelligence.
01 Perception RGB · NIR · TIR · Text
02 Efficient models Align · select · compress
03 Agents Reliable agent systems

Established RESEARCH THEME

Multimodal Perception

01

How can heterogeneous sensors describe the same identity across viewpoints, spectra, and environments?

I align RGB, near-infrared, thermal, text, and aerial-ground observations into identity-aware representations that remain dependable in complex scenes.

Methods
  • Cross-modal alignment
  • Modality-specific representation
  • Text-guided fusion
All related papers 22 works
2026 · Journal Multi-Modal Object Re-Identification with Dual Semantic Guidance and Global-Local Mutual Modulation Contributor · IEEE Transactions on Circuits and Systems for Video Technology (TCSVT) 2026 · Conference Incentive Noise and Structural Prior Infusion for Multi-Modal Object Re-Identification Co-first author · European Conference on Computer Vision (ECCV) 2026 · Conference STMI: Segmentation-Guided Token Modulation with Cross-Modal Hypergraph Interaction for Multi-Modal Object Re-Identification Co-corresponding author · AAAI Conference on Artificial Intelligence (AAAI) 2026 · Conference Signal: Selective Interaction and Global-local Alignment for Multi-Modal Object Re-Identification Co-first author · AAAI Conference on Artificial Intelligence (AAAI) 2026 · Journal SD-ReID: View-aware Stable Diffusion for Aerial-Ground Person Re-Identification First author · IEEE Transactions on Image Processing (TIP) 2026 · Journal HFP-SAM: Hierarchical Frequency Prompted SAM for Efficient Marine Animal Segmentation Contributor · IEEE Transactions on Image Processing (TIP) 2026 · Conference CADTrack: Learning Contextual Aggregation with Deformable Alignment for Robust RGBT Tracking Contributor · AAAI Conference on Artificial Intelligence (AAAI) 2026 · Conference RAGTrack: Language-aware RGBT Tracking with Retrieval-Augmented Generation Contributor · IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) 2026 · Workshop SAS-VPReID: A Scale-Adaptive Framework with Shape Priors for Video-based Person Re-Identification at Extreme Far Distances Contributor · WACV Workshop on Video Re-Identification at Extreme Far Distances 2026 · Challenge Report VReID-XFD: Video-based Person Re-identification at Extreme Far Distance Challenge Results Contributor · WACV Workshop on Video Re-Identification at Extreme Far Distances 2025 · Journal Unity Is Strength: Unifying Convolutional and Transformeral Features for Better Person Re-Identification First author · IEEE Transactions on Intelligent Transportation Systems (TITS) 2025 · Conference Sigma: Siamese Mamba Network for Multi-Modal Semantic Segmentation Contributor · IEEE/CVF Winter Conference on Applications of Computer Vision (WACV) 2024 · Conference Magic Tokens: Select Diverse Tokens for Multi-Modal Object Re-Identification Contributor · IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) 2024 · Conference TOP-ReID: Multi-spectral Object Re-Identification with Token Permutation First author · AAAI Conference on Artificial Intelligence (AAAI) 2025 · Challenge Report AG-VPReID 2025: Aerial-Ground Video-based Person Re-identification Challenge Results Contributor · IEEE International Joint Conference on Biometrics (IJCB) 2025 · Conference IDEA: Inverted Text with Cooperative Deformable Aggregation for Multi-Modal Object Re-Identification First author · IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) 2025 · Conference DeMo: Decoupled Feature-Based Mixture of Experts for Multi-Modal Object Re-Identification First author · AAAI Conference on Artificial Intelligence (AAAI) 2025 · Conference MambaPro: Multi-Modal Object Re-Identification with Mamba Aggregation and Synergistic Prompt First author · AAAI Conference on Artificial Intelligence (AAAI) 2025 · Conference CLIMB-ReID: A Hybrid CLIP-Mamba Framework for Person Re-Identification Contributor · AAAI Conference on Artificial Intelligence (AAAI) 2025 · Preprint LATex: Leveraging Attribute-based Text Knowledge for Aerial-Ground Person Re-Identification Contributor · arXiv preprint 2026 · Journal Multi-Modal Object Re-Identification with Prompt-S6 and Semantic-Aware Knowledge Guidance Contributor · IEEE Transactions on Image Processing (TIP)
2025 · Manuscript VMambaX: Exploiting Vision Mamba for Abdominal X-ray Image Based NEC Classification Contributor · Public record pending
View all related works
  • RGB / NIR / TIR
  • Multimodal ReID
  • Cross-modal Retrieval

RESEARCH PHILOSOPHY

Four principles behind the work.

01

Perceive beyond pixels.

Multimodal systems should preserve the evidence unique to each sensor while discovering the semantics they share.

02

Spend compute where it matters.

Efficiency is an information-design problem: select useful tokens, route useful features, and reuse useful memory.

03

Design for the device.

A method is more valuable when latency, memory, and deployment constraints influence the research question from the beginning.

04

Connect perception to action.

The next step is not only to understand multimodal environments, but to help agents make reliable decisions within them.

WHERE I’M GOING

From efficient models to reliable agent systems.

The next research questions build directly on the same through-line: multimodal evidence, efficient computation, and deployment-aware decisions.

1

Current · Now

Efficient multimodal models

Reduce token, feature, and memory redundancy while preserving cross-modal understanding.

  • Token pruning
  • Compression
  • Fast inference
2

Next · Near term

Long-horizon GUI agents

Build agents that perceive interfaces, retain useful visual history, and act under real device budgets.

  • GUI understanding
  • Agent memory
  • Planning
3

Future · Research vision

Cloud–edge multimodal agent systems

Coordinate perception, reasoning, memory, and action across device and cloud for reliable autonomous decision-making.

  • Adaptive compute
  • Cloud–edge collaboration
  • Reliable agents

COLLABORATE

Working on multimodal models, efficient inference, or intelligent interfaces?

Start a conversation