Results 141 to 150 of about 13,981 (216)

A Survey on Visual Mamba

open access: yesApplied Sciences (Switzerland)
State space models (SSM) with selection mechanisms and hardware-aware architectures, namely Mamba, have recently shown significant potential in long-sequence modeling. Since the complexity of transformers’ self-attention mechanism is quadratic with image
Zi Ye, Ziyang Wang, Tianxiang Chen
exaly   +4 more sources

Is Mamba effective for time series forecasting?

Neurocomputing
In the realm of time series forecasting (TSF), it is imperative for models to adeptly discern and distill hidden patterns within historical time series data to forecast future states. Transformer-based models exhibit formidable efficacy in TSF, primarily
Zihan Wang   +6 more
exaly   +2 more sources

Mamba-in-Mamba: Centralized Mamba-Cross-Scan in Tokenized Mamba Model for Hyperspectral image classification

open access: yesNeurocomputing
Hyperspectral image (HSI) classification is pivotal in the remote sensing (RS) field, particularly with the advancement of deep learning techniques. Sequential models, adapted from the natural language processing (NLP) field such as Recurrent Neural Networks (RNNs) and Transformers, have been tailored to this task, offering a unique viewpoint. However,
Man Sing Wong   +2 more
exaly   +3 more sources

Vision Mamba: Efficient Visual Representation Learning with Bidirectional State Space Model

International Conference on Machine Learning
Recently the state space models (SSMs) with efficient hardware-aware designs, i.e., the Mamba deep learning model, have shown great potential for long sequence modeling.
Lianghui Zhu   +5 more
semanticscholar   +1 more source

VM-UNet: Vision Mamba UNet for Medical Image Segmentation

ACM Transactions on Multimedia Computing, Communications, and Applications (TOMCCAP)
In the realm of medical image segmentation, both CNN-based and Transformer-based models have been extensively explored. However, CNNs exhibit limitations in long-range modeling capabilities, whereas Transformers are hampered by their quadratic ...
Jiacheng Ruan   +2 more
semanticscholar   +1 more source

U-Mamba: Enhancing Long-range Dependency for Biomedical Image Segmentation

arXiv.org
Convolutional Neural Networks (CNNs) and Transformers have been the most popular architectures for biomedical image segmentation, but both of them have limited ability to handle long-range dependencies because of inherent locality or computational ...
Jun Ma, Feifei Li, Bo Wang
semanticscholar   +1 more source

MambaVision: A Hybrid Mamba-Transformer Vision Backbone

Computer Vision and Pattern Recognition
We propose a novel hybrid Mamba-Transformer backbone, MambaVision, specifically tailored for vision applications. Our core contribution includes redesigning the Mamba formulation to enhance its capability for efficient modeling of visual features ...
Ali Hatamizadeh, Jan Kautz
semanticscholar   +1 more source

NVIDIA Nemotron Nano 2: An Accurate and Efficient Hybrid Mamba-Transformer Reasoning Model

arXiv.org
We introduce Nemotron-Nano-9B-v2, a hybrid Mamba-Transformer language model designed to increase throughput for reasoning workloads while achieving state-of-the-art accuracy compared to similarly-sized models. Nemotron-Nano-9B-v2 builds on the Nemotron-H
Nvidia Aarti Basant   +209 more
semanticscholar   +1 more source

Home - About - Disclaimer - Privacy