Mambular: A Sequential Model for Tabular Deep Learning
https://github.com/basf/mamba-tabular
https://arxiv.org/pdf/2408.06291
Abstract
The analysis of tabular data has traditionally been dominated by gradient-boosted decision trees (GBDTs), known for their proficiency with mixed categorical and numerical features. However, recent deep learning innovations are challenging this dominance. We introduce Mambular, an adaptation of the Mamba architecture optimized for tabular data. We extensively benchmark Mambular against state-of-the-art models, including neural networks and tree-based meth