Attention with Markov: A framework for principled analysis of transformers via Markov chains AV Makkuva, M Bondaschi, A Girish, A Nagle, M Jaggi, H Kim, M Gastpar arXiv preprint arXiv:2402.04161, 2024 | 31 | 2024 |
Automatic classification of mice vocalizations using Machine Learning techniques and Convolutional Neural Networks M Premoli, D Baggi, M Bianchetti, A Gnutti, M Bondaschi, A Mastinu, ... PloS one 16 (1), e0244636, 2021 | 26 | 2021 |
Transformers on markov data: Constant depth suffices N Rajaraman, M Bondaschi, K Ramchandran, M Gastpar, AV Makkuva NeurIPS 2024, 2024 | 8 | 2024 |
Mismatched decoding reliability function at zero rate M Bondaschi, AG i Fàbregas, M Dalai IEEE Transactions on Information Theory 68 (3), 1482-1495, 2021 | 7* | 2021 |
Local to Global: Learning Dynamics and Effect of Initialization for Transformers AV Makkuva, M Bondaschi, C Ekbote, A Girish, A Nagle, H Kim, ... NeurIPS 2024, 2024 | 6 | 2024 |
Laser: Linear compression in wireless distributed optimization AV Makkuva, M Bondaschi, T Vogels, M Jaggi, H Kim, MC Gastpar ICML 2024, 2023 | 6 | 2023 |
A revisitation of low-rate bounds on the reliability function of discrete memoryless channels for list decoding M Bondaschi, M Dalai IEEE Transactions on Information Theory 68 (5), 2829-2838, 2022 | 6* | 2022 |
Batch Universal Prediction M Bondaschi, M Gastpar 2024 IEEE International Symposium on Information Theory (ISIT), 2024 | 4 | 2024 |
Alpha-NML Universal Predictors M Bondaschi, M Gastpar IEEE Transactions on Information Theory 71 (2), 1171-1183, 2025 | 3 | 2025 |
Fundamental limits of prompt compression: A rate-distortion framework for black-box language models A Girish, A Nagle, M Bondaschi, M Gastpar, AV Makkuva, H Kim NeurIPS 2024, 2024 | 2* | 2024 |
From Markov to Laplace: How Mamba In-Context Learns Markov Chains M Bondaschi, N Rajaraman, X Wei, K Ramchandran, R Pascanu, ... arXiv preprint arXiv:2502.10178, 2025 | | 2025 |
Batch Normalization Decomposed I Nachum, M Bondaschi, M Gastpar, A Khina arXiv preprint arXiv:2412.02843, 2024 | | 2024 |