---
title: Topological properties of basins of attraction and expressiveness of width bounded neural networks
url: https://www.ml-quant.com/papers/arxiv/2011.04923/
site: ML-Quant (https://www.ml-quant.com)
updated: 2026-09-26
license: Summaries CC BY 4.0; links go to the original sources
index: https://www.ml-quant.com/llms.txt
identifier: arXiv:2011.04923
source_url: https://arxiv.org/abs/2011.04923v1
featured: 2023-11-29
citations: 0
topic: ML & AI Methods
---


# Topological properties of basins of attraction and expressiveness of width bounded neural networks

A study has shown that autoencoders trained with standard SGD methods create bounded basins of attraction around their training data, answering a previous question and providing insight into why certain neural network functions are not dense in continuous function spaces.

- Source: https://arxiv.org/abs/2011.04923v1
- Identifier: arXiv:2011.04923
- Released: 2020-11-10
- First featured: Quant Letter No. 27 (2023-11-29): https://www.ml-quant.com/issues/2023-11-29/
- Citations (Semantic Scholar): 0
- Published in: not yet
- Topic: ML & AI Methods

## Related

- [Mamba: Linear-Time Sequence Modeling with Selective State Spaces](https://www.ml-quant.com/papers/arxiv/2312.00752/): Sequence Modeling: Mamba, a neural network architecture that doesn't use attention or MLP blocks, provides faster inference and better performance in language, audio, and genomics than Transformers.
- [Graph Mamba: Towards Learning on Graphs with State Space Models](https://www.ml-quant.com/papers/arxiv/2402.08678/): Graph Mamba Networks, a new type of Graph Neural Networks, have been introduced, which achieve excellent performance in various benchmark datasets despite lower computational cost.
- [Edge Directionality Improves Learning on Heterophilic Graphs](https://www.ml-quant.com/papers/arxiv/2305.10498/): The study presents Directed Graph Neural Network (Dir-GNN), a new deep learning framework for directed graphs that surpasses traditional models in heterophilic benchmarks.
- [Tensor Programs VI: Feature Learning in Infinite-Depth Neural Networks](https://www.ml-quant.com/papers/arxiv/2310.02244/): Deep Residual Network Feature Learning: The research explores depthwise parametrizations in deep residual networks, pinpointing Depth-$\mu$P as the best parametrization for maximizing feature learning and diversity, but notes its limitations in deeper networks.
- [Modular Duality in Deep Learning](https://www.ml-quant.com/papers/arxiv/2410.21265/): The article presents a new theory of modular dualization for general neural networks, providing a theoretical basis for fast and scalable training algorithms, potentially leading to a new generation of optimizers for neural architectures.
- [Historical calibration of SVJD models with deep learning](https://www.ml-quant.com/papers/ssrn/4650097/): The paper suggests using deep neural networks to calibrate parameters of Stochastic Volatility Jump Diffusion models, proving to be more accurate, robust, and faster than other methods.