.

Kolmogorov Arnold Network


Reading time: less than 1 minute

Commonly called a KAN. A KAN is a Neural network where you learn the activation functions instead of the weights.

For now they’ve turned out to be not very useful.

KAN vs MLP

It turns out, that you can write Kolmogorov-Arnold Network as an MLP, with some repeats and shift before ReLU.

  • https://colab.research.google.com/drive/1v3AHz5J3gk-vu4biESubJdOsUheycJNz
    • https://archive.md/Wg8P7
  • https://www.reddit.com/r/MachineLearning/comments/1clcu5i/d_kolmogorovarnold_network_is_just_an_mlp/

Link dump

  • Paper: https://arxiv.org/abs/2404.19756
  • https://cprimozic.net/blog/trying-out-kans/
  • https://github.com/Ameobea/kan/blob/main/tiny_kan.py
  • https://github.com/KindXiaoming/pykan
  • https://github.com/Blealtan/efficient-kan

Citation

If you find this work useful, please cite it as:
@article{yaltirakli,
  title   = "Kolmogorov Arnold Network",
  author  = "Yaltirakli, Gokberk",
  journal = "gkbrk.com",
  year    = "2025",
  url     = "https://www.gkbrk.com/kolmogorov-arnold-network"
}
Not using BibTeX? Click here for more citation styles.
IEEE Citation
Gokberk Yaltirakli, "Kolmogorov Arnold Network", October, 2025. [Online]. Available: https://www.gkbrk.com/kolmogorov-arnold-network. [Accessed Oct. 30, 2025].
APA Style
Yaltirakli, G. (2025, October 30). Kolmogorov Arnold Network. https://www.gkbrk.com/kolmogorov-arnold-network
Bluebook Style
Gokberk Yaltirakli, Kolmogorov Arnold Network, GKBRK.COM (Oct. 30, 2025), https://www.gkbrk.com/kolmogorov-arnold-network

Comments

© 2025 Gokberk Yaltirakli