Ayhan Suleymanzade

Hey there!

I am a Visiting Researcher at AITHYRA, supervised by Prof. Ismail Ilkan Ceylan and Prof. Michael Bronstein. I am also an incoming PhD student at EPFL. I completed my Bachelor’s degree in CS/EE at KAIST. I did my exchange at TUM, where I worked with Prof. Stefanie Jegelka.

I am interested in language models. Recently, I have focused on their reasoning capabilities in continuous spaces, including looped and latent transformers and flow language models. In the past, I focused on geometric deep learning, demonstrating the benefits of language models for data-efficient and generalizable approaches to learning symmetries.

Beyond research, I enjoy playing and watching football (soccer). I support Chelsea FC and Beşiktaş JK and rarely miss a match. I also enjoy solving challenging physics problems and teaching others. I lead Team Azerbaijan at international physics olympiads, including IPhO and EuPhO.

I am always open to discussing collaborations, research, or interesting ideas. Feel free to email me for a virtual chat.

Selected Publications

ICLR 2026 Workshop

MUX: Continuous Reasoning via Multiplexed Tokens

Ayhan Suleymanzade, Halil Alperen Gozeten, Michael Bronstein, and 2 more authors

ICLR 2026 Workshop on LLM Reasoning, 2026

Bib PDF Website

@article{suleymanzade2026mux,
  title = {{MUX}: Continuous Reasoning via Multiplexed Tokens},
  author = {Suleymanzade, Ayhan and Gozeten, Halil Alperen and Bronstein, Michael and Ceylan, İsmail İlkan and Kim, Jinwoo},
  year = {2026},
  journal = {ICLR 2026 Workshop on LLM Reasoning},
  eprint = {2607.18264},
  archiveprefix = {arXiv},
  primaryclass = {cs.AI},
  url = {https://arxiv.org/abs/2607.18264},
}

ACL 2025 Oral

Diffusion Models Through a Global Lens: Are They Culturally Inclusive?

Zahra Bayramli^*, Ayhan Suleymanzade^*, Na Min An, and 5 more authors

Association for Computational Linguistics (ACL), 2025

Bib PDF

@article{bayramli2025diffusionmodelsgloballens,
  title = {Diffusion Models Through a Global Lens: Are They Culturally Inclusive?},
  author = {Bayramli, Zahra and Suleymanzade, Ayhan and An, Na Min and Ahmad, Huzama and Kim, Eunsu and Park, Junyeong and Thorne, James and Oh, Alice},
  year = {2025},
  journal = {Association for Computational Linguistics (ACL)},
  oral = {Oral},
}

ICLR 2025 Spotlight

Revisiting Random Walks for Learning on Graphs

Jinwoo Kim, Olga Zaghen^*, Ayhan Suleymanzade^*, and 2 more authors

International Conference on Learning Representations (ICLR), 2025

Bib PDF

@article{kim2025revisitingrandomwalkslearning,
  title = {Revisiting Random Walks for Learning on Graphs},
  author = {Kim, Jinwoo and Zaghen, Olga and Suleymanzade, Ayhan and Ryou, Youngmin and Hong, Seunghoon},
  year = {2025},
  journal = {International Conference on Learning Representations (ICLR)},
  spotlight = {Spotlight},
}

NeurIPS 2023 Spotlight

Learning Probabilistic Symmetrization for Architecture Agnostic Equivariance

Jinwoo Kim, Tien Dat Nguyen, Ayhan Suleymanzade, and 2 more authors

Neural Information Processing Systems (NeurIPS), 2023

Bib PDF

@article{kimd2024learningprobabilisticsymmetrizationarchitecture,
  title = {Learning Probabilistic Symmetrization for Architecture Agnostic Equivariance},
  author = {Kim, Jinwoo and Nguyen, Tien Dat and Suleymanzade, Ayhan and An, Hyeokjun and Hong, Seunghoon},
  year = {2023},
  journal = {Neural Information Processing Systems (NeurIPS)},
  spotlight = {Spotlight},
}

Honors

2026	Summa Cum Laude, KAIST — Graduated 2nd out of 143 students in the Computer Science Department.
2025	Q-Day Award, Advanced Research Division, KAIST — Recognized for contributions to academic research.
2022-2024	Dean's List, KAIST — Awarded four times.
2024	Presidential Fellowship, KAIST
2020-2021	Bronze Medal and Honorable Mention, International Physics Olympiad (IPhO)
2020-2021	Two Gold Medals, Azerbaijan National Physics Olympiad
2020	Honorable Mention, International Olympiad on Astronomy and Astrophysics (IOAA)
2019	Silver Medal, International Junior Science Olympiad (IJSO)