Ryuichiro Hataya

Ryuichiro Hataya · PhD (Information Science and Technology, University of Tokyo)

Ryuichiro Hataya’s webpage.

Senior Research Scientist, SB IntuitionsProgram-Specific Assistant Professor, Kyoto University

About

Short Bio

I am a senior research scientist at SB Intuitions and a program-specific assistant professor at Kyoto University. Previously, I was a postdoctoral researcher at RIKEN. I received my PhD in Information Science and Technology from the University of Tokyo in 2022.

News

2026

  • Our paper “RAPTOR: Accurate and Scalable Rational Polar Decomposition for the Muon Algorithm” has been accepted at ECML PKDD 2026. See you in September in Napoli🇮🇹.
  • Our paper “Provable Data Scaling Law for Meta Learning via Complexity Minimization,” coauthored with K. Fukuchi (University of Tsukuba) and K. Matsui (Kyoto University), has been accepted at the High-dimensional Learning Dynamics (HiLD) workshop at ICML 2026.
  • Our paper “Provable Target Sample Complexity Improvements as Pre‑Trained Models Scale,” coauthored with K. Fukuchi (University of Tsukuba) and K. Matsui (Kyoto University), has been accepted at AISTATS 2026.
Older news

2025

  • I will visit Artois University and Inria Centre at the University of Bordeaux🇫🇷.
  • I will join Kyoto University as a Program-Specific Assistant Professor.
  • Our paper “An Empirical Study of Pre-trained Model Selection for Out-of-Distribution Generalization and Calibration” (coauthored with H. Naganuma) is accepted at TMLR.
  • I will visit Nicolaus Copernicus University @ Torun, Poland to attend NOW🇵🇱.
  • My research proposal is accepted at JST BOOST Fostering Researchers in Emerging AI Program.
  • I quit my position at RIKEN AIP and join SB Intuitions as a senior research scientist.

2024

2023

  • Our paper “Sketch-based Semantic Retrieval of Medical Images” (Kobayashi et al.) has been accepted at Medical Image Analysis.
  • We will present “Non-commutative $C^\ast$-algebra Net” at QTML 2023 @ Geneve, Switzerland.
  • Our paper “An Empirical Investigation of Pre-trained Model Selection for Out-of-Distribution Generalization and Calibration” (Naganuma & Hataya) has been accepted at ICCV Workshop 2023 on Uncertainty Quantification for Computer Vision.
  • I will visit Nicolaus Copernicus University Poland from Sep 25th to 30th.
  • Our paper “Will Large-scale Generative Models Corrupt Future Datasets?” has been accepted at ICCV 2023.
  • Our paper “Towards AI-driven radiology education: A self-supervised segmentation-based framework for high-precision medical image editing” (Kobayashi et al.) has been accepted at MICCAI 2023 as an oral presentation.
  • I will visit MILA at Montreal and attend CVPR in June.
  • I will give a talk at UTokyo ICEPP.
  • I will visit IIT at Genova in May.
  • I will attend AISTATS at Valencia in April.
  • I will visit Vietnam Institute for Advanced Study in Mathematics at Hanoi in April.
  • I will visit EPFL CIS (Switzerland) and Fraunhofer IIS (Germany) from 8th to 15th March 2023.
  • Our paper “Nyström Method for Accurate and Scalable Implicit Differentiation” has been accepted at AISTATS 2023.

2022

  • I joined RIKEN ADSP and RIKEN AIP as a postdoctral researcher
  • I recieved a doctal degree as a representative student of the graduate school of Information Science and Techonology, UTokyo.
  • I defended my PhD thesis.
  • I visited IIT (Genova, Italy) from July 8th.
  • Our paper “DJMix: Unsupervised Task-agnostic Image Augmentation for Improving Robustness of Convolutional Neural Networks” is accepted to IJCNN 2022.

2021

  • I visited IIT (Genova, Italy) from October 1st to December 17th.
  • Our paper “Meta Approach to Data Augmentation Optimization” is accepted to WACV 2022.
  • My research proposal has been accepted in JST’s ACT-X.
  • Call for NeurIPS meetups is now out!
  • I will present about Faster AutoAugment and its applications at AIP Open seminar.
  • Our paper “Graph Energy-based Model for Molecular Graph Generation” is accepted at EBM workshop 2021 as a contributed talk.
  • I will serve as a meetup chair for NeurIPS 2021.
  • My research proposal has been accepted in JSPS’s travel grant.
  • My research proposals have been accepted by Microsoft Research Asia, and RIISE at UTokyo.
  • We organized a NeurIPS meetup and Women in ML in Japan: https://neuripsmeetupjapan.github.io.
  • Our paper “Decomposing Normal and Abnormal Features of Medical Images for Content-based Image Retrieval” is accepted at ML4H 2020.

Projects

Research Interests

  • Gradient-based hyperparameter optimization
  • Efficient and scalable deep learning
  • Applications of machine learning to other research fields (medical imaging, palaeontology, chemistry, physics, etc.)

Publications

  1. 2026
  2. Sci. Data 2026
    MNISQ: A Large-Scale Quantum Circuit Dataset for Machine Learning in the NISQ Era
    Leonardo Placidi, Ryuichiro Hataya, Toshio Mori, Koki Aoyama, Hayata Morisaki, Kosuke Mitarai, Keisuke Fujii
    Scientific Data, 2026
  3. ECML PKDD 2026
    RAPTOR: Accurate and Scalable Rational Polar Decomposition for the Muon Algorithm
    Ryuichiro Hataya
    European Conference on Machine Learning and Principles and Practice of Knowledge Discovery in Databases, 2026
  4. AISTATS 2026
    Provable Target Sample Complexity Improvements as Pre-Trained Models Scale
    Kazuto Fukuchi, Ryuichiro Hataya, Kota Matsui
    International Conference on Artificial Intelligence and Statistics, 2026
  5. ICML-W 2026
    Provable Data Scaling Law for Meta Learning via Complexity Minimization
    Kazuto Fukuchi, Ryuichiro Hataya, Kota Matsui
    ICML Workshop on High-dimensional Learning Dynamics, 2026 · Peer-reviewed short paper
  6. 2025
  7. TMLR 2025
    An Empirical Study of Pre-trained Model Selection for Out-of-Distribution Generalization and Calibration
    Hiroki Naganuma*, Ryuichiro Hataya*, Kotaro Yoshida, Ioannis Mitliagkas
    Transactions on Machine Learning Research, 2025
  8. 2024
  9. MedIA 2024
    Sketch-based Semantic Retrieval of Medical Images
    Kazuma Kobayashi, Lin Gu, Ryuichiro Hataya, Takaaki Mizuno, Mototaka Miyake, Hirokazu Watanabe, Masamichi Takahashi, Yasuyuki Takamizawa, Yukihiro Yoshida, Satoshi Nakamura, Nobuji Kouno, Amina Bolatkan, Yusuke Kurose, Tatsuya Harada, Ryuji Hamamoto
    Medical Image Analysis, 2024
  10. ICML 2024
    Self-attention Networks Localize When QK-eigenspectrum Concentrates
    Han Bao, Ryuichiro Hataya, Ryo Karakida
    International Conference on Machine Learning, 2024
  11. arXiv 2024
    Automatic Domain Adaptation by Transformers in In-Context Learning
    Ryuichiro Hataya, Kota Matsui, Masaaki Imaizumi
    arXiv, 2024
  12. arXiv 2024
    Quantum Circuit $C^\ast$-algebra Net
    Yuka Hashimoto*, Ryuichiro Hataya*
    arXiv, 2024
  13. arXiv 2024
    Glocal Hypergradient Estimation with Koopman Operator
    Ryuichiro Hataya, Yoshinobu Kawahara
    arXiv, 2024
  14. ICML-W 2024
    Automatic Domain Adaptation by Transformers in In-Context Learning
    Ryuichiro Hataya, Kota Matsui, Masaaki Imaizumi
    ICML Workshop on In-Context Learning, 2024 · Peer-reviewed short paper
  15. ICML-W 2024
    Transformers as Stochastic Optimizers
    Ryuichiro Hataya, Masaaki Imaizumi
    ICML Workshop on In-Context Learning, 2024 · Peer-reviewed short paper
  16. 2023
  17. ICCV 2023
    Will Large-scale Generative Models Corrupt Future Datasets?
    Ryuichiro Hataya, Han Bao, Hiromi Arai
    International Conference on Computer Vision, 2023
  18. MICCAI 2023
    Towards AI-driven Radiology Education: A Self-supervised Segmentation-based Framework for High-precision Medical Image Editing
    Kazuma Kobayashi, Lin Gu, Ryuichiro Hataya, Mototaka Miyake, Yasuyuki Takamizawa, Sono Ito, Hirokazu Watanabe, Yukihiro Yoshida, Hiroki Yoshimura, Tatsuya Harada, Ryuji Hamamoto
    Medical Image Computing and Computer-Assisted Intervention, 2023 · Oral
  19. AISTATS 2023
    Nyström Method for Accurate and Scalable Implicit Differentiation
    Ryuichiro Hataya, Makoto Yamada
    International Conference on Artificial Intelligence and Statistics, 2023
  20. arXiv 2023
    Noncommutative $C^\ast$-algebra Net: Learning Neural Networks with Powerful Product Structure in $C^\ast$-algebra
    Ryuichiro Hataya*, Yuka Hashimoto*
    arXiv, 2023
  21. QTML 2023
    Noncommutative $C^\ast$-algebra Nets
    Ryuichiro Hataya, Yuka Hashimoto
    International Conference on Quantum Techniques in Machine Learning, 2023 · Peer-reviewed extended abstract
  22. ICCV-W 2023
    An Empirical Investigation of Pre-trained Model Selection for Out-of-Distribution Generalization and Calibration
    Hiroki Naganuma, Ryuichiro Hataya
    ICCV Workshop on Uncertainty Quantification for Computer Vision, 2023 · Peer-reviewed extended abstract
  23. 2022
  24. IJCNN 2022
    DJMix: Unsupervised Task-agnostic Image Augmentation for Improving Robustness of Convolutional Neural Networks
    Ryuichiro Hataya, Hideki Nakayama
    International Joint Conference on Neural Networks, 2022
  25. WACV 2022
    Meta Approach to Data Augmentation Optimization
    Ryuichiro Hataya, Jan Zdenek, Kazuki Yoshizoe, Hideki Nakayama
    Winter Conference on Applications of Computer Vision, 2022
  26. 2021
  27. MedIA 2021
    Decomposing Normal and Abnormal Features of Medical Images for Content-Based Image Retrieval of Glioma Imaging
    Kazuma Kobayashi, Ryuichiro Hataya, Yusuke Kurose, Mototaka Miyake, Masamichi Takahashi, Akiko Nakagawa, Tatsuya Harada, Ryuji Hamamoto
    Medical Image Analysis, 2021
  28. ICASSP 2021
    Visualizing Association in Exemplar-based Classification
    Taiga Kashima, Ryuichiro Hataya, Hideki Nakayama
    International Conference on Acoustics, Speech, and Signal Processing, 2021
  29. arXiv 2021
    Graph Energy-based Model for Substructure Preserving Molecular Design
    Ryuichiro Hataya, Hideki Nakayama, Kazuki Yoshizoe
    arXiv, 2021
  30. ICLR-W 2021
    Graph Energy-based Model for Molecular Graph Generation
    Ryuichiro Hataya, Hideki Nakayama, Kazuki Yoshizoe
    EBM Workshop at ICLR, 2021 · Contributed talk
  31. 2020
  32. ECCV 2020
    Faster AutoAugment: Learning Augmentation Strategies using Backpropagation
    Ryuichiro Hataya, Jan Zdenek, Kazuki Yoshizoe, Hideki Nakayama
    European Conference on Computer Vision, 2020
  33. ML4H 2020
    Decomposing Normal and Abnormal Features of Medical Images for Content-based Image Retrieval
    Kazuma Kobayashi, Ryuichiro Hataya, Yusuke Kurose, Tatsuya Harada, Ryuji Hamamoto
    Machine Learning for Health Workshop at NeurIPS, 2020 · Peer-reviewed extended abstract
  34. GSA 2020
    Learning to Identify Large Fossils using Deep Convolutional Neural Networks
    Ryuichiro Hataya, Kumiko Matsui, Tomoki Karasawa
    Geological Society of America Abstracts with Programs, 2020
  35. 2019
  36. ICIP 2019
    LOL: Learning To Optimize Loss Switching Under Label Noise
    Ryuichiro Hataya, Hideki Nakayama
    International Conference on Image Processing, 2019
  37. ICLR-W 2019
    Unifying Semi-supervised and Robust Learning by Mixup
    Ryuichiro Hataya, Hideki Nakayama
    Workshop on Learning from Limited Labeled Data at ICLR, 2019 · Spotlight

* equal contribution

Other Research Activities

Invited Talks

  • “Developing Japanese Vision Language Models,” NOW, Nicolaus Copernicus University, Jan 2025.
older information
  • “Gradient-based Hyperparameter Optimization for Deep Learning”, University of Trento, Oct, 2024.
  • “Will Large-scale Generative Models Corrupt Future Datasets?”, (in Japanese) FIT2024, Sep, 2024.
  • “Automatic Domain Adaptation by Transformers in In-Context Learning,” CIRM Workshop on mathematical foundations of machine learning, July 2024.
  • “Automatic Domain Adaptation by Transformers in In-Context Learning,” A*STAR-CFAR_RIKEN-AIP Workshop, June 2024. Slides
  • “Automatic Domain Adaptation by Transformers in In-Context Learning,” (in Japanese) Zapping Seminar, June 2024.
  • “Gradient-based Hyperparameter Optimization”, (in Japanese) The 53rd IBISML seminar, March 2024.
  • “Deep learning and data augmentation”, (in Japanese) The 4th TREFOIL seminar, Feburary 2024.
  • “Determinantal point processes and their applications in machine learning,” (in Japanese) ICEPP seminar, June 2023.
  • “Towards accurate and scalable gradient-based hyperparameter optimization,” Istituto Italiano di Tecnologia, May, 2023.
  • “Noncommutative $C^\ast$-algebra Nets,” Japan-Vietnam AI Forum, April 2023.
  • “Bayesian Model Selection for Deep Learning” (in Japanese), Zapping Seminar, 2022.
  • “Data Augmentation for Deep Learning” (in Japanese), Ehime University DS Research Seminar, 2021.
  • “Data Augmentation for Deep Learning” (in Japanese), Symposium on Sensing via Image Information, 2021.
  • “Data Augmentation for Deep Learning” (in Japanese), StatsML Symposium, 2020.
  • “Gradient-based Hyperparameter Optimization” (in Japanese), Zapping Seminar, 2020.

Talks

Research Grants

  • BOOST Fostering Researchers in Emerging AI Program, Japan Science and Technology Agency, ¥50M, 2025-2029.
older information
  • Grant-in-Aid for Young Scientists, Japan Society for the Promotion of Science, ¥3.2M, 2025-2026.
  • ACT-X Acceleration phase, Japan Science and Technology Agency, ¥5.0M, 2024.
  • Grant-in-Aid for Research Activity Start-up, Japan Society for the Promotion of Science, ¥2.2M, 2023-2024.
  • ACT-X, Japan Science and Technology Agency, ¥4.5M, 2021-2024.
  • Overseas Challenge Program for Young Researchers by JSPS, ¥1.4M, 2021.
  • Microsoft Research Asia Collaborative Research Program (D-CORE 2021) by MSRA, ¥1.0M, 2021.
  • Sprouting Research RA’s in Value Exchange Engineering by RIISE@UTokyo, ¥2.0M, 2020-2022.

Awards

  • Microsoft Research Asia D-Core Award, 2020.
  • Best Student Paper Award, The 23rd Meeting on Image Recognition and Understanding, 2020.

Others

older information

Contact

Contact me via research@${last_name}.tokyo.