About me

I’m a Ph.D student at Machine Learning and Artificial Intelligence (MLAI) lab in KAIST, under the supervision of Prof. Sung Ju Hwang.

My research interest includes:

  • Neural architecture search
  • Meta-learning
  • AutoML

Education

  • Korea Advanced Institute of Science and Technology

    Mar. 2018 - Present
    Ph.D. in School of Computing

  • Korea Advanced Institute of Science and Technology

    Mar. 2016 - Feb. 2018
    M.S. in School of Computing

  • SungKyunKwan University

    Mar. 2012 - Feb. 2016
    B.S. in Computer Science

Preprints

  • Online Hyperparameter Meta-Learning with Hypergradient Distillation

    [paper]
    Hae Beom Lee, Hayeon Lee, Jaewoong Shin, Eunho Yang, Timothy Hospedales, Sung Ju Hwang
    arXiv, 2021

Conference Publications

  • HELP: Hardware-Adaptive Efficient Latency Prediction for NAS via Meta-Learning

    [paper] [code]
    Hayeon Lee*, Sewoong Lee*, Song Chong, Sung Ju Hwang
    (*: equal contribution)
    NeurIPS 2021, Spotlight Presentation (acceptance < 3%)

  • Task-Adaptive Neural Network Search with Meta-Contrastive Learning

    [paper] [code]
    Wonyong Jeong*, Hayeon Lee*, Gun Park*, Eunyoung Hyung, Jinheon Baek, Sung Ju Hwang
    (*: equal contribution)
    NeurIPS 2021, Spotlight Presentation (acceptance < 3%)

  • Rapid Neural Architecture Search by Learning to Generate Graphs from Datasets

    [paper] [code]
    Hayeon Lee*, Eunyoung Hyung*, Sung Ju Hwang
    (*: equal contribution)
    ICLR 2021

  • Learning to Balance: Bayesian Meta-Learning for Imbalanced and Out-of-distribution Tasks

    [paper] [code]
    Hae Beom Lee*, Hayeon Lee*, Donghyun Na*, Saehoon Kim, Minseop Park, Eunho Yang, Sung Ju Hwang
    (*: equal contribution)
    ICLR 2020, Oral Presentation (acceptance = 48/2594 = 1.9%)

  • Learning Spatial Relationships for Cross Modal Retrieval

    Hayeon Lee*, Wonjun Yoon*, Jinseok Park, Sung Ju Hwang
    (*: equal contribution)
    CKAIA 2020

Awards & Honors

  • The Best Presentation Award at KAIST-ADD Workshop (2021)
  • ICML Top Reviewer (2020)
  • NAVER Ph.D. Fellowship Award (2020)
  • ICLR Kyunghyun Cho Travel Grant (2020)

Talks

  • "Rapid Neural Architecture Search by Learning to Generate Graphs from Datasets"
    • @ Samsung Electronics DS DIT Center, Korea, April 2021
    • @ Korea Agency for Defence Development, Korea, October 2021
  • "Task-Adaptive Neural Network Search with Meta-Contrastive Learning"
    • @ NeurIPS Social: ML in Korea, Dec 2021
  • "HELP: Hardware-Adaptive Efficient Latency Prediction for NAS via Meta-Learning"
    • @ NeurIPS Social: ML in Korea, Dec 2021

Academic Services

  • ICML 2020, 2021 (expert)
  • NeurIPS 2020, 2021
  • ACML 2020
  • AAAI 2021
  • ICLR 2021, 2022

News Articles

Work Experiences