About Me
I’m a Ph.D student at Machine Learning and Artificial Intelligence (MLAI) lab in KAIST, under the supervision of Prof. Sung Ju Hwang. I am interning with Meta AI (Seattle, WA). My research has been supported by Google Ph.D. Fellowship.
My research interest includes:
- Neural architecture search
- Meta-learning
- AutoML
News
Oct. 2022. NeurIPS2022 Top reviewer
Sep. 2022. Google Ph.D. fellowship
Aug. 2022. Research internship at Meta AI, Seattle, WA, USA
Feb. 2022. AI/CS/EE Rising star 2022 supported by Google exploreCSR
Jan. 2022. One paper accepted to ICLR 2022 as Spotlight Presentation
Oct. 2021. Best presentation award at KAIST-ADD workshop
Sep. 2021. Two papers accepted to NeurIPS 2021 as Spotlight Presentations
Apr. 2021. Invited talk at Samsung, Suwon, South Korea
Jan. 2021. One paper accepted to ICLR 2021
Dec. 2020. Research internship at AITRICS, Seoul, South Korea
Dec. 2020. ICML2020 oustanding reviewer (Top 30%)
Nov. 2020. NAVER Ph.D. fellowship
Dec. 2019. One paper accepted to ICLR 2020 as Oral Presentation
Education
Ph.D. in School of Computing, Korea Advanced Institute of Science and Technology (KAIST)
Mar. 2018 - Aug. 2023 (expected)M.S. in School of Computing, Korea Advanced Institute of Science and Technology (KAIST)
Mar. 2016 - Feb. 2018B.S. in Computer Science, Sungkyunkwan University
Mar. 2012 - Feb. 2016
Awards & Honors
- Top Reviewer
NeurIPS, 2022 - Google Ph.D. Fellowship
One of the five recipients from Republic of Korea, 2022 - AI/CS/EE Rising Stars Award
Google exploreCSR, 2022 - The Best Presentation Award
KAIST-Korea Agency for Defence Development Workshop, 2021 - NAVER Ph.D. Fellowship
One of the ten Ph.D. students with outstanding research outcome in KAIST CS Dept., 2020 - Outstanding Reviewer (Top 30%)
ICML, 2020 - Kyunghyun Cho Travel Grant
ICLR, 2020
Work Experiences
- Research Intern, Meta AI, Seattle, WA (Aug 2022 - Dec 2022)
- Research Intern, AITRICS, Seoul, South Korea (Dec 2020 - Feb 2021)
- Research Intern, National AI Research Institute, Deajeon, South Korea (Jul 2015 - Jun 2015)
- Developer Intern, Samsung Electronics, Suwon, South Korea (Jan 2015 - Feb 2015)
International Conference Publications
Online Hyperparameter Meta-Learning with Hypergradient Distillation
[paper]
Hae Beom Lee, Hayeon Lee, Jaewoong Shin, Eunho Yang, Timothy Hospedales, Sung Ju Hwang
ICLR 2022, Spotlight Presentation (acceptance = 176 / 3391 = 5.1%)HELP: Hardware-Adaptive Efficient Latency Prediction for NAS via Meta-Learning
[paper] [code]
Hayeon Lee*, Sewoong Lee*, Song Chong, Sung Ju Hwang (*: equal contribution)
NeurIPS 2021, Spotlight Presentation (acceptance < 3%)Task-Adaptive Neural Network Search with Meta-Contrastive Learning
[paper] [code]
Wonyong Jeong*, Hayeon Lee*, Gun Park*, Eunyoung Hyung, Jinheon Baek, Sung Ju Hwang (*: equal contribution)
NeurIPS 2021, Spotlight Presentation (acceptance < 3%)Rapid Neural Architecture Search by Learning to Generate Graphs from Datasets
[paper] [code]
Hayeon Lee*, Eunyoung Hyung*, Sung Ju Hwang (*: equal contribution)
ICLR 2021Learning to Balance: Bayesian Meta-Learning for Imbalanced and Out-of-distribution Tasks
[paper] [code]
Hae Beom Lee*, Hayeon Lee*, Donghyun Na*, Saehoon Kim, Minseop Park, Eunho Yang, Sung Ju Hwang (*: equal contribution)
ICLR 2020, Oral Presentation (acceptance = 48/2594 = 1.9%)
Domestic Conference Publication
- Learning Spatial Relationships for Cross Modal Retrieval
Hayeon Lee*, Wonjun Yoon*, Jinseok Park, Sung Ju Hwang (*: equal contribution)
CKAIA 2020
Workshop Publication
- Lightweight Neural Architecture Search with Parameter Remapping and Knowledge Distillation
[paper]
Hayeon Lee*, Sohyun An*, Minseon Kim, Sung Ju Hwang (*: equal contribution)
AutoML 2022 Workshop
Preprint
- SuperNet in Neural Architecture Search: A Taxonomic Survey
[paper]
Stephen Cha, Taehyeon Kim, Hayeon Lee, Se-Young Yun
arXiv 2022
Invited Talks
- “Rapid Neural Architecture Search by Learning to Generate Graphs from Datasets”
- @ Samsung Electronics DS DIT Center, Korea, April 2021
- @ Korea Agency for Defence Development, Korea, October 2021
- “Task-Adaptive Neural Network Search with Meta-Contrastive Learning”
- @ NeurIPS Social: ML in Korea, Dec 2021
- @ Hanbat National University in Republic of Korea, April 2022
- @ KAIST Programming Language Research Group in Republic of Korea, May 2022
- @ Electronic & Information Research Information Center in Republic of Korea, May 2022
- “HELP: Hardware-Adaptive Efficient Latency Prediction for NAS via Meta-Learning”
- @ NeurIPS Social: ML in Republic of Korea, Dec 2021
- @ Hanbat National University in Republic of Korea, April 2022
- @ KAIST Programming Language Research Group in Republic of Korea, May 2022
- @ Electronic & Information Research Information Center in Republic of Korea, May 2022
- @ Ewha University in Republic of Korea, June 2022
News Articles
- KAIST 황성주 교수팀, NeurIPS에 빅테크 오토ML 문제 푼 비결 공개, AI Times, 2021.12.08
- “NeurIPS에 소개된 국내 연구 성과는?” EIRIC, 5월부터 리뷰 세미나 개최, AI Times, 2022.04.27
Academic Services
Conference Reviewer
- International Conference on Machine Learning (ICML) 2020, 2021 (expert), 2022
- Neural Information Processing Systems (NeurIPS) 2020, 2021, 2022
- International Conference on Learning Representations (ICLR) 2021, 2022
- AAAI Conference on Artificial Intelligence (AAAI) 2021
- Asian Conference on Machine Learning (ACML) 2020
Journal Reviewer
- Transactions on Machine Learning Research (TMLR)
Projects
Human-Inspired Large-Scale Visual Recognition System, Samsung Electronics, 2019-2022
AutoML with Large-scale Hyperparameter Meta-Learning, Google, 2022-Present