Takuma Yagi

Takuma Yagi, Ph.D.

This is Takuma Yagi (八木拓真) 's personal webpage.
I am a Project Researcher at Institute of Industrial Science, The University of Tokyo.
I was formerly a Ph.D. student at the University of Tokyo, advised by Prof. Yoichi Sato.
I'm especially interested in developing an intelligent system that perceives and understand our world and using them to make our life better.

Email: tyagi[at]iis.u-tokyo.ac.jp
Google Scholar

Resarch Interests

News

Selected Publications

New!
Fine-grained Affordance Annotation for Egocentric Hand-Object Interaction Videos
Zecheng Yu, Yifei Huang, Ryosuke Furuta, Takuma Yagi, Yusuke Goutsu, and Yoichi Sato.
WACV 2023, EPIC [email protected]
[preprint]

Ego4D: Around the World in 3,000 Hours of Egocentric Video
Kristen Grauman, Andrew Westbury, Eugene Byrne, Zachary Chavis, Antonino Furnari, Rohit Girdhar, ..., Takuma Yagi, ... Jitendra Malik.
CVPR 2022 (Oral)
[project page] [paper]

Object Instance Identification in Dynamic Environments
Takuma Yagi, Md. Tasnimul Hasan, and Yoichi Sato.
In Tenth International Workshop on Egocentric Perception, Interaction and Computing ([email protected]), Extended Abstracts.
[paper] [preprint] [code]

Hand-Object Contact Prediction via Motion-Based Pseudo-Labeling and Guided Progressive Label Correction
Takuma Yagi, Md. Tasnimul Hasan, and Yoichi Sato.
BMVC 2021
[paper & talk] [preprint] [data & code]

Foreground-Aware Stylization and Consensus Pseudo-Labeling for Domain Adaptation of First-Person Hand Segmentation
Takehiko Ohkawa, Takuma Yagi, Atsushi Hashimoto, Yoshitaka Ushiku and Yoichi Sato
IEEE Access 2021
[Preprint] [Paper] [Project] [Data & Code]

GO-Finder: Registration-Free Wearable System for Assisting Users in Finding Lost Objects via Hand-Held Object Discovery
Takuma Yagi, Takumi Nishiyasu, Kunimasa Kawasaki, Moe Matsuki, and Yoichi Sato.
IUI 2021 (Long Paper)
[Preprint] [Paper] [Video] [Presentation]

Future Person Localization in First-Person Videos
Takuma Yagi, Karttikeya Mangalam, Ryo Yonetani, and Yoichi Sato.
CVPR 2018 (Spotlight)
[Preprint] [Paper] [Data & Code]

Work Experience

Apr. 2022 - Present, Project Researcher at Institute of Industrial Science, The University of Tokyo

Analysis of biochemical experiment videos at Sato Laboratory

Oct. 2022 - Mar. 2023, Visiting Researcher at Nihon University

Research on Human-Agent Interaction at Osawa Laboratory

Sep. 2018 - Dec. 2018, Microsoft Research Asia

Research Internship at Media Computing Group. Advisor: Dr. Xun Guo

Jun. 2017 - Mar. 2018, Dwango Artificial Intelligence Laboratory

Curriculum supervisor/lecturer at Neuro-Inspired COmputing To AI School (NICO2AI School)

Dec. 2015 - Jan. 2016, Datasection.Inc

Machine Learning Engineer

Mar. 2014 - Mar. 2015, Datasection.Inc

Java/Javascript Engineer

Education

2022 Ph.D. in Information Science and Technology, The University of Tokyo

Advisor: Prof. Yoichi Sato

Thesis: Hand-Object Interaction Mining from First-Person Videos

2019 M.S. in Information and Science and Technology, The University of Tokyo

Advisor: Prof. Yoichi Sato

Thesis: Future Person Localization in First-Person Videos

2017 B.E. in Computer Science, Tokyo Institute of Technology

Advisor: Prof. Koichi Shinoda

Thesis: Patch-based Human Action Recognition from Video via Disrciminative Feature Mining

Grants

Oct. 2022 - Mar. 2025 JST ACT-X AI powered Research Innovation / Creation, 6,000,000 JPY

Oct. 2022 - Mar. 2024 JSPS Grant-in-Aid for Research Activity Start-up, 2,200,000 JPY

Apr. 2021 - Mar. 2022 JSPS Research Fellowship for Young Scientists (JSPS DC2), 800,000 JPY

2019 JASSO Scholarship for Top 10% Excellent Master Students from Japan Student Services Organization, 2,112,000 JPY

Jul. 2018 - Jun. 2023 Masason Foundation Full Member

2018 The NEC C&C Foundations: Grants for Attendees at International Conference, 200,000 JPY

Apr. 2017 - Mar. 2018 Toyota/Dwango Scholarship for Advanced Artificial Intelligence Researcher, 1,200,000 JPY