Deep Learning for Food Recognition

Chong-Wah Ngo - Professor in the Dept. of Computer Science at the City University of Hong Kong
Data Science

Date: -
Location: Eurecom

Abstract: In multimedia, dishes recognition is regarded as a difficult problem due to diverse appearance of prepared food in shape and color. As a result, while there is a large number of cooking recipes posted on the Internet, finding a right recipe for a food picture remains a challenge. The problem is also shared among health-related applications. For example, food-log management, which records dairy food intake, often requires manual input of food/ingredients for nutrition estimation. This talk will share with you the challenge of recognizing food attributes (e.g., ingredients, cooking methods) in dishes for recipe retrieval. Finding a recipe that exactly describes a dish is challenging because ingredient compositions and cooking styles vary across geographical regions, cultures, seasons and occasions. I will introduce deep neutral architectures that explore the relationship among food, ingredients and recipes for recognition. The learnt deep features are used for cross-modal retrieval of food and recipes. Bio: Chong-Wah Ngo is a professor in the Dept. of Computer Science at the City University of Hong Kong. He received his PhD in Computer Science from Hong Kong University of Science & Technology, and MSc and BSc, both in Computer Engineering, from Nanyang Technological University of Singapore. Before joining City University of Hong Kong, he was a postdoctoral scholar in Beckman Institute at the University of Illinois in Urbana-Champaign. His main research interests include large-scale multimedia information retrieval, video computing, multimedia mining and visualization. He was the associate editor of IEEE Trans. on Multimedia and is currently steering committee member of TRECVid, ICMR (Int. Conf. on Multimedia Retrieval) and ACM Multimedia Asia. He is program co-chair of ACM Multimedia 2019, and general co-chairs of ICIMCS 2018 and PCM 2018. He served as the chairman of ACM (Hong Kong Chapter) during 2008-2009, and was named ACM Distinguished Scientist in 2016 for contributions to video search and semantic understanding.