Paper accepted at INLG2019

Atsushi Hashimoto
Nov 8 · 1 min read

We are pleased to announce that a paper from OMRON SINIC X (in collaboration with Kyoto University) was accepted at International Conference on Natural Language Generation (INLG) 2019!

Taichi Nishimura, Atsushi Hashimoto, and Shinsuke Mori, “Procedural Text Generation from a Photo Sequence”

Overview

Multimedia procedural texts, such as instructions and manuals with pictures, support people to share how-to knowledge. In this paper, we propose a method for generating a procedural text given a photo sequence allowing users to obtain a multimedia procedural text. We propose a single embedding space both for image and text enabling to interconnect them and to select appropriate words to describe a photo. We implemented our method and tested it on cooking instructions, i.e., recipes. Various experimental results showed that our method outperforms standard baselines.

[Paper] [INLG2019]

sinicx

Activities at OMRON SINIC X (OSX), aiming for near-future design through cutting-edge research in perception, robotics, and human computer interaction.

Atsushi Hashimoto

Written by

sinicx

sinicx

Activities at OMRON SINIC X (OSX), aiming for near-future design through cutting-edge research in perception, robotics, and human computer interaction.

Welcome to a place where words matter. On Medium, smart voices and original ideas take center stage - with no ads in sight. Watch
Follow all the topics you care about, and we’ll deliver the best stories for you to your homepage and inbox. Explore
Get unlimited access to the best stories on Medium — and support writers while you’re at it. Just $5/month. Upgrade