Imaginary Soundscape — AIが「想像」するサウンドスケープ

Nao Tokui (Qosmo)
Dec 19, 2017 · 10 min read
Image for post
Image for post
Imaginary Soundscape — http://imaginarysoundscape.qosmo.jp/

NIPS 2017 Machine Learning for Creativity and Designで発表したショートペーパー Imaginary Soundscape: Cross-Modal Approach to Generate Pseudo Sound Environments について.

In English, please refer to this post.

デンバー空港 2002年

Ambisonics360マイク — 2015
Image for post
Image for post
Image for post
Image for post
左が入力画像. 右が画像認識のエンジンが選択した類似画像

人は一枚の写真からその場にいたら聞こえてくるであろう音を想像することができる. AIにも同じことが可能だろうか?

もしできるのであれば、Googleストリートビューにその音をつけたらどうなるだろうか、AIが妄想する仮想のサウンドスケープの中を散歩できたら…


Cross-Modal検索の研究 — Deep Learning for Content-Based, Cross-Modal Retrieval of Videos and Music
Image for post
Image for post
SoundNet: Learning Sound Representations from Unlabeled Video

Welcome to a place where words matter. On Medium, smart voices and original ideas take center stage - with no ads in sight. Watch
Follow all the topics you care about, and we’ll deliver the best stories for you to your homepage and inbox. Explore
Get unlimited access to the best stories on Medium — and support writers while you’re at it. Just $5/month. Upgrade

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store