.

Inferring User Interests on Social Media From Text and Images

We propose to infer user interests on social media where multi-modal data (text, image etc.) exist. We leverage user-generated data from Pinterest.com as a natural expression of users’ interests. Our main contribution is exploiting a multi-modal space composed of images and text. This is a natural approach since humans express their interests with a combination of modalities. We performed experiments using the state-of-the-art image and textual representations, such as convolutional neural networks, word embeddings, and bags of visual and textual words. Our experimental results show that in fact jointly processing image and text increases the overall interest classification accuracy, when compared to uni-modal representations (i.e., using only text or using only images).

Check out our paper

Inferring User Interests on Social Media From Text and Images

International Workshop on Social Media Retrieval and Analysis in conjunction with the IEEE International Conference on Data Mining (ICDM 2015)

Yagmur Gizem Cinar, Susana Zoghbi, Marie-Francine Moens

About Me Author

Susana Zoghbi

Helping machines understand the world to enable businesses’ growth Read More
Recent Post
Categories
Tags

You May Also Like

Antler Program T-5days

We are about to start the Antler program in the Nordics in just 5 days and I can’t wait. For the past 6 weeks, we’ve had the pre-ramp phase, where we already started chatting with other founders and Antler coaches, mentors and partners. For those that don’t know, Antler is a 12-week program that helps you meet like-minded founders and work on ideas in a systematic way. At the end of the program, you present your progress to an Investment Committee to see if your startup will …