MediaEval 2014 Crowdsourcing Task: Crowdsorting multimedia comments

Date created: | Last Updated:


Creating DOI. Please wait...

Create DOI

Category: Project

Description: The MediaEval 2014 Crowdsorting task addresses the challenge of classifying timed-comments that users have associated with specific time-points in music tracks on a large social music sharing platform. Input to the classifier is a set of labels generated by human computation (i.e., input from the crowd). Alternately, the classifier can exploit labels generated by both human and automatic computation (i.e., text and/or audio signal analysis). The job of the classifier is to sort timed-comments that have been contributed by users listening to a particular song in order to isolate the comments that are the most useful (whereby 'useful' takes on different definitions dependent on the final application scenario in which the sorted comments are to be used).


2014 Crowdsourcing for Social Multimedia Task ReadMe This data set was published by the MediaEval Multimedia Benchmark Initiative within the context of the MediaEval 2014 Crowdsourcing Task. The task takes place during the month of September 2014. We are using the OSF for the first time in order to test its usefulness for such a task. Note that by using this data, we are assume that you are agre...


Loading files...



  • Data

    Recent Activity

    Loading logs...

  • F1-score

    Recent Activity

    Loading logs...

Recent Activity

Loading logs...

OSF does not support the use of Internet Explorer. For optimal performance, please switch to another browser.
This website relies on cookies to help provide a better user experience. By clicking Accept or continuing to use the site, you agree. For more information, see our Privacy Policy and information on cookie use.

Start managing your projects on the OSF today.

Free and easy to use, the Open Science Framework supports the entire research lifecycle: planning, execution, reporting, archiving, and discovery.