History: Crowd motivation

Preview of version: 4

Challenges in crowd motivation:

-Haiti response:
it became hard to keep workers motivated as the process went on before funding came online. Personal relationships really helped keep people going
-Using social media helped both recruit people and provide a positive motivation for people coming into the work in a more personal manner

MTurk: Money is the main motivator
Other motivation besides money:
-community recognition
-personal achievement
-competition (who does the most tasks wins)
-stat maintenance keeps people shooting for a goal ("competing" with themselves going forward)

Feedback loop is important for people as an extra motivation. Whether its:
-markup of their ESL output
-translation back and forth view for the Monolingual contributing
-People on Livemocha want to learn a language and this is a great motivator
-positive feedback and access to more advanced work based on previous performance was a very good tool with people on MTurk

There is an effect of national/language pride in low density language tasks. People are proud to help get their language out there and build resources for it.

How much of the motivation can be automated into the process and how much of it will and has to remain personal relationship driven. How scalable are these relationship models to larger and larger crowds.

Going back to disaster related crowdsourcing, they found an effect of how Newsmaking the issue was related to how much interest there was in helping out.

There is a strong confound of incentive quantity and the standards of living in the countries where language is spoken. For Indian languages you can get away with paying less than, say, Japanese or Korean.

At Kiva.org they found that there are certain demographics for volunteers that they are recruiting...so middle aged professionals and retirees, as well as young mothers are great, but students tend to be quite bad in terms of long-term commitment

Community is important. Even on MTurk people are forming communities on turkernation to discuss the work they do and other related matters. Giving people good senses of community is very good.

Giving people a humanitarian reason for participating is great. Burch, when collecting data for Pakistani SMS translation, told people what the information would be used for and people seemed to really respond on a personal level to the work.

To what extent can games (with a purpose) be used to motivate people for language translation tasks?
-thinking in terms of Re-Capture and Image labeling task
-Educational or fun game for translation? What are the annotations or other information that can be generated quickly and be quite useful?
-there has been work done (for example, CrowdFlower) with putting tasks into games like Farmville







History

Advanced
Information Version
Tue 30 of Nov, 2010 15:25 GMT alain_desilets 15
Tue 30 of Nov, 2010 15:21 GMT alain_desilets 14
Tue 30 of Nov, 2010 15:16 GMT alain_desilets 13
Thu 25 of Nov, 2010 19:39 GMT alain_desilets 12
Thu 25 of Nov, 2010 19:38 GMT alain_desilets 11
Thu 25 of Nov, 2010 19:37 GMT alain_desilets 10
Mon 22 of Nov, 2010 21:44 GMT alain_desilets 9
Mon 22 of Nov, 2010 21:43 GMT alain_desilets 8
Mon 22 of Nov, 2010 21:43 GMT alain_desilets 7
Mon 22 of Nov, 2010 18:59 GMT alain_desilets 6
Sun 31 of Oct, 2010 18:41 GMT yakov added Rob's quotes 5
Sun 31 of Oct, 2010 18:33 GMT yakov another iterative save 4
Sun 31 of Oct, 2010 18:10 GMT yakov intermittent change 3
Sun 31 of Oct, 2010 17:52 GMT yakov first step 2
Sun 31 of Oct, 2010 16:48 GMT alain_desilets 1

Upcoming Events

No records to display