07/23/2012: Finalize We finally finalized our questions for the Mechanical Turk study. We finally got the questions that we are going to ask them for each HIT, which in our case is 1 lead. We decided to pay people by each lead instead of bundling them together. First, we weren't sure how we would be able to do that and still get 10 responses on each lead while making sure that each Hit contained different leads and not always the same set of leads. Clumping leads together might affect the results and we didn't want that. Also this way people could do as many as they wanted. They could do 1 or 10 or 23. We are slightly worried that this means that people won't do it because it's small pay for doing one lead but we will see. After using the sandbox to look at the survey and arguing again about which questions to use, are they phrased appropriately, is the choices to respond clear enough, are the questions in the right order, and so on. We also had to figure out how long it took us to do the survey so Ethan set up a sequence of 10 leads that we all had to do. This way we could test ourselves on the same data and get an average score of how long it will take for users to take the test. We had to pretend that we were reading about all this stuff for the first time so we didn't rush through it quicker just because we knew everything already. All five of us taking the test took between 15-20 minutes. This makes sense because it included the set up process and actually doing the first lead which would take longer than the other ones. Then it would be a little over a minute for each lead. The questions we settled on were: Then for each of the leads we decided on asking the following 8 questions: (All questions were answered on a scale of 1 to 5, how much you agree with each statement). Even though it's not shown here but we followed through these directions as a reminder to the user. 1. The text style is creative. 2. The text contains unnecessary detail. 3. The text is confusing. 4. The text's writing is exceptional. 5. I know the main topic o the article. 6. Personally I feel the topic of the article is boring 7. The writing style enhances the text. 8. I enjoyed reading the text. 9. The writing style of the text is interesting. 10. I want to read the rest of the article.