MY ONGOING TASK
Develop and design an Emperical study to test whether users will enter
assertions into spreadsheets and whether or not these assertions will help
with spreadsheet correctness. This includes all the details of running
the study, such as, the creation of tutorial, development of tasks and
spreadsheet descriptions, background and post-session questionnaires,
recruiting and organizing subjects for the study, and analizing the data
afterwards.
Below I have listed a few examples of our research questions and their resulting hypothesis:
RESEARCH GOALS
1. Will users choose to enter assertions regardless of which group they were in?
2. Will users assertions be useful in turning up the bugs? Will their assertions help with correctness of spreadsheets?
3. What is the quality of the assertions users enter?
4. If users do choose to enter assertions will their assertions impact or improve percent testedness?
5. What is HMT's role in developing user assertions? Are they
encouraging the user to enter in their own assertions instead of using
what HMT asserts? (which assertions are users using? HMT assertions
or their own?)
OUR HYPOTHESES
1.There will be no significant difference between the number of user assertions entered in the HMT Assertions group verses the no HMT Assertions group. (or any other group)
2.
i) There will be no significant difference between the debugging score
of the
a) HMT Assertions group verses the no HMT Assertions group.
b) people in the HMT Assertions group who edited at least one assertion
verses the people in the no HMT Assertions group who put on at least one
assertion.
c) people in any of the studies with at least one user assertion verses
people in any of the studies with no user assertions.
ii) There will be no significant difference between the rate HMT Assertions
subjects and the no HMT Assertions subjects do the following:
for each stimulus of the type wrong assertion or a red circle the subjects
edit a formula or an assertion to remove the stimulus.
(note: what percent of stimuli were HMT Assertions?)
iii) There will be no significant difference in understanding guards
(determined from post-session questionnaire) with the:
a) HMT Assertions group verses the no HMT Assertions group.
b) people in the HMT Assertions group who edited at least one assertion
verses the people in the no HMT Assertions group who put on at least one
assertion.
c) HMT Assertions group verses Omkar's Assertions group
d) No HMT Assertions group verses Omkar's Assertions group
3.There will be no significant difference in the quality of assertions that both HMT Assertions group and no HMT Assertions group come up with.
4. There will be no significant difference between the percent testedness
of the
a) HMT Assertions group verses the no HMT Assertions group.
b) people in the HMT Assertions group who edited at least one assertion
verses the people in the no HMT Assertions group who put on at least one
assertion.
c) people in any of the studies with at least one user assertion verses
people in any of the studies with no user assertions.
| about me | mentor | research | journal | final report | summer fun | me and my roommate |