PEDAGOGICAL EXPERIMENT 1
Pre/Post Test Results Conceptual Questions  Procedural Questions Conceptual Questions  Procedural Questions Conceptual Questions  Procedural Questions
PreTest PostTest Difference Pretest Posttest Difference Pretest Pretest Posttest Posttest Difference Difference
1 2 3 4   1 2 3 4   1 2 3 4 1 2a 3a 4a 4c 4d(part1) Total 2b 3b 4b 4d(part2) Total 1 2a 3a 4a 4c 4d(part1) Total 2b 3b 4b 4d(part2) Total 1 2a 3a 4a 4c 4d(part1) Total 2b 3b 4b 4d(part2) Total
/4 /3 /3 /9   /4 /3 /3 /9           /4 /1 /1 /1 /1 /1 /9 /2 /2 /2 /4 /10 /4 /1 /1 /1 /1 /1 /9 /2 /2 /2 /4 /10 /4 /1 /1 /1 /1 /1 /9 /2 /2 /2 /4 /10
Applet Users                                    
Participant 1 (M) 16 19 3 4 3 1 8   4 3 3 9   0 0 2 1 4 1 1 1 1 1 9 2 0 1 4 7 4 1 1 1 1 1 9 2 2 2 4 10 0 0 0 0 0 0 0 0 2 1 0 3
Participant 2 (F) 3 13.5 10.5 2 1 0 0   2.5 1 3 7   0.5 0 3 7 2 1 0 0 0 0 3 0 0 0 0 0 2.5 1 1 0 1 1 6.5 0 2 1 4 7 0.5 0 1 0 1 1 3.5 0 2 1 4 7
Participant 3 (F) 14 14 0 2 3 3 6   0 3 3 8   -2 0 0 2 2 1 1 1 0 0 5 2 2 2 3 9 0 1 1 1 1 0 4 2 2 2 4 10 -2 0 0 0 1 0 -1 0 0 0 1 1
Participant 4 (M) 13 15 2 2 1 2 8   3 1 3 8   1 0 1 0 2 1 0 1 1 1 6 0 2 1 4 7 3 1 1 1 1 1 8 0 2 1 4 7 1 0 1 0 0 0 2 0 0 0 0 0
Participant 5 (M) 6 14 8 2 0 3 1   3 3 0 8   1 3 -3 7 2 0 1 1 0 0 4 0 2 0 0 2 3 1 0 1 1 0 6 2 0 2 4 8 1 1 -1 0 1 0 2 2 -2 2 4 6
Participant 6 (F) 10 18 8 3 1 3 3   3 3 3 9   0 2 0 6 3 1 1 1 0 0 6 0 2 2 0 4 3 1 1 1 1 1 8 2 2 2 4 10 0 0 0 0 1 1 2 2 0 0 4 6
Participant 7 (M) 7.5 10 2.5 2.5 1 3 1   3 3 3 1   0.5 2 0 0 2.5 1 1 1 0 0 5.5 0 2 0 0 2 3 1 1 1 0 0 6 2 2 0 0 4 0.5 0 0 0 0 0 0.5 2 0 0 0 2
Participant 8 (M) 8 12.5 4.5 2 1 3 2   1 1 3 7.5   -1 0 0 5.5 2 1 1 1 1 0 6 0 2 0 0 2 1 1 1 1 1 0.5 5.5 0 2 1 4 7 -1 0 0 0 0 0.5 -0.5 0 0 1 4 5
Participant 9 (M) 17.5 18 0.5 2.5 3 3 9   3 3 3 9   0.5 0 0 0 2.5 1 1 1 1 1 7.5 2 2 2 4 10 3 1 1 1 1 1 8 2 2 2 4 10 0.5 0 0 0 0 0 0.5 0 0 0 0 0
Participant 10 (F) 15 18 3 4 1 3 7   4 3 3 8   0 2 0 1 4 1 1 1 1 0 8 0 2 1 4 7 4 1 1 1 1 0 8 2 2 2 4 10 0 0 0 0 0 0 0 2 0 1 0 3
Non-Applet Users
Participant 11 (F) 10 16 6 3 1 3 3   3 3 3 7   0 2 0 4 3 1 1 1 1 0 7 0 2 1 0 3 3 1 1 1 1 0 7 2 2 1 4 9 0 0 0 0 0 0 0 2 0 0 4 6
Participant 12 (M) 9.5 13 3.5 2.5 1 3 3   3 3 3 4   0.5 2 0 1 2.5 1 1 1 1 0 6.5 0 2 1 0 3 3 1 1 1 1 0 7 2 2 2 0 6 0.5 0 0 0 0 0 0.5 2 0 1 0 3
Participant 13 (F) 19 19 0 4 3 3 9   4 3 3 9   0 0 0 0 4 1 1 1 1 1 9 2 2 2 4 10 4 1 1 1 1 1 9 2 2 2 4 10 0 0 0 0 0 0 0 0 0 0 0 0
Participant 14 (F) 13 16 3 2 3 2 6   4 3 3 6   2 0 1 0 2 1 0 1 1 1 6 2 2 0 3 7 4 1 1 1 1 1 9 2 2 0 3 7 2 0 1 0 0 0 3 0 0 0 0 0
Participant 15 (M) 5.5 14 8.5 2.5 1 1 1   3 3 3 5   0.5 2 2 4 2.5 1 1 0 1 0 5.5 0 0 0 0 0 3 1 1 1 1 1 8 2 2 2 0 6 0.5 0 0 1 0 1 2.5 2 2 2 0 6
Participant 16 (M) 10 12 2 2 2 3 3   3 3 3 3   1 1 0 0 2 1 1 1 1 0 6 1 2 1 0 4 3 1 1 1 1 0 7 2 2 1 0 5 1 0 0 0 0 0 1 1 0 0 0 1
Participant 17 (F) 9.5 12 2.5 3 2 1 3.5   2.5 0 3 6.5   -0.5 -2 2 3 3 1 1 1 1 0.5 7.5 1 0 1 0 2 2.5 0 1 1 1 0.5 6 0 2 0 4 6 -0.5 -1 0 0 0 0 -1.5 -1 2 -1 4 4
Participant 18 (M) 7.5 13 5.5 2.5 1 3 1   3 3 3 4   0.5 2 0 3 2.5 1 1 1 0 0 5.5 0 2 0 0 2 3 1 1 1 1 0 7 2 2 1 1 6 0.5 0 0 0 1 0 1.5 2 0 1 1 4
Participant 19 (M) 7 17 10 4 0 3 0   4 3 3 7   0 3 0 7 4 0 1 0 0 0 5 0 2 0 0 2 4 1 1 1 1 1 9 2 2 0 4 8 0 1 0 1 1 1 4 2 0 0 4 6
Questionnaire 1=more than enough, 2=enough, 3=barely enough, 4= not enough 1=less than 5 mins, 2=5-10mins, 3=10-20mins, 4=20-30mins, 5=over 30 mins
Rate Confidence Level Statements 5=Agree, 4=Somewhat Agree, 3= Neutral, 2=Somewhat Disagree, 1= Disagree Time Time
Variables Variable Domains Constraints CSP Def'n of Arc Consistency AC-3 Domain Splitting Backtracking Applet Helped Book Alone would have been enough Difficult to follow applet Looking at sample prob would have helped more Time to Read the book Time to Study Sample problems Time to figure out applet's interface
Applet Users
Participant 1 (M) 5 5 5 5 5 5 5 5 5 4 3 1 2 2 1
Participant 2 (F) 5 5 5 4 3 2 5 5 5 1 1 1 1 2 1
Participant 3 (F) 5 5 5 5 4 4 5 4 4 3 1 2 1 1 1
Participant 4 (M) 4 3 4   3 4 4 3 5 2 4 3 3 3 2
Participant 5 (M) 5 5 5 5 5 3 4 4 5 1 1 2 1 1 1
Participant 6 (F) 5 5 5 5 5 3 5 3 5 2 1 1 2 1 1
Participant 7 (M) 4 4 4 3 2 2 1 1 5 2 2 1 1 2 1
Participant 8 (M) 5 5 5 5 5 3 3 1 5 4 4 1 1 1 2
Participant 9 (M) 5 5 5 5 4 4 4 4 5 2 1 2 2 1 2
Participant 10 (F) 4 5 4 4 3 5 4 4 5 3 2 4 2 3 2
Non-Applet Users Samples Helped Book Alone would have been enough Difficult to follow samples Watching CSP change would have helped more
Participant 11 (F) 5 5 4 4 4 3 3 2 5 2 3 2 1 2
Participant 12 (M) 4 5 5 4 3 3 2 2 5 1 4 5 2 3
Participant 13 (F) 5 5 5 5 5 4 5 4 5 4 2 1 2 1
Participant 14 (F) 5 5 5 5 4 4 5 4 5 4 1 2 1 1
Participant 15 (M) 4 4 5 5 5 5 4 3 5 2 1 1 1 1
Participant 16 (M) 4 4 4 3 3 3 2 4 4 1 3 5 2 2
Participant 17 (F) 4 4 4 4 3 4 3 3 5 2 3 5 2 2
Participant 18 (M) 3 3 4 5 5 3 3 4 5 2 4 3 2 2
Participant 19 (M) 5 5 5 5 3 5 5 4 5 3 1 3 3 2