Course Schedule
Advanced Methods and Analysis for the Learning and Social Sciences
Spring 2012
Professor Ryan S.J.d. Baker
Thursday, January 12
SPECIAL LOCATION
3pm-4:50pm, Salisbury Laboratories 011
Introduction
Slides [pptx]
Readings
Assignments Due: None
Wednesday, January 18
SPECIAL SESSION
3pm-4:50pm, Atwater Kent 232
Optional Fun Session: An Inappropriately Brief Introduction to Frequentist Statistics
Slides [pptx]
Readings
Assignments Due: None
Monday, January 23
3pm-4:50pm, Atwater Kent 232
Item-Response Theory
Slides [pptx]
Readings
- Baker, F.B. (2001) The Basics of Item Response Theory. Chapters 1,2. [pdf]
Other Files
Assignments Due: None
Wednesday, January 25
3pm-4:50pm, Atwater Kent 232
Performance Factors Analysis
Slides [pptx]
Readings
- Pavlik, P.I., Cen, H., Koedinger, K.R. (2009) Performance Factors Analysis -- A New Alternative to Knowledge Tracing. Proceedings of AIED2009.[pdf]
- Pavlik, P.I., Cen, H., Koedinger, K.R. (2009) Learning Factors Transfer Analysis: Using Learning Curve Analysis to Automatically Generate Domain Models. Proceedings of the 2nd International Conference on Educational Data Mining. [pdf]
Other Files
Assignments Due: None
Monday, January 30
3pm-4:50pm, Atwater Kent 232
Bayesian Knowledge-Tracing
Slides [pptx]
Readings
- Corbett, A.T., Anderson, J.R. (1995) Knowledge Tracing: Modeling the Acquisition of Procedural Knowledge. User Modeling and User-Adapted Interaction, 4, 253-278. [pdf]
- Baker, R.S.J.d., Corbett, A.T., Aleven, V. (2008) More Accurate Student Modeling Through Contextual Estimation of Slip and Guess Probabilities in Bayesian Knowledge Tracing. Proceedings of the 9th International Conference on Intelligent Tutoring Systems, 406-415. [pdf]
Other Files
Assignments Due: 1. PFA and BKT
Wednesday, February 1
3pm-4:50pm, Atwater Kent 232
Diagnostic Metrics: ROC, A', AUC, Precision, Recall, LL, BiC
Slides [pptx]
Readings
- Fogarty, J., Baker, R., Hudson, S. (2005) Case Studies in the use of ROC Curve Analysis for Sensor-Based Estimates in Human Computer Interaction. Proceedings of Graphics Interface (GI 2005), 129-136. [pdf]
- Davis, J., Goadrich, M. (2006) The relationship between Precision-Recall and ROC curves. Proceedings of the 23rd international conference on Machine learning. [pdf]
- Russell, S., Norvig, P. (2010) Artificial Intelligence: A Modern Approach. Ch. 20: Learning Probabilistic Models.
Assignments Due: None
Monday, February 6
3pm-4:50pm, Atwater Kent 232
Knowledge Structure (Q-Matrices, POKS, LFA)
Slides [pptx]
Readings
- Barnes, T. (2005) The Q-matrix Method: Mining Student Response Data for Knowledge. Proceedings of the Workshop on Educational Data Mining at the Annual Meeting of the American Association for Artificial Intelligence.[pdf]
- Desmarais, M.C., Meshkinfam, P., Gagnon, M. (2006) Learned Student Models with Item to Item Knowledge Structures. User Modeling and User-Adapted Interaction, 16, 5, 403-434. [pdf]
- Cen, H., Koedinger, K., Junker, B. (2006) Learning Factors Analysis – A General Method for Cognitive Model Evaluation and Improvement. Proceedings of the International Conference on Intelligent Tutoring Systems, 164-175. [pdf]
Assignments Due: 2. KNOWLEDGE STRUCTURE
Wednesday, February 8
3pm-4:50pm, Atwater Kent 232
Advanced BKT and Learning Decomposition
Slides [pptx]
Readings
- Beck, J.E., Chang, K-m., Mostow, J., Corbett, A. (2008)
Does Help Help? Introducing the Bayesian Evaluation and Assessment Methodology. Proceedings of the International Conference on Intelligent Tutoring Systems. [pdf]
Assignments Due: None
Monday, February 13
3pm-4:50pm, Atwater Kent 232
Classification and Behavior Detection
Slides [pptx]
Readings
- Sao Pedro, M.A., Baker, R.S.J.d., Gobert, J., Montalvo, O. Nakama, A. (in press) Leveraging Machine-Learned Detectors of Systematic Inquiry Behavior to Estimate and Predict Transfer of Inquiry Skill. To appear in User Modeling and User-Adapted Interaction. [pdf]
- Baker, R.S.J.d., Corbett, A.T., Roll, I., Koedinger, K.R. (2008) Developing a Generalizable Detector of When Students Game the System. User Modeling and User-Adapted Interaction, 18, 3, 287-314. [pdf]
Other Files
- Ryan modified data file [csv]
- Ryan RapidMiner xml file [xml]
Assignments Due: 3. BEHAVIOR DETECTION
Wednesday, February 15
3pm-4:50pm, Atwater Kent 232
Special Guest Lecture: Sujith Gowda
Feature engineering and feature distillation
Slides [pptx]
Readings
Assignments Due: 4. FEATURE ENGINEERING
Monday, February 20
Class Cancelled
Readings
Assignments Due: 4. FEATURE ENGINEERING RESUBMISSION
Wednesday, February 22
3pm-4:50pm, Atwater Kent 232
Meta-analysis/integration of data across contexts
Slides [pptx]
Readings
- Rosenthal, R., Rosnow, R.L. (1991) Essentials of Behaviroal Research: Methods and Data Analysis, 2nd edition. Ch. 22: Meta-Analysis.
Assignments Due: 5. META-ANALYSIS
Monday, February 27
3pm-4:50pm, Atwater Kent 232
Regression and Regressors
Slides [pptx]
Readings
- Ramsey, F.L., Schafer, D.W. (1997) The Statistical Sleuth: A Course in Methods of Data Analysis. Sections 7.2-7.4, 9.2-9.3, 10.2-10.3
- Witten, I.H., Frank, E. (2005)Data Mining: Practical Machine Learning Tools and Techniques. Sections 4.6, 6.5.
Assignments Due: 6. REGRESSION
Wednesday, February 29
3pm-4:50pm, Atwater Kent 232
Learnograms
Special Guest Lecture: Arnon Hershkovitz
Slides [pptx]
No Readings
Assignments Due: None
Monday, March 5
NO CLASS: SPRING BREAK
Wednesday, March 7
NO CLASS: SPRING BREAK
Monday, March 12
3pm-4:50pm, Atwater Kent 232
Factor Analysis
Slides [pptx]
Readings
- Ferguson, G.A. (1971) Statistical Analysis in Psychology and Education (3rd edition). Ch. 27: Factor Analysis.
Assignments Due: None
Wednesday, March 14
3pm-4:50pm, Atwater Kent 232
Clustering
Slides [pptx]
Readings
- Witten, I.H., Frank, E. (2005)Data Mining: Practical Machine Learning Tools and Techniques. Sections 4.8, 6.6.
Assignments Due: 7. CLUSTERING
Friday, March 16
Special Session
3pm-4:50pm, SSPS Conference Room
MOTIF Extraction
Slides [pptx]
Readings
- Lawrence, C.E., Altschul, S.F., Boguski, M.S., Liu, J.S., Neuwald, A.F., Wootton, J.C. (1993) Detecting subtle sequence signals: a Gibbs sampling strategy for multiple alignment. Science, 262 (5131), 208-214. [pdf]
- Shanabrook, D.H., Cooper, D.G., Woolf, B.P., Arroyo, I. (2010)Identifying High-Level Student Behavior Using Sequence-based Motif Discovery. Proceedings of the 3rd International Conference on Educational Data Mining,191-200. [pdf]
Assignments Due: None
Monday, March 19
3pm-4:50pm, Atwater Kent 232
Association Rule Mining
Slides [pptx]
Readings
- Witten, I.H., Frank, E. (2005)Data Mining: Practical Machine Learning Tools and Techniques. Section 4.5.
- Merceron, A., Yacef, K. (2008) Interestingness Measures for Association Rules in Educational Data. Proceedings of the 1st International Conference on Educational Data Mining,57-66. [pdf]
Assignments Due: None
Wednesday, March 21
Class Cancelled
Readings
Assignments Due: None
Monday, March 26
3pm-4:50pm, Atwater Kent 232
Sequential Pattern Mining
Slides [pptx]
Readings
- Srikant, R., Agrawal, R. (1996) Mining Sequential Patterns: Generalizations and Performance Improvements. Research Report: IBM Research Division. San Jose, CA: IBM. [pdf]
- Perera, D., Kay, J., Koprinska, I., Yacef, K., Zaiane, O. (2009)
Clustering and Sequential Pattern Mining of
Online Collaborative Learning Data. IEEE Transactions on Knowledge and Data Engineering, 21, 759-772 [pdf]
Assignments Due: 8. SEQUENTIAL PATTERN MINING
Wednesday, March 28
Class cancelled due to GRAD DAY
Monday, April 2
3pm-4:50pm, Atwater Kent 232
Learning Curves
Slides [pptx]
Readings
- Martin, B., Mitrovic, A., Koedinger, K.R., Mathan, S. (2011) Evaluating and improving adaptive educational systems with learning curves. User Modeling and User-Adapted Interaction, 21 (3), 249-283 [pdf]
Assignments Due: None
Wednesday, April 4
3pm-4:50pm, Atwater Kent 232
Discovery with Models
Slides [pptx]
Readings
- Baker, R.S.J.d., Gowda, S.M. (2010) An Analysis of the Differences in the Frequency of Students' Disengagement in Urban, Rural, and Suburban High Schools. Proceedings of the 3rd International Conference on Educational Data Mining, 11-20. [pdf]
Assignments Due: None
Monday, April 9
3pm-4:50pm, Atwater Kent 232
Missing data and Imputation
Slides [pptx]
Additional Materials [xlsx]
Readings
- Schafer, J.L., Graham, J.W. (2002) Missing Data: Our View of the State of the Art. Psychological Methods, 7 (2), 147-177 [pdf]
Assignments Due: 9. IMPUTATION
Wednesday, April 11
3pm-4:50pm, Atwater Kent 232
Power Analysis
Slides [pptx]
Additional Materials [xlsx]
Readings
- Lachin, J.M. (1981) Introduction to Sample Size Determination
and Power Analysis for Clinical Trials Controlled Clinical Trials,2,93-113.[pdf]
- Cohen, J. (1992) A Power Primer. Psychological Bulletin , 112 (1), 155-159. [pdf]
Assignments Due: None
Monday, April 16
CLASS CANCELLED: PATRIOTS DAY
Wednesday, April 18
3pm-4:50pm, Atwater Kent 232
Post-hoc Adjustments
Slides [pptx]
Additional Materials [xlsx]
Readings
- Rosenthal, R., Rosnow, R.L. (1991) Essentials of Behavioral Research: Methods and Data Analysis, 2nd edition. p. 329-333.
- Verhoven, K.J.F., Simonsen, K.L., McIntyre, L.M. (2005)Implementing false
discovery rate control: increasing your power. Oikos, 108, 643-647. [pdf]
Assignments Due: 10. POST-HOC
Monday, April 23
CLASS RESCHEDULED: SEE BELOW
Wednesday, April 25
3pm-4:50pm, Atwater Kent 232
Social Network Analysis
Slides [pptx]
Readings
- Haythornthwaite, C. (2001) Exploring Multiplexity: Social Network Structures in a Computer-Supported Distance Learning Class. The Information Society: An International Journal, 17 (3), 211-226[pdf]
- Dawson, S. (2008) A study of the relationship between student social networks and sense of community. Educational Technology & Society, 11(3),224-238. [pdf]
Assignments Due: None
Thursday, April 26
3pm-4:50pm, Campus Center Peterson Room
Frequentist Statistics not Covered in 21st Century Textbooks
Slides [pptx]
Readings
- Ferguson, G.A. (1971) Statistical Analysis in Psychology and Education (3rd edition). p. 160-172, 321-346, 390-403.
Assignments Due: None
Monday, April 30
3pm-4:50pm, Atwater Kent 232
Ensemble Selection Methods
Special Guest Lecture: Zachary Pardos
Slides [pptx]
Readings
- Caruana, R., Niculescu-Mizil, A., Crew, G., Ksikes, A. (2004) Ensemble selection from libraries of models. Proceedings of the twenty first International Conference on Machine Learning. [pdf]
- Pardos, Z.A., Baker, R.S.J.d., Gowda, S.M., Heffernan, N.T. (in press) The Sum is Greater than the Parts: Ensembling Models of Student Knowledge in Educational Software. To appear in SIGKDD Explorations. [pdf]
Assignments Due: None