Presentation is loading. Please wait.

Presentation is loading. Please wait.

SimStudent: A computational model of learning for Intelligent Authoring and beyond Noboru Matsuda Human-Computer Interaction Institute Carnegie Mellon.

Published bySabrina Short Modified over 8 years ago

Similar presentations

Presentation on theme: "SimStudent: A computational model of learning for Intelligent Authoring and beyond Noboru Matsuda Human-Computer Interaction Institute Carnegie Mellon."— Presentation transcript:

1 SimStudent: A computational model of learning for Intelligent Authoring and beyond Noboru Matsuda Human-Computer Interaction Institute Carnegie Mellon University

2 SimStudent Project PSLC Summer School 2010 :: SimStudent Demo :: Noboru Matsuda (CMU) 2 CTAT: Cognitive Tutor Authoring Tools Example-Tracing Tutor –Zero programming –A cognitive model specific to a particular problem –Limited generalization by editing a behavior graph Model-Tracing Tutor –Requires a cognitive model –Cognitive task analysis is hard –Writing production rules is even more challenging Performing a task is much easier…

3 SimStudent Project PSLC Summer School 2010 :: SimStudent Demo :: Noboru Matsuda (CMU) 3 Next Generation Authoring Build a tutor GUI Teaching a solution SimSt. learning Rule simplify-LHS: IFis-equation( Eq ), is-lhs( Eq, Lhs ), polynomial( Lhs ), all-var-terms( Lhs ) Thensimplify( Lhs, S-lhs ), enter( S-lhs ) Production Rules Rule simplify-LHS: IFis-equation( Eq ), is-lhs( Eq, Lhs ), polynomial( Lhs ), all-var-terms( Lhs ) Thensimplify( Lhs, S-lhs ), enter( S-lhs ) Rule simplify-LHS: IFis-equation( Eq ), is-lhs( Eq, Lhs ), polynomial( Lhs ), all-var-terms( Lhs ) Thensimplify( Lhs, S-lhs ), enter( S-lhs )

4 SimStudent Project PSLC Summer School 2010 :: SimStudent Demo :: Noboru Matsuda (CMU) 4 SimStudent Machine learning agent –Learns problem-solving steps by … –Observes model solutions / solving problems, and … –Outputs a set of production rules Fundamental technology –Programming by Demonstration –Inductive Logic Programming Lau & Weld (1998). Blessing (1997).

5 SimStudent Project PSLC Summer School 2010 :: SimStudent Demo :: Noboru Matsuda (CMU) Authoring Strategies Authoring by demonstration –Demonstrate whole solutions –Learning from worked-out examples Demonstrated solutions as positive examples Authoring by tutoring –Interactively tutor with immediate feedback and hint –Learning by tutored problem-solving Learning by generalizing hint with taking feedback into account 5

6 SimStudent Project PSLC Summer School 2010 :: SimStudent Demo :: Noboru Matsuda (CMU) Demo! 6 Authoring by Tutoring

7 SimStudent Project PSLC Summer School 2010 :: SimStudent Demo :: Noboru Matsuda (CMU) Learning Production Rules in 3 parts: What-When-How If among this and that GUI elements such and such constraints hold Then do actions with the GUI elements When What How

8 SimStudent Project PSLC Summer School 2010 :: SimStudent Demo :: Noboru Matsuda (CMU) Production Rule in JESS GUI elements Constraints Actions

9 SimStudent Project PSLC Summer School 2010 :: SimStudent Demo :: Noboru Matsuda (CMU) 9 Background Knowledge Domain concepts to “explain” demonstrations –Operators –Feature predicates External Jess function written in Java (defrule multi-lhs … ?var22140 <- (column (cells ? ? ?var22143 ? ? ? ? ?)) ?var22143 <- (cell (value ?val0&~nil)) (test (fraction-term ?val0 )) => (bind ?val2 (denominator ?val0)) (bind ?input (mul-term-by ?val0 ?val2)) … )

10 SimStudent Project PSLC Summer School 2010 :: SimStudent Demo :: Noboru Matsuda (CMU) 10 Example ： Algebra domain 16 Feature predicates & 28 operators Feature Predicates for LHS conditionsOperators for RHS actions HasCoefficient HasConstTerm HasVarTerm Homogeneous IsFractionTerm IsConstant IsDenominatorOf IsNumeratorOf IsPolynomial Monomial NotNull VarTerm IsSkillAdd IsSkillSubtract IsSkillDivide IsSkillMultiply AddTerm AddTermBy Coefficient CopyTerm Denominator DivTerm DivTermBy EvalArithmetic FirstTerm FirstVarTerm GetOperand InverseTerm LastConstTerm LastTerm LastVarTerm MulTerm MulTermBy Numerator ReverseSign RipCoefficient SkillAdd SkillClt SkillDivide SkillMultiply SkillRf SkillMt SkillSubtract VarName

11 SimStudent Project PSLC Summer School 2010 :: SimStudent Demo :: Noboru Matsuda (CMU) 11 Learning Results # of training tasks % Correct rule firings (10 test tasks) Authoring by tutoring Authoring by demonstration Better than

12 SimStudent Project PSLC Summer School 2010 :: SimStudent Demo :: Noboru Matsuda (CMU) 12 Authoring Time Authoring by Tutoring Authoring by Demonstration Authoring by tutoring took 86 minutes Authoring by demonstration took 238 minutes A 2.8x speed-up!

13 SimStudent Project PSLC Summer School 2010 :: SimStudent Demo :: Noboru Matsuda (CMU) 13 Example: Stoichiometry Tutor

14 SimStudent Project PSLC Summer School 2010 :: SimStudent Demo :: Noboru Matsuda (CMU) SimStudent Projects Intelligent Authoring –Building a Cognitive Tutor as a CTAT Plug-in Student Modeling and Simulation –Controlled educational studies –Error formation study –Prerequisite conceptual knowledge study Teachable Peer Learner –Learning by teaching 14

15 SimStudent Project PSLC Summer School 2010 :: SimStudent Demo :: Noboru Matsuda (CMU) SimStudent Projects Intelligent Authoring –Building a Cognitive Tutor as a CTAT Plug-in Student Modeling and Simulation –Controlled educational studies –Error formation study –Prerequisite conceptual knowledge study Teachable Peer Learner –Learning by teaching 15

16 SimStudent Project PSLC Summer School 2010 :: SimStudent Demo :: Noboru Matsuda (CMU) Model of Incorrect Learning Identify errors students commonly make Weaken SimStudent’s background knowledge Let SimStudent make an induction error 16

17 SimStudent Project PSLC Summer School 2010 :: SimStudent Demo :: Noboru Matsuda (CMU) Weak Prior Knowledge Hypothesis Multiple ways to make sense of examples 17 3x=5 “divide by 3” Get a coefficient and divide Get a number and divide Get a denominator and multiply 4/x=5 strong prior knowledge weak prior knowledge “divide by 4” “multiply by x”

18 SimStudent Project PSLC Summer School 2010 :: SimStudent Demo :: Noboru Matsuda (CMU) Target Common Errors 18

19 SimStudent Project PSLC Summer School 2010 :: SimStudent Demo :: Noboru Matsuda (CMU) Results: Learning Rate Steps Score = 0 (if there is no rule applicable) # correct rule applications / # all rule applications # training problems Step Score

20 SimStudent Project PSLC Summer School 2010 :: SimStudent Demo :: Noboru Matsuda (CMU) SimStudent Projects Intelligent Authoring –Building a Cognitive Tutor as a CTAT Plug-in Student Modeling and Simulation –Controlled educational studies –Error formation study –Prerequisite conceptual knowledge study Teachable Peer Learner –Learning by teaching 20

21 SimStudent Project PSLC Summer School 2010 :: SimStudent Demo :: Noboru Matsuda (CMU) Learning by Teaching SimStudent

22 SimStudent Project PSLC Summer School 2010 :: SimStudent Demo :: Noboru Matsuda (CMU) Demo! 22 Learning by Teaching

23 SimStudent Project PSLC Summer School 2010 :: SimStudent Demo :: Noboru Matsuda (CMU) Learn more about SimStudents Project Web –www.SimStudent.org Download & Tutorial –http://ctat.pact.cs.cmu.edu (linked from project web) Contact us! –mazda@cs.cmu.edu 23

Download ppt "SimStudent: A computational model of learning for Intelligent Authoring and beyond Noboru Matsuda Human-Computer Interaction Institute Carnegie Mellon."

Similar presentations

Polynomial Inequalities in One Variable

Polynomial Inequalities in One Variable
What can CTAT do for you? Overview of the CTAT track Vincent Aleven, Bruce McLaren and the CTAT team 3rd Annual PSLC LearnLab Summer School Pittsburgh,

What can CTAT do for you? Overview of the CTAT track Vincent Aleven, Bruce McLaren and the CTAT team 3rd Annual PSLC LearnLab Summer School Pittsburgh,
The Network of Dynamic Learning Communities C 107 F N Increasing Rigor February 5, 2011.

The Network of Dynamic Learning Communities C 107 F N Increasing Rigor February 5, 2011.
Educational data mining overview & Introduction to Exploratory Data Analysis Ken Koedinger CMU Director of PSLC Professor of Human-Computer Interaction.

Educational data mining overview & Introduction to Exploratory Data Analysis Ken Koedinger CMU Director of PSLC Professor of Human-Computer Interaction.
* is a cluster of specific instructional strategies that involve students working collaboratively to reach common goals;

* is a cluster of specific instructional strategies that involve students working collaboratively to reach common goals;
Collaborative Warrior Tutoring Tom Livak Neil Heffernan 8/24/06.

Collaborative Warrior Tutoring Tom Livak Neil Heffernan 8/24/06.
WHERE ARE THE COOKIES? A presentation by Jessica Hill.

WHERE ARE THE COOKIES? A presentation by Jessica Hill.
An Individualized Web-Based Algebra Tutor D.Sklavakis & I. Refanidis 1 An Individualized Web-Based Algebra Tutor Based on Dynamic Deep Model Tracing Dimitrios.

An Individualized Web-Based Algebra Tutor D.Sklavakis & I. Refanidis 1 An Individualized Web-Based Algebra Tutor Based on Dynamic Deep Model Tracing Dimitrios.
Supporting (aspects of) self- directed learning with Cognitive Tutors Ken Koedinger CMU Director of Pittsburgh Science of Learning Center Human-Computer.

Supporting (aspects of) self- directed learning with Cognitive Tutors Ken Koedinger CMU Director of Pittsburgh Science of Learning Center Human-Computer.
Fostering Algebraic Thinking October 26  December 2  6-hour Assignment after Session 2  January 20 Presented by: Janna Smith

Fostering Algebraic Thinking October 26  December 2  6-hour Assignment after Session 2  January 20 Presented by: Janna Smith
Learning from Observations Copyright, 1996 © Dale Carnegie & Associates, Inc. Chapter 18 Spring 2004.

Learning from Observations Copyright, 1996 © Dale Carnegie & Associates, Inc. Chapter 18 Spring 2004.
A C OMPUTATIONAL M ODEL OF A CCELERATED F UTURE L EARNING THROUGH F EATURE R ECOGNITION Nan Li Computer Science Department Carnegie Mellon University Building.

A C OMPUTATIONAL M ODEL OF A CCELERATED F UTURE L EARNING THROUGH F EATURE R ECOGNITION Nan Li Computer Science Department Carnegie Mellon University Building.
Projects March 29, 2006. Project Requirements Think Aloud –At least two people OR Difficulty Factors Assessment –Ideally >25 (at least one class), but.

Projects March 29, Project Requirements Think Aloud –At least two people OR Difficulty Factors Assessment –Ideally >25 (at least one class), but.
LEARNING FROM OBSERVATIONS Yılmaz KILIÇASLAN. Definition Learning takes place as the agent observes its interactions with the world and its own decision-making.

LEARNING FROM OBSERVATIONS Yılmaz KILIÇASLAN. Definition Learning takes place as the agent observes its interactions with the world and its own decision-making.
Relational Data Mining in Finance Haonan Zhang CFWin03-37 03/04/2003.

Relational Data Mining in Finance Haonan Zhang CFWin /04/2003.
1 Learning from Behavior Performances vs Abstract Behavior Descriptions Tolga Konik University of Michigan.

1 Learning from Behavior Performances vs Abstract Behavior Descriptions Tolga Konik University of Michigan.
Toward the extraction of production rules for solving logic proofs Tiffany Barnes, John Stamper Computer Science.

Toward the extraction of production rules for solving logic proofs Tiffany Barnes, John Stamper Computer Science.
Our Explorations with CTAT!

Our Explorations with CTAT!
B EAUCLERC E LEMENTARY S CHOOL Florida Standards Assessments.

B EAUCLERC E LEMENTARY S CHOOL Florida Standards Assessments.
7.6 Function Operations. Review: What is a function? A relationship where every domain (x value has exactly one unique range (y value). Sometimes we talk.

7.6 Function Operations. Review: What is a function? A relationship where every domain (x value has exactly one unique range (y value). Sometimes we talk.

Similar presentations

Ads by Google