1. Simple Sequencing Part 2
Neil Cramer, Manager Instructional Systems Northwest Airlines

2. Overview Review of Basics IMS Sequencing Models Use Case Resources
Definition and Tracking
Process
Utilities
Use Case
Resources

3. What is Simple Sequencing?
A method for representing the intended behavior of an authored learning experience
Any sequencing engine (e.g. LMS) can provide consistent sequencing of learning activities
Based on properties and conditional rules
Controls the launching of activities and access to learning resources
The manifestation of an instructional strategy

4. What Simple Sequencing is Not
AI based sequencing
Schedule based sequencing
Sequencing requiring data from closed systems and services (e.g. embedded simulations)
Collaborative learning
Customized learning
Synchronization between multiple parallel learning activities
Does not recognize activities of instructors, mentors, peers, etc.

5. Relation to Content Packaging
Simple sequencing is based on the organization and structure of the Content Packaging Model
Simple Sequencing does not require Content Packaging be used
Currently Content Packaging is the only mechanism for exchanging definition instances

6. Overview of Sequencing Process
WAIT
for Navigation Request
(Start, Resume, Choice)
Navigation Event
(Continue, Previous, Choice, Exit, etc.)
Sequencing Process
Navigation Behavior
Termination Request
Termination Behavior
Rollup Behavior
Sequencing Request
Sequencing Behavior
LMS
Delivery Request
Delivery Behavior

7. Activity Tree Course Lesson 1 Lesson 2 Lesson 3 Module 1 Module 1
Topic 1
Topic 2
Module 4

8. Components of Sequencing
Sequencing Definition Model
Tracking Model
Activity State Model
Navigation Behavior Model
Termination Behavior Model
Rollup Behavior Model
Selection and Randomization Behavior Model
Sequencing Behavior Model
Delivery Behavior Model
Utility Processes

9. Sequencing Definition Model
The intended sequence and interaction with learning activities is described by these attributes:
Sequencing Control Modes
Sequencing Rules
Limit Conditions
Rollup Rules
Objectives
Objective Map
Rollup Controls
Selection Controls
Randomization Controls
Delivery Controls

10. Sequencing Control Modes
Type of sequencing behavior applied to a learning activity
Optional (defaults may be assumed)
Not exclusive; multiple control modes may be specified

11. Control Modes Choice Choice Exit Flow Forward Only
Use Current Attempt Objective Information
Use Current Attempt Progress Information

12. Sequencing Rule
Specifies details of rule-based behaviors for an activity
Sequencing process may reference any rule(s) in the activity tree
Any activity may have multiple rules (or none) or multiple conditions with Boolean logic applied
Each condition references one objective in the Tracking model for the activity
One action results when the rule conditions evaluate to true

13. Rule Attributes Condition Combination Rule Conditions Rule Action
How rule conditions are combined (any, all)
Rule Conditions
One or more
Rule Action
Desired sequencing behavior if condition(s) met
Precondition actions
Post condition actions
Exit actions

14. Rule Conditions Satisfied Objective Status Known
Objective Measure Known
Objective Measure Greater Than
Objective Measure Less Than
Completed
Activity Progress Known
Attempted
Attempt Limit Exceeded
Time Limit Exceeded
Outside Available Time Range
Always

15. Additional Attributes
Rule Condition Referenced Objective
Rule Condition Measure Threshold
Rule Condition Operator

16. Precondition Actions Skip Disabled Hidden from Choice
Stop Forward Traversal
Ignore

17. Post Condition Actions
Exit Parent
Exit All
Retry
Retry All
Continue
Previous
Ignore

18. Exit Actions
Exit
Ignore

19. Limit Conditions Define the constraints on access to an activity
Can be assigned to any (or none) of the activities in the tree

20. Limit Conditions Attempt Control Attempt Limit
Attempt Absolute Duration Control
Attempt Absolute Duration Control Limit
Attempt Experienced Duration Control
Attempt Experienced Duration Control Limit
Activity Absolute Duration Control
Activity Absolute Duration Control Limit
Activity Experienced Duration Control
Activity Experienced Duration Control Limit
Begin Time Limit Control
Begin Time Limit
End Time Limit Control
End Time Limit

21. Auxiliary Resource
Defines auxiliary resource associated with an activity
When activity is available auxiliary resource(s) are available
Sequencing process many reference any (or no) auxiliary resources in the activity tree

22. Auxiliary Resource Attributes
Resource ID
Purpose (open vocabulary)

23. Rollup Rule
Define how child activities influence Objective and Activity/Attempt Progress information in the Tracking model
Sequencing process many reference any (or no) rollup rules in the activity tree
Activities may have multiple (or no) rollup rules and/or conditions with Boolean logic
Each condition references an item in the Tracking model
There is one action that may result when the conditions evaluate to True
May set Attempt Completion Status or Objective Satisfied Status

24. Rollup Rule Attributes
Rollup Child Activity Set
All, Any, None, At Least Count (Rollup Minimum Count), At Least Percent (Rollup Minimum Percent)
Condition Combination (all, any)
Conditions/Condition Operator
Rollup Action

25. Rollup Conditions Satisfied Objective Status Known
Objective Measure Known
Completed
Activity Progress Known
Attempted
Attempt Limit Exceeded
Time Limit Exceeded
Outside Available Time Range
Never

26. Rollup Action
Satisfied – Objective Progress Status set to True and Objective Satisfied Status set to True
Not Satisfied – Objective Progress Status set to True and Objective Satisfied Status set to False
Completed – Attempt Progress Status set to True and Attempt Completion Status set to True
Incomplete – Attempt Progress Status set to True and Attempt Completion Status set to False

27. Objectives Defines the learning objectives associated with an activity
Activities may have an unlimited number of objectives
Tracking model defines the set of data that records satisfaction status and measures for each objective for each attempt on the activity
Sequencing process may reference any local objective for an activity
Objective Map allows process to reference global objectives
Activity must have at least one objective
Activity may have only one objective that contributes to rollup

28. Objective Attributes Objective ID Objective Satisfied by Measure
Objective Minimum Satisfied Normalized Measure (-1 to 1)
Objective Contributes to Rollup

29. Objective Map
Defines mapping of local objective to and from shared global objective
Activities can have unlimited number of objectives maps
Objective map is evaluated whenever local objectives are evaluated as determined in the Tracking model
Read map (local) and write map (global) tied to one objective

30. Objective Map Attributes
Activity Objective ID
Target Objective ID
Read Objective Satisfied Status
Write Objective Satisfied Status
Read Objective Normalized Measure
Write Objective Normalized Measure

31. Rollup Controls
The definition of rollup behavior when Objective Contributes to Rollup is True
Rollup Objective Satisfied
Rollup Objective Measure Weight
Rollup Progress Completion

32. Selection Controls
Description of how Child activities should be selected in the sequencing process
Selection Timing – Never, Once, On Each New Attempt
Selection Count Status (True/False)
Selection Count – how many must be selected

33. Randomization Controls
Determines how Child activities are ordered during the sequencing process
Randomization Timing – Never, Once, On Each New Attempt
Randomization Children (True/False)

34. Delivery Controls
Describe actions and controls used when an activity is delivered
Objective, Activity, and Attempt Progress Data are recorded on delivery
Tracked (True/False)
Completion Set by Content (True/False)
Objective Set by Content (True/False)

35. Tracking Model
Describes the results of learner interaction with activities
Information Model
Objective Progress Information
Activity/Attempt

36. Objective Progress Information
The results of learner interactions relative to an objective
Objective Progress Status
Objective Satisfied Status
Objective Measure Status
Objective Normalized Measure

37. Activity Progress Information
Activity Progress Status
Activity Absolute Duration
Activity Experienced Duration
Activity Attempt Count

38. Activity Duration Tracking
TIME
Begin
Resume
Resume
Attempt 1
Attempt 2
Attempt 3
Terminate w/ Suspend
Terminate w/ Suspend
Terminate
Activity + +
Activity Experienced Duration
Activity Absolute Duration

39. Attempt Progress Information
Attempt Progress Status
Attempt Completion Amount (0…1)
Attempt Completion Status
Attempt Absolute Duration
Attempt Experienced Duration

40. Activity State Model
Describe the state of learner interaction with activities
Do not reference any specific sequencing definition or rule
Control the overall sequencing process
Information Model
Activity State Information
Global State Information

41. Activity State Information
Describes a learner’s state or status in an activity
Activity is Active
Activity is Suspended
Available Children

42. Global State Information
Describes the learner’s state or status within the overall sequenced learning experience
Current Activity
Suspended Activity

43. Overall Process
Combines and relates other models to produce a complete sequenced learning experience
Navigation Behavior Model/Process
Termination Behavior Model/Process
Selection and Randomization Behavior Model/Process
Sequencing Behavior Model/Process
Delivery Behavior Model/Process

44. Navigation Event Source
Overall Process Flow
Navigation Event Source
Overall Process
Navigation Behavior
Termination Behavior
Rollup Behavior
Sequencing Behavior
Delivery Behavior
Navigation Request
Navigation event is translated into navigation request
Possible Termination Request and/or Sequencing Request
Termination Request
Invoke Rollup
Possible Sequencing Request
Sequencing Request
Possible Delivery Request
Delivery Request
Content Delivery
Possible Identification of Learning Resources

45. Navigation Behavior Model
Learner interactions and choices are navigation events that generate navigation requests
Navigation requests map to termination requests and to sequencing requests
Navigation process uses data from the Sequencing Definition model and Activity State model but not from the Tracking model

46. Navigation Requests Start Resume All Continue Previous Forward
Backward
Choice
Exit
Exit All
Suspend All
Abandon
Abandon All

47. Termination Behavior Model
Process of evaluating exit actions and post condition sequencing rules, recording information about the state of an activity, and terminating other activities based on sequencing behaviors
Uses sequencing rule definitions, tracking information (objective/progress), and activity state information
Triggers Rollup process

48. Termination Requests
Exit
Exit All
Suspend All
Abandon
Abandon All

49. Rollup Behavior Model
Process of determining the result data for an activity from the result data of child activities
Applied to the Tracking model
Controlled by parts of the Sequencing Definition model
Rollup Controls
Rollup Rule Definitions
Objective Description
Delivery Controls

50. Measure Rollup Process
Determines and computes the normalized measure for the objective that is tied to the activity (children)
Controlled by Rollup Objective Measure Weight and Delivery Control value Tracked

51. Objective Rollup Process
Determines the status of the objective associated with an activity from the values of objective information associated with the children of the activity
Controlled by Rollup control Rollup Objective Satisfied Status and the Rollup rules
Applies, in order, Measure-based computation, Rule-based computation, and Default Rule-based computation

52. Activity Progress Rollup Process
Determines the completion status of the current attempt on an activity from the completion status of the children of the activity
Defined by a Rule-based computation or Default Rule-based computation

53. Selection and Randomization Behavior Model
Determines how elements of the activity tree are ordered and selected during the sequencing process
Process operates on activities at any level that have children
Selection and Randomization persist as long as activity (or children) are active (even if suspended)
Process controlled by Selection controls and Randomization controls from the Sequencing Definition Model and Activity State information
Child activities are selected and/or randomized prior to selecting the activity to be delivered

54. Sequencing Behavior Model
Determines the content object to deliver (or error) upon receiving a sequencing request
Controlled by Sequencing Control Modes, Sequencing Rule Definitions, Limit Conditions, Objective Description
Uses information from the Tracking and Activity State models

55. Sequencing Processes Rule Check Process Check Activity Process
Flow Subprocesses
Choice
Start
Resume
Continue
Previous
Retry
Exit

56. Delivery Behavior Model
Determines what content and/or auxiliary resources should be delivered to the user
Determines whether the activity may be delivered
Initiates the content delivery
Updates appropriate components of the Tracking and Activity State models

57. Utility Processes Limit Conditions Check Process
Sequencing Rules Check Process
Terminate Descendant Attempts Process
End Attempt Process

58. Boeing Fuel Valve Removal Use Case
Part of maintenance tech curriculum
Removal of fuel valve for service
Removal of appropriate door and the fuel quantity transmitter to access valve
Introduction block, lesson block, access to Interactive Electronic Technical Manual (IETM), Test block

59. Course Structure Fuel Valve Introduction Fuel Valve Lessons Tests IETM
Each block must be completed before the next block is available
Upon completion of first block only first two items of second block are enabled. Student can taken them in any order
Must complete first two before proceeding to third lesson
Must take third lesson in order. IETM is available at any time
Tests enabled only after completion of lessons
If test is failed remediate back to that lesson then take test a second time
If test is passed move to second part of test
If test is failed again student is remediated again and fails course
On completion of first test student moves to simulation test
Student must perform correct steps in order within time limit
IETM available during performance test
Fuel Valve Lesson Intro
Fuel Valve Theory Of Operation
Fuel Valve Lessons
Fuel Valve and Quantity Transmitter Components
Fuel System Hazards
Fuel Valve Removal Procedure
Preparation
Remove Door
Remove Transmitter
Remove Valve
Tests
Knowledge Test
Fuel System Components
Fuel System Hazards
Performance Test (simulation)
IETM
Removal Simulation
Indicates is visible on menu

60. Fuel Valve Introduction Fuel Valve Lessons Tests
Choice
Fuel Valve Introduction
Each block must be completed before the next block is available
Flow
Fuel Valve Lesson Intro
Flow
Fuel Valve Theory Of Operation
Flow
Fuel Valve Lessons
Fuel Valve and Quantity Transmitter Components
Fuel System Hazards
Fuel Valve Removal Procedure
Preparation
Remove Door
Remove Transmitter
Remove Valve
Flow
Tests
Knowledge Test
Fuel System Components
Fuel System Hazards
Performance Test (simulation)
IETM
Removal Simulation
Indicates is visible on menu

61. Fuel Valve Introduction Fuel Valve Lessons Tests
Satisfied
Fuel Valve Introduction
Each block must be completed before the next block is available
Upon completion of first block only first two items of second block are enabled. Student can taken them in any order
Must complete first two before proceeding to third lesson
Fuel Valve Lesson Intro
Fuel Valve Theory Of Operation
Fuel Valve Lessons
Choice
Fuel Valve and Quantity Transmitter Components
Choice
Fuel System Hazards
Flow
Fuel Valve Removal Procedure
Preparation
Remove Door
Remove Transmitter
Remove Valve
Tests
Knowledge Test
Fuel System Components
Fuel System Hazards
Performance Test (simulation)
IETM
Removal Simulation
Indicates is visible on menu

62. Fuel Valve Introduction Fuel Valve Lessons Tests
Each block must be completed before the next block is available
Upon completion of first block only first two items of second block are enabled. Student can taken them in any order
Must complete first two before proceeding to third lesson
Must take third lesson in order. IETM is available at any time
Fuel Valve Lesson Intro
Fuel Valve Theory Of Operation
Fuel Valve Lessons
Satisfied
Fuel Valve and Quantity Transmitter Components
Satisfied
Fuel System Hazards
Enabled
Fuel Valve Removal Procedure
Flow
Preparation
Flow
Remove Door
Flow
Remove Transmitter
Flow
Remove Valve
Tests
Knowledge Test
Fuel System Components
Fuel System Hazards
Performance Test (simulation)
IETM
Auxiliary ID Enabled
Removal Simulation
Indicates is visible on menu

63. Fuel Valve Introduction Fuel Valve Lessons Tests
Each block must be completed before the next block is available
Upon completion of first block only first two items of second block are enabled. Student can taken them in any order
Must complete first two before proceeding to third lesson
Must take third lesson in order. IETM is available at any time
Tests enabled only after completion of lessons
Fuel Valve Lesson Intro
Fuel Valve Theory Of Operation
Fuel Valve Lessons
Satisfied
Fuel Valve and Quantity Transmitter Components
Satisfied
Fuel System Hazards
Satisfied
Fuel Valve Removal Procedure
Preparation
Remove Door
Remove Transmitter
Remove Valve
Enabled
Tests
Flow
Knowledge Test
Flow
Fuel System Components
Flow
Fuel System Hazards
Flow
Performance Test (simulation)
IETM
Flow
Removal Simulation
Indicates is visible on menu

64. Fuel Valve Introduction Fuel Valve Lessons Tests
Each block must be completed before the next block is available
Upon completion of first block only first two items of second block are enabled. Student can taken them in any order
Must complete first two before proceeding to third lesson
Must take third lesson in order. IETM is available at any time
Tests enabled only after completion of lessons
If test is failed remediate back to that lesson then take test a second time
If test is passed move to second part of test
If test is failed again student is remediated again and fails course
On completion of first test student moves to simulation test
Student must perform correct steps in order within time limit
IETM available during performance test
Fuel Valve Lesson Intro
Fuel Valve Theory Of Operation
Fuel Valve Lessons
Fuel Valve and Quantity Transmitter Components
Fuel System Hazards
Fuel Valve Removal Procedure
Preparation
Remove Door
Remove Transmitter
Remove Valve
Tests
Knowledge Test
Normalized Measure
Rollup
Fuel System Components
Normalized Measure
Fuel System Hazards
Rollup
Performance Test (simulation)
IETM
Removal Simulation
Indicates is visible on menu

65. Fuel Valve Introduction Fuel Valve Lessons Tests
Each block must be completed before the next block is available
Upon completion of first block only first two items of second block are enabled. Student can taken them in any order
Must complete first two before proceeding to third lesson
Must take third lesson in order. IETM is available at any time
Tests enabled only after completion of lessons
If test is failed remediate back to that lesson then take test a second time
If test is passed move to second part of test
If test is failed again student is remediated again and fails course
On completion of first test student moves to simulation test
Student must perform correct steps in order within time limit
IETM available during performance test
Fuel Valve Lesson Intro
Fuel Valve Theory Of Operation
Fuel Valve Lessons
Fuel Valve and Quantity Transmitter Components
Fuel System Hazards
Fuel Valve Removal Procedure
Preparation
Remove Door
Remove Transmitter
Remove Valve
Tests
Passed
Knowledge Test
Fuel System Components
Fuel System Hazards
Enabled
Performance Test (simulation)
IETM
Enabled
Removal Simulation
Limit-Time
Indicates is visible on menu

66. Fuel Valve Introduction Fuel Valve Lessons Tests
Each block must be completed before the next block is available
Upon completion of first block only first two items of second block are enabled. Student can taken them in any order
Must complete first two before proceeding to third lesson
Must take third lesson in order. IETM is available at any time
Tests enabled only after completion of lessons
If test is failed remediate back to that lesson then take test a second time
If test is passed move to second part of test
If test is failed again student is remediated again and fails course
On completion of first test student moves to simulation test
Student must perform correct steps in order within time limit
IETM available during performance test
Fuel Valve Lesson Intro
Fuel Valve Theory Of Operation
Fuel Valve Lessons
Flow
Fuel Valve and Quantity Transmitter Components
Flow
Fuel System Hazards
Fuel Valve Removal Procedure
Preparation
Remove Door
Remove Transmitter
Remove Valve
Flow
Tests
Failed
Knowledge Test
Fuel System Components
Fuel System Hazards
Performance Test (simulation)
IETM
Removal Simulation
Indicates is visible on menu

67. ADL http://www.adlnet.org
Resources
ADL
SCORM Sequencing and Navigation 1.3 (2004)
IMS
Simple Sequencing Information and Behavior Model Version 1.0
XML Binding Version 1.0
Best Practice and Implementation Guide Version 1.0
Examples, XML Bindings, and DTDs