1. Possible DARPA IPTO Grand Challenge: “WAIS Robot” (WAIS+ Robot?)
Title slide: include title of your proposal and name of presenter. Include any graphics or clip art that illustrate your proposal.
Presented by: Dr. Selmer Bringsjord
with Bettina Schimanski

2. The Challenge: WAIS Robot
Autonomous artificially intelligent robots will display mastery of the Wechsler Adult Intelligence Scale (WAIS).
Include the title of your proposal and a brief explanation that clearly conveys the task
… + tests of creativity and mechanical ability…?

3. Intelligence Tests: Narrow vs. Broad
Thurstone’s view of
intelligence
Spearman’s
view of intelligence

4. Narrow Test: RPM =========== start of search ===========
given clause #1: (wt=2) 10 [] R1(a11).
given clause #2: (wt=2) 11 [] R1(a12).
given clause #3: (wt=2) 12 [] R1(a13).
...
given clause #4: (wt=2) 13 [] R2(a21).
given clause #278: (wt=16) 287 [para_into,64.3.1,3.3.1] R2(x)| -R3(a23)|
-EmptyBar(y)| -R3(x)| -EmptyBar(x)| -T(a23)| -R3(y)| -T(y).
given clause #279: (wt=16) 288 [para_into,65.3.1,8.3.1] R2(x)| -R3(a23)|
-StripedBar(y)| -R3(x)| -StripedBar(x)| -EmptyBar(a23)| -R3(y)|
-EmptyBar(y).
Search stopped by max_seconds option.
============ end of search ============

5. Broad Test: WAIS Wechsler Adult Intelligent Scale
WAIS includes many sub-tests

6. Wechsler Adult Intelligent Scale
Broad Test: WAIS
Wechsler Adult Intelligent Scale

7. Wechsler Adult Intelligent Scale
Broad Test: WAIS
Wechsler Adult Intelligent Scale

8. Broad Test: WAIS Wechsler Adult Intelligent Scale
Comprehension sub-test
The Comprehension sub-test is so difficult it could be a motivator for the original CYC dream
Deals with ordinary conversation
Examples:
“Why is copper often used in making electrical wires?”
“What is the advantage of keeping money in a bank account?”

9. Wechsler Adult Intelligent Scale
Broad Test: WAIS
Wechsler Adult Intelligent Scale
Block Design sub-test
Arrange blocks to
match a given sample
(Blocks courtesy of Binary Arts Corporation)

10. Broad Test: WAIS Wechsler Adult Intelligent Scale
Object Assembly sub-test
- Presented with several 2D puzzle-like pieces

11. Object Assembly
Sample provided by Psychological Corporation (© 2004)

12. Picture Arrangement sub-test
Broad Test: WAIS
Wechsler Adult Intelligent Scale
Picture Arrangement sub-test
- Deals with many mental facets

13. Picture Arrangement

14. WAIS Challenge Decidedly Non - Ad Hoc
Integrated intelligence via Alan Newell’s third paradigm
“You Can’t Play 20 Questions with Nature and Win” (1973)
“We never seem in the experimental literature to put the results of all the experiments together”
First Paradigm: Complete Processing Models
Second Paradigm: Analyze a Complex Task
Third Paradigm: One Program for Many Tasks
The same observation can be made today about systems engineered in AI (Building Block Approach)
The idea is to use different subtests from certain chosen tests of mental and/or physical ability to create a composite artificial agent for a specific application.

15. The Proposed Rules
The artificial agent must operate without any prior knowledge of actual test course (must handle any case in the general space)
The artificial agent will be administered the test as a human subject would:
Must physically manipulate objects (of many different shapes and sizes but weighing less than 4 lbs. each)
Must be able to take spoken directions
Must be able to respond to questions of varied topics
Must have a vision component
Must be subject to the same time limitations
The artificial agent operates autonomously once the test has started until completion
List the rules that Grand Challenge participants would be required to follow.

16. Training & Test Materials
Some homegrown test samples/examples
What training and test materials would be made available to participants? Note potential issues (e.g., costs, copyright, etc) with acquiring data.

17. Milestones Year 1: Feasibility demonstration
Complete individual sub-tests at different year cutoffs:
Year 2: Digit Symbol, Digit Span, Vocabulary, Arithmetic, Similarities
Year 3: Block Design, Object Assembly
Year 5: Picture Completion
Year 7: Information. Comprehension
Year 9: Picture Arrangement
Year 10: Complete all sub-tests within time limit given for humans (in terms of physical manipulation, language parsing, visual deciphering, etc.)
State the Grand Challenge test as it would evolve over time. Include a plan for 1 year, 5 years, and 10 years.

18. Milestones: Permutation 1
Year 1: Feasibility demonstration
Complete individual sub-tests at different year cutoffs:
Year 2: Digit Symbol, Digit Span, Vocabulary, Arithmetic, Similarities
Year 3: Block Design, Object Assembly
Year 5: Picture Completion
Year 7: Picture Arrangement
Year 9: Information, Comprehension
Year 10: Complete all sub-tests within time limit given for humans (in terms of physical manipulation, language parsing, visual deciphering, etc.)

19. Limitations The WAIS does not test generative ability much
Short Short Story Game (S3G)
S. Bringsjord (1998). "Chess is Too Easy", Technology Review, 101, 2,
What about locomotion etc.?

20. Background References
S. Bringsjord and B. Schimanski (2003). "What is Artificial Intelligence? Psychometric AI as an Answer", Proceedings of the 18th International Joint Conference on Artificial Intelligence (IJCAI-03), Morgan Kaufmann, San Francisco, CA,
S. Bringsjord and B. Schimanski (2004). "Pulling It All Together via Psychometric AI", Achieving Human-Level Intelligence Through Integrated Systems and Research: Technical Report FS-04-01, AAAI Press, Menlo Park, CA, 9-16.