RESEARCH IN HANDS-FREE CONTROL OF DIGTAL PHOTOGRAMMETRIC 3D MEASUREMENTS Presented to: 12th International Scientific and Technical Conference “From imagery to map: digital photogrammetric technologies”. Presented by: Dr. Eugene Levin, CP, (Houghton,USA) Dr. Alexander Grechishev (Moscow,Russia) Dr. Chunming Gao, (Houghton,USA) Justin Carter, (Houghton,USA)

Presentation outline Research Motivation – Why to improve human- computer interactions in photogrammetric environments? How to teach photogrammetry operators and collaborate? - review of HCI innovations Preliminary Experimental Results and Analysis Future Research Plans and Conclusion

Why HCI research is needed for geospatial science and technology? Given the limited number of human photogrammetry/GIS operators at any environmental organization, the rational and efficient use of their time is important. In spite of high level in automation nowadays systems they still can be termed as ”human- in-the-loop”.

Why human will be in the loop? All the existing programmable computers are the Turing machines – today’s silicon realization of virtual universal computing machine invented by Alan Turing some 60 years ago. We’ve all learned to appreciate this machine but its limitation were known from the very beginning. Turing’s is an algorithmic machine and it has been proven that not all problems can be solved algorithmically. Gödel theorem tells that within any given branch of mathematics, there would always be some propositions that couldn't be proven either true or false using the axioms of that mathematical branch itself. The Theorem is used to argue that a computer can never be as smart as a human being because the extent of its knowledge is limited by a fixed set of axioms, whereas a human can go beyond them.

Photogrammetry Lab - (collaborative training)

Is collaboration idea really new?  Analyst – 1  Analyst - 2

Typical analyst operations a)change view – zoom in, zoom out; pan; rotate b) measure in 2D or 3D b) select elements to modify c) editing selected elements d) saving or sending results e) Collaborative: Discuss and make decision

How collaborative environment can be designed nowadays?

What HCI technologies we can use to make this collaboration possible? voice recognition, eye-gaze-tracking, gesture, Haptic electro-encephalograms of brain (EEG)

Live Demo… EEG Photomod + EEG

EEG supports collaborative environments = feasible

FUTURE RESEARCH PLANS

HCI research – Dr.Gao How accurate is 3D points measurements compare to traditional? (personal difference?) How fast new 3D points measurements compare to traditional? Datasets and cognitive science guided test- plan

Future Networked deployment

More sensors: Why Eye-tracking? Spatial and temporal data derived from eye movements, compiled while the analyst observes the geospatial imagery and GIS data, retain meaningful information that could be successfully utilized in image analysis, cognitive collaborative geospatial environments

Basic physiological components of gaze trajectory

It Makes sense to build and include eye-tracker “under $50”?

Conclusion Challenges of collaborative 3D geospatial domain: Do not disturb analysts/operator regular workflow; Increase productivity Collaborative environments Interoperability with state-of-the-art systems Ease to use

Acknowledgement We would like to express our gratitude to “Racurs” and personally Dr.Victor Adrov for supporting this research by “Photomod Lite” software licenses and test data sets.

Thank you! Q&A