1. Supporting Domain-Expert Users Pisa, 23-24 September 2002 Maria Francesca Costabile Dipartimento di Informatica, Università di Bari, Italy costabile@di.uniba.it

2. Maria Francesca Costabile – Pisa, September 23, 2002 Outline n Who we are n End-users n Domain-expert users n Characteristics of systems for domain-expert users n Software Shaping Workshops: environments for supporting domain-expert users development

3. Maria Francesca Costabile – Pisa, September 23, 2002 Maria Francesca Costabile* Antonio Piccinno* Dip. Informatica Università di Bari, Italy Daniela Fogli * Piero Mussio * Dip. Elettronica per l'Automazione Università di Brescia, Italy Giuseppe Fresta ISTI "A. Faedo" CNR, Pisa, Italy *Pictorial Computing Laboratory University of Rome “La Sapienza” Italy

4. Maria Francesca Costabile – Pisa, September 23, 2002 Pictorial Computing Laboratory n PCL started in 1993 at the University of Rome “La Sapienza” n Director: Stefano Levialdi n Main researchers: M.F. Costabile, Piero Mussio, P. Bottoni n Primary theme: Analysis and use of images in HCI n Formal theory of Visual Languages to model Visual Interaction n IEEE Symposia on Visual Languages, now Symposia on Human- Centric Computing n Journal on Visual Languages and Computer n Advanced Visual Interfaces (AVI) Conferences, AVI’04 in Bari

5. Maria Francesca Costabile – Pisa, September 23, 2002 End-users n A user of an application program. Typically, the term means that the person is not a computer programmer. A person who uses a computer as part of their daily life or daily work, but is not interested in computers per se. Allen Cypher, “Watch What I Do: Programming by Demonstration“ n End-User Computing is “..the adoption and use of information technology by people outside the information system department, to develop software applications in support of organizational tasks” Brancheau and Brown, “The Management of End-User Computing: Status and Directions”, ACM Computing Surveys, 25 (4), 1993 n End-users are experts in a specific domain, who use computer systems to develop software applications

6. Maria Francesca Costabile – Pisa, September 23, 2002 Domain-expert users n Domain-expert users: experts in a specific domain, not necessarily experts in computer science, who use computer environments to perform their daily tasks n They are responsible for the tasks accomplished through the system n They must understand the consequences of the system activity and must be in control of the interactive computation n Domain examples: Medicine Mechanical Engineer Earth Science

7. Maria Francesca Costabile – Pisa, September 23, 2002 The communicational gap n Users and designers adopt different reasoning strategies: heuristic vs. algorithmic examples, analogies vs. deductive abstract tools concreteness vs. abstraction n Users are forced to express their problems in “computerese” Interactive systems are difficult to learn and use

8. Maria Francesca Costabile – Pisa, September 23, 2002 Bridging the gap n Recognizing users as experts!!! in their field, not in CS n Recognizing that experts develop languages and notations to reason on problems and communicate solutions n Designing systems which make abstract CS concepts concrete to users and allow users to follow their learning and reasoning strategies

9. Maria Francesca Costabile – Pisa, September 23, 2002 The designer team Software Experts Domain Experts HCI Experts

10. Maria Francesca Costabile – Pisa, September 23, 2002 User diversity within a domain n It depends not only on user skill, culture, knowledge, but also on specific abilities (physical/cognitve), tasks and context n “using the system changes the users, and as they change they will use the system in new ways” Nielsen, Usability Engineering n New uses of the system make the environment evolve and force to adapt the system to the evolved user and environment

11. Maria Francesca Costabile – Pisa, September 23, 2002 Loop 2 Loop 1 TechnologyOrganizational context User view of the task System Adapted from [Bourguin & al. 2001] Co-evolution

12. Maria Francesca Costabile – Pisa, September 23, 2002 User tailoring n User diversity  user tailoring n Decoupling between pictorial and computational representations of concepts n PCL theory of visual sentences and model of visual interaction

13. Maria Francesca Costabile – Pisa, September 23, 2002 PCL interaction model screen materialization interpretation

14. Maria Francesca Costabile – Pisa, September 23, 2002 characteristic structures n a characteristic structure (cs) is a set of pixels relevant to the interaction process Edit

15. Maria Francesca Costabile – Pisa, September 23, 2002 attributed symbols n a set of css can be identified on an image i on the screen n the computer interprets every gesture with respect to the image i on the screen using a description d of it n d is a set of attributed symbols, each describing the computational meaning of a cs in i Bullet (b11, 279, 224, 18, blue, comp-action=‘link to a page’) tuple of properties

16. Maria Francesca Costabile – Pisa, September 23, 2002 visual sentence n the relations between characteristic structures and attributed symbols are specified by 2 functions: int: CS i  d(interpretation function) where CS i is the set of css in image i mat: d  CS i (materialization function) n a visual sentence (vs) is a triple > n a visual language VL is a set of vss

17. Maria Francesca Costabile – Pisa, September 23, 2002 mat & int n A concept is materialised on the screen through a mat function that associates the attributed symbol describing the concept to a specific cs n The same concept can be materialised in another cs through a different mat function n int & mat allow user tailoring

18. Maria Francesca Costabile – Pisa, September 23, 2002 Example in earth science domain n An Environmental Agency n Experts perform: photo interpretation of satellite images to obtain medium and long term environmental forecast organize the forecast results into reports and thematic maps for different communities of client experts (planner, decision maker,...) n Two categories of experts arise: photo-interpreters and clerks, sharing similar notations but having different tasks to achieve

19. Maria Francesca Costabile – Pisa, September 23, 2002 int & mat for the photo-interpreter d int 1 mat 1

20. Maria Francesca Costabile – Pisa, September 23, 2002 int & mat for the clerk d int 2 mat 2

21. Maria Francesca Costabile – Pisa, September 23, 2002 How to support domain-expert users n Design environments in which domain-expert users interact in their visual notations and with tools familiar to them

22. Maria Francesca Costabile – Pisa, September 23, 2002 Software Shaping Workshops n Software environments as workshops in which users find and use virtual tools resembling their notations and habits and necessary to accomplish their activities n Analogy to real workshops, such as blacksmith or joiner workshops n More user categories  SSW hierarchy

23. Maria Francesca Costabile – Pisa, September 23, 2002 System workshop B-GlacManager generation Application workshop B-monitore generation Application workshop B-glacier System workshop B-SwEngineer System workshop B-AirManager System workshop B-VegManager generation … … … … A 3-level Visual Workshop Hierarchy

24. Maria Francesca Costabile – Pisa, September 23, 2002 The photo-interpreter environment The photo-interpreter obtains the spectral signature of the ‘ablation area’ using tools and notations familiar to her

25. Maria Francesca Costabile – Pisa, September 23, 2002 The clerk environment The clerk obtains the glaciological parameters using the button ‘ablation area’ using tools and notations familiar to him

26. Maria Francesca Costabile – Pisa, September 23, 2002 Conclusion n Software Shaping Workshops are computer environments aimed at supporting the activities of domain-expert users n Novel features of our approach are: 1) it is collaborative in that end-users, as domain experts, assume a responsibility in the design; 2) the SSWs are able to associate different pictorial representations to a same computational representation, and vice versa, thus permitting end-user tailoring; 3)end-users can perform their tasks interacting with the SSWs through interaction visual languages, which resemble their traditional notations and tools; 4)the system is evolutive and allows the domain-expert user to generate another SSW with new functionalities. n We are experimenting this apprach in various domains, using the software tool BANCO