 An Advanced Web 3D Mobile e-Learning System to Manage Virtual Courses and Multimedia Flavio Fontana, ENEA Usability Lab, Department of Computer Science, University of Rome, Italy Summer School, ENEA 15 September 2013, Rome, italy

An Advanced Web 3D Mobile e-Learning System to Manage Virtual Courses and Multimedia 2011 Summer School Ovidius Univerisity Usability & Media Laboratory: Ulab The ENEA Usability Lab is an experienced experts and developers group in web applications, multimedia database design and distributed systems for the fruition of e-learning contents by means of Internet. The Usability Lab organizes usability testing sessions since The Usability Lab issue is to improve the effectiveness, the efficiency and the users systems satisfaction by advanced methods of usability testing and design.

An Advanced Web 3D Mobile e-Learning System to Manage Virtual Courses and Multimedia 2011 Summer School Ovidius Univerisity First dimension: distance teaching We started by postulating that the universe of instruction consisted of two families of teaching behaviors, which we referred of two families of teaching behaviors, which we referred to as “contiguous teaching” and “distance teaching”. to as “contiguous teaching” and “distance teaching”. Second dimension: learner autonomy and independent study Michael G. Moore University of Wisconsin Main concept

An Advanced Web 3D Mobile e-Learning System to Manage Virtual Courses and Multimedia 2011 Summer School Ovidius Univerisity 4 Virtual World 3D Abstract: In this paper an innovative 3D interactive e-learning objects management for multimedia databases in virtual scenes is discussed. In the last years has been improved an innovative structured platform to integrate e-learning information and 3D scenes. The Web 3D mobile e-learning system has been studied in terms of: functionality, performances and accessibility to determine the effectiveness and satisfaction of the educational proposal. The Virtual World 3D (VW-3D) next generation is a new integration approach of data with the visual representation. VW-3D is finalized both to manage e-learning activities and the online study. The system, VRML, XML and Java Technology based, has been developed in the ENEA Usability Lab, Casaccia Research Centre, in collaboration with the University of Rome "La Sapienza".

An Advanced Web 3D Mobile e-Learning System to Manage Virtual Courses and Multimedia 2011 Summer School Ovidius Univerisity The system allows the web end-user to access to virtual courses and multimedia web pages. It provides also advanced communication between docent/student for web lessons and seminars. VW-3D visualizes multimedia data exclusively by predefined Meta e- learning objects information and creates dynamically interactive e- learning objects with specific functionality and interactivity from the available learning contents. The new VW-3D provides a new virtual space to query multimedia database and visualize the results in the 3D scenario using the 3D objects. The system is integrated with the ENEA Matrix e-learning platform to give a new portability at the project with no limitation in a mobile scenario. Virtual World 3D

An Advanced Web 3D Mobile e-Learning System to Manage Virtual Courses and Multimedia 2011 Summer School Ovidius Univerisity VW 3D: System Overview The system developed at ENEA Usability Lab is based on the Java and VRML/X3D languages and a deep integration between an innovative web site and its related multimedia and distributed databases. New experimentations on: WebGL, Html5, XML 3D, Flash 3D, etc. The main modules of Virtual World-3D are: Core System (CS), it manages the virtual world structure and its related web pages and databases; Video Conference Module (VCM), this module manages the users communication by means of a flash open source video streaming conference server; 3D Learning Object Module (3D-LOM), this module manages the 3D learning objects, it manages the 3D objects with a metadata descriptor that defines how the system has to use it in the 3D scenario; Visual Interface Multimedia Manager (VIMM), this module manages, by means of a visual representation, the visualization of the e-learning data by functional interactive e-learning objects and the data retrieved from the VCM module; Avatar Management Module (AMM), this module guarantees the possibility to configure an avatar for each registered user.

An Advanced Web 3D Mobile e-Learning System to Manage Virtual Courses and Multimedia 2011 Summer School Ovidius Univerisity 7 VW 3D: General Architecture

An Advanced Web 3D Mobile e-Learning System to Manage Virtual Courses and Multimedia 2011 Summer School Ovidius Univerisity 8 VW 3D: Functional Schema

An Advanced Web 3D Mobile e-Learning System to Manage Virtual Courses and Multimedia 2011 Summer School Ovidius Univerisity VW 3D VIMM Internal Architecture AVI Mobile Interface Web 3D Interface

An Advanced Web 3D Mobile e-Learning System to Manage Virtual Courses and Multimedia 2011 Summer School Ovidius Univerisity My Space Personal DB Central DB Advanced Visual Interface - AVI Courses MATRIX CORE SYS ObjectVideos NETLESSON Object VW 3D 3D Personal Object Management

An Advanced Web 3D Mobile e-Learning System to Manage Virtual Courses and Multimedia 2011 Summer School Ovidius Univerisity VW 3D 3D Personal Object Management and Mobile Interaction Personal DB Central DB Advanced Visual Interface - AVI Course s MATRIX CORE SYS ObjectVideos NETLESSON Object My Virtual Space My Real Space My Mobile Virtual Space NetLesson System (VMS –VCMS) Synchronous Lesson Realtime NetLesson System (VMS –VCMS) Asynchronous Lesson WiFi Area

An Advanced Web 3D Mobile e-Learning System to Manage Virtual Courses and Multimedia 2011 Summer School Ovidius Univerisity VW 3D: Management and Mobile Interaction Internet network Multimedia Class Room Multmedia Repository Streaming Server End User (Home, Office, etc.), Expert Remote access via modem 56 kps Global Multimedia Specifications Synchronous/Asynchronous Classrom Systems Internet network Multimedia Class Room kps / Mbs / 1 Gbs kps Java MM and VW – 3D Mobile Video Camera

An Advanced Web 3D Mobile e-Learning System to Manage Virtual Courses and Multimedia 2011 Summer School Ovidius Univerisity VW 3D: Classroom and Mobile Interaction External Teaching Other Teachers Mobile Didactical Organisation Mobile Interaction and e-learning Other students

An Advanced Web 3D Mobile e-Learning System to Manage Virtual Courses and Multimedia 2011 Summer School Ovidius Univerisity VW3D: 3D Object Personal Management and Mobile Interaction

An Advanced Web 3D Mobile e-Learning System to Manage Virtual Courses and Multimedia 2011 Summer School Ovidius Univerisity VW3D: 3D Object Personal Management and Mobile Interaction

An Advanced Web 3D Mobile e-Learning System to Manage Virtual Courses and Multimedia 2011 Summer School Ovidius Univerisity Virtual World 3D Search Engine (VW-3DSE) The new feature designed in VW-3D is the 3D search engine environment. The users by entering the library room display a new 3D space where queries can be visualized and interact with the results displayed by 3D objects. The communication between the external e- learning platforms is managed by a SOAP protocol with dedicated web services. The main query processes are headed to the MMP system, designed by the Usability Lab (ULAB) in ENEA (E-LEARN2007), to make information retrieved from different databases a homogeneous data standard resource. Hence the search engine queries are not specifically implemented for all the different e-learning systems but only for a single standard. In the ULAB we are also working to embed queries from external search engine forms by the Meta Engine objects System (MES).

An Advanced Web 3D Mobile e-Learning System to Manage Virtual Courses and Multimedia 2011 Summer School Ovidius Univerisity Virtual World 3D Search Engine (VW-3DSE) Virtual space the 3D visualization of the query results. The VW-3DS E has a very friendly and easy query interface to find e-learning contents. The user search field is a key word and options as thematic, the docent name, file type can be activated. A little visualization menu can be used by the user to define the visualization options as 3D, 2D, and the order as the 3D have to bed ordered. Interesting studies have been done in the display of the 3D objects for query results. The new application SpaceTime designed by SpaceTime, had the same approach of the VW-3DSE. The information of generic queries are visualized inside 3D objects and the user can walk virtually between the results. Obviously ULAB aim is to obtain a more specific approach for e-learning purpose.

An Advanced Web 3D Mobile e-Learning System to Manage Virtual Courses and Multimedia 2011 Summer School Ovidius Univerisity Virtual World 3D Search Engine & 3D Visualisation 3D Carousel Visualization of the Video Lesson. The result display of the Video Lesson in a 3D representation have been preferred by the users (Usability Testing Phase #2). It was considered a valid solution for a mobile scenario. Other 3D applications are: Cube, 3D Icons, Virtual Screen, Virtual Smath-phone.

An Advanced Web 3D Mobile e-Learning System to Manage Virtual Courses and Multimedia 2011 Summer School Ovidius Univerisity Application scenario In the last years new environments, based on 3D technologies, were developed to manage educational activities and promote virtual meetings. In particular, the more significant existing systems are: Convenos Meeting Center (SmartMeeting.com); Convenos Meeting Center (SmartMeeting.com); AAlten Project (Norway 2004) ; AAlten Project (Norway 2004) ; Seconf Life by Linden Labs; Seconf Life by Linden Labs; WonderLand; WonderLand; Other. Other. Technologies and Standards: X3D/VMRL, WebGL, Html 5, XML 3D, Java, Flash 3D, CSS 3D, etc.

An Advanced Web 3D Mobile e-Learning System to Manage Virtual Courses and Multimedia 2011 Summer School Ovidius Univerisity User Classification Criteria and Identification USER CLASSES: Generic user (randomly access to the system); Generic user (randomly access to the system); Professional user (frequently access to course, information and services, generally students/teachers and tutors). Professional user (frequently access to course, information and services, generally students/teachers and tutors). Avatar characteristics, parameters, actions, personal functionality, personal area, other. Avatar characteristics, parameters, actions, personal functionality, personal area, other. USER CLASSIFICATION CRITERIA: Frequency of use Frequency of use Computer familiarity Computer familiarity Computer software expertise Computer software expertise User mental abilities User mental abilities User physical abilities and skill User physical abilities and skill USER AVATAR

An Advanced Web 3D Mobile e-Learning System to Manage Virtual Courses and Multimedia 2011 Summer School Ovidius Univerisity User Requirements General requirements (access to the system through the Web, use of the Net to study, easy to use, efficiency, effectiveness, robustness, modularity, portability, etc.); General requirements (access to the system through the Web, use of the Net to study, easy to use, efficiency, effectiveness, robustness, modularity, portability, etc.); Functional requirements (use of mouse, access to enquiry functions, real-time and asynchronous communications, etc.); Functional requirements (use of mouse, access to enquiry functions, real-time and asynchronous communications, etc.); Technical requirements (active environment, networks, multi-language, integration with distributed multimedia database,); Technical requirements (active environment, networks, multi-language, integration with distributed multimedia database,); Hardware: 3D Vision graphics card 512 MB min,. Hardware: 3D Vision graphics card 512 MB min, resolutions up to 2560x1600.

An Advanced Web 3D Mobile e-Learning System to Manage Virtual Courses and Multimedia 2011 Summer School Ovidius Univerisity Mobile Scenario Equipments: LapTop, Ipad, Smart-Phones (iPhone, HTC, Nokia, etc. Virtual Classroom Real Classroom External Area Other Site Mobile Advanced communication

An Advanced Web 3D Mobile e-Learning System to Manage Virtual Courses and Multimedia 2011 Summer School Ovidius Univerisity Mobile Scenario Real – Time Virtual Teaching 3D Virtual Object Real Scena Web Cam / HD Video Camera

An Advanced Web 3D Mobile e-Learning System to Manage Virtual Courses and Multimedia 2011 Summer School Ovidius Univerisity VW 3D Modules VW 3D II Generation VW 3D II Generation VW 3D One ULAB VW 3D Module VW 3D Module New VW 3D Rome University 2011 VW 3D Mobile 2010 ULAB VW 3D One ULAB VW 3D Module VW 3D Module

An Advanced Web 3D Mobile e-Learning System to Manage Virtual Courses and Multimedia 2011 Summer School Ovidius Univerisity VW 3D Design VW 3D II Generation VW 3D II Generation

An Advanced Web 3D Mobile e-Learning System to Manage Virtual Courses and Multimedia 2011 Summer School Ovidius Univerisity VW 3D Design VW 3D II Generation VW 3D II Generation

An Advanced Web 3D Mobile e-Learning System to Manage Virtual Courses and Multimedia 2011 Summer School Ovidius Univerisity VW 3D Design for simulation VW 3D II Generation VW 3D II Generation

An Advanced Web 3D Mobile e-Learning System to Manage Virtual Courses and Multimedia 2011 Summer School Ovidius Univerisity VW 3D Design for simulation VW 3D Second Life VW 3D Second Life

An Advanced Web 3D Mobile e-Learning System to Manage Virtual Courses and Multimedia 2011 Summer School Ovidius Univerisity VW 3D Design AVATAR VW 3D II Generation VW 3D II Generation

An Advanced Web 3D Mobile e-Learning System to Manage Virtual Courses and Multimedia 2011 Summer School Ovidius Univerisity The Web Site To login in the VW-3D platform it’s necessary to visit the VW-3D site. It’s possible to view: The project; The VW-3D Applet; Files to download; Generic informations; Links.

An Advanced Web 3D Mobile e-Learning System to Manage Virtual Courses and Multimedia 2011 Summer School Ovidius Univerisity 3D Spaces

An Advanced Web 3D Mobile e-Learning System to Manage Virtual Courses and Multimedia 2011 Summer School Ovidius Univerisity Virtual classroom Campus Hall Meeting-point Private Rooms Library The VW 3D Methodologies has defined the virtual space (External / Internal), the objects, the multimedia and users. The main internal space (ROOMS) are: 3D Spaces

An Advanced Web 3D Mobile e-Learning System to Manage Virtual Courses and Multimedia 2011 Summer School Ovidius Univerisity 33 The virtual classroom in Virtual World 3D is a space for synchronous and asynchronous lectures. In this space the user is represented in terms of avatar to visualise its position and actions during the lecture (teacher, student). In the classroom other 3D objects like books, documents, video and whiteboards are represented to improve the functionality of the system. The Virtual Classroom

An Advanced Web 3D Mobile e-Learning System to Manage Virtual Courses and Multimedia 2011 Summer School Ovidius Univerisity The Hall and the Meeting-Point are spaces dedicated to the virtual meeting between the users of the world. They can be see the avatar connected, in real time, to the system after their access to the VW3D environment. In this virtual area have been designed some free virtual objects (video, book, etc.) to introduce the multimedia contents of the Campus. Near the hall there are other videos to present the real-time streaming about the courses and the lesson. Il Meeting Point is a relax space to meet the other users before and after the lectures. The Hall and Meeting Point

An Advanced Web 3D Mobile e-Learning System to Manage Virtual Courses and Multimedia 2011 Summer School Ovidius Univerisity The virtual World 3D contains in every scene interactive functionality realted to the object to stimulate toward the user a simulation of the real world to obtain: Information, data, multimedia and documentation. The most important objects implemented during this experimenation are the following: - Digital screen; - Whiteboard; - Calendar; - Book; - Personal Computer; - Other. The 3D Objects

An Advanced Web 3D Mobile e-Learning System to Manage Virtual Courses and Multimedia 2011 Summer School Ovidius Univerisity VW-3D / Matrix layer The 3D Objects The schema shows the internal mechanism use by VW3D to manage the book object. The book is a simple or parametric query to the Matrix Database with the book_data and the user_data. In this case the metaphor is a query to the database. FADVIGENDATABASE

An Advanced Web 3D Mobile e-Learning System to Manage Virtual Courses and Multimedia 2011 Summer School Ovidius Univerisity 37 The books represents the documents that the end-user saves inside his own repository. The end-user, in the 3D scene, is capable to compose a new document with the Si.A. tool or save paper passed by another user. By this, the end-user will have a new BOOK represented in his library or on his desk. This funtion is abled to call the procedure of the e-learning platform to read and write new documents. The Matrix platform has an internal authoring tool (Si.A) to script HTML pages with multimedia contents. Create new document adds a new virtual book in the 3d space. Si.A. Authoring tool The 3D Objects: the Book

An Advanced Web 3D Mobile e-Learning System to Manage Virtual Courses and Multimedia 2011 Summer School Ovidius Univerisity 38 The digital screen is situated in: virtual classroom, meeting-point, meeting room and in the private rooms (docent, student) to visualise the didactical contents (multimedia, PPT presentatiom, calendard, etc.). The screen is a result display of a query to the multimedia database. FADVIGEN DATABASE Vw-3D/Matrix layer The 3D Objects: the Digital Screen

An Advanced Web 3D Mobile e-Learning System to Manage Virtual Courses and Multimedia 2011 Summer School Ovidius Univerisity 39 The 3D Objects: the Whiteboard The WhiteBoard module is a experimental prototype of shared blackboard that allows to design and to write images. Already experimented in MES project, the WhiteBoard has been integrated in the 3D scene. The WhiteBoard shares the drawings of users that are present in the same room, like the classrooms.

An Advanced Web 3D Mobile e-Learning System to Manage Virtual Courses and Multimedia 2011 Summer School Ovidius Univerisity 40 The user can read the offline and the online lessons’ information like time, arguments, teachers and which classrooms will take place the lessons. The information is retrieved from the database and it is ASP and JavaScript file The 3D Objects: the Calendar

An Advanced Web 3D Mobile e-Learning System to Manage Virtual Courses and Multimedia 2011 Summer School Ovidius Univerisity VW-3D has been integrated Matrix IV Generation of ENEA Platform (2005 ENEA E- LEARN, VW-3D has been used with a set of existent courses and multimedia databases. Specific experimentations have been carry-on by students and docents (e-learning system design group by ENEA and University of Rome “Sapienza”, Computer Science Dept.) to test VW-3D in terms of functionality. In the same time it has been completed an entire usability testing process in the ULAB laboratory in the research centre ENEA of Rome. The testing phases have been planned following the basic principles of cognitive and educational of a user’s properties like students and teachers. The result obtained, in relation to the measure usability degree of the system, according to MUSiC performance measurement method (Macleod et al., 1997) and ENEA Usability Methodology (ULAB, 2002), has been excellent. The tests measured a high perception of the virtual space of VW-3D in the user’s mind making it easier to memorize. About 100 users with 200 h of experimentation. Experimental results

An Advanced Web 3D Mobile e-Learning System to Manage Virtual Courses and Multimedia 2011 Summer School Ovidius Univerisity The system has confirmed that an advanced visual representation is really easier to use for large end-user groups. As future features it is planned to provide a completely modular architecture (to add functions easily), to migrate all modules in a Java environment. The next step is to manage a similar Second Life platform that can generate contemporarily more virtual worlds with personalized configurations. New virtual objects and new mobile applications. Conclusions and future works The VW-3D experience will be extended towards other application domains to provide cooperative works and advanced simulation environments, the compatibility with standards as SCORM data structures has to be completed. The globalization of this architecture is fundamental to make more usable and users accepted. The aim is to make more information available in a 3D structure to test the fruition velocity and efficiency of this alternative interface by generic users.

An Advanced Web 3D Mobile e-Learning System to Manage Virtual Courses and Multimedia 2011 Summer School Ovidius Univerisity Thank you for your attention! Flavio Fontana Virtual World 3D