Project Name

Real-time Collaborative work/Remote Elder Care


M. Amano, E. Ito


Computer Supported Cooperative Work (CSCW)、Groupware、Collaboration、Web Synchronization


Real-time collaboration and support for communication


In this laboratory, we are working on the development of a cooperative work support system that creates new value through cooperation and work by multiple people. As its application examples, Mahoca, a real-world electronic sticky note system for supporting ideas, the quality of explanatory voices of lecture videos used in collaborative arranging work systems and reversing lessons for cooperative creation of songs by I will give lecture video browser to improve by cooperation between students and teachers. We are developing a real world type electronic sticky note system Mahoca for idea support using physical sticky notes and electronic sticky notes. We also developed a drifting information sharing mechanism using a drifting type object that displays text and image information on the screen of each user using this system. Drifting type objects are intended to support information sharing and communication by drifting between the screens of each user, and to activate interaction between users. We also developed message communication for calling machine learning API including depth learning. This increases the expandability of the function. This system was developed as a single window application. A single window application can reduce the memory usage compared to a multi-window application and has high scalability.

Many people are developing collaborative arranging work system to create songs cooperatively. Arrangement work is carried out in order to play the composed songs in band form and to make music more complete. In order to arrange the parts of all the musical instruments individually, knowledge of various musical instruments is necessary. Therefore, in a band where users who have biased knowledge on specific musical instruments gather, the performers of the respective instrument parts are in charge of arranging their own parts, and cooperative arrangement in which combinations are performed is performed. Since there are many sensory elements in music, ambiguous instructions increase when cooperative arrangement is performed, and there is a discrepancy in recognition among users. In order to solve this problem, a prototype of a synchronous score editor was made. This system synchronizes musical score data among users, is capable of collaborative editing, and supports communication conducted in the arranging process.

Explanation of lecture video We are developing a lecture video browser that improves the quality of speech by cooperation between students and teachers. Educational institutions that incorporate reversing classes to reverse the role of lessons and homework and lecture services online are on the rise. As a result, demand for lecture images is increasing, and automatic correction techniques for commentary voices in lecture images are required. Explanation Although it is desirable to personalize the students' requests and preferences for speech, it is expensive to create lecture images suitable for each student. Therefore, we developed a new lecture video browser that allows students to edit and view commentary voices for easy listening. Furthermore, as information for lecture improvement, a function to present the editing history / viewing history of the lecture video by the student to the teacher was implemented.

Copyright (c) 2017 Shintani Lab. All rights reserved.