To view PDF files

You need Adobe Reader 7.0 or later in order to read PDF files on this site.
If Adobe Reader is not installed on your computer, click the button below and go to the download site.


Report on NTT Communication Science Laboratories Open House 2014

Kazuo Aoyama, Hidehisa Nagano, Shin Mizutani,
Takaaki Tanaka, and Naotoshi Abekawa


Open House 2014 was held at NTT Communication Science Laboratories in Keihanna Science City, Kyoto, on June 5 and 6. Over 1000 people visited the facility to enjoy 6 talks and 29 exhibits introducing our latest research activities and efforts in the fields of information and human sciences.

Keywords: information science, human science, big data


1. Overview

At NTT Communication Science Laboratories (NTT CS Labs), we aim to build a new technical infrastructure connecting people and information, and we are studying aspects of both human and information sciences to create innovative technologies and discover new principles. NTT CS Labs deals with the most fundamental research targets in the fields of human and information sciences of NTT laboratories; our facilities are located in Kansai Science City (Seika-cho, Kyoto) and Atsugi City, Kanagawa.

NTT CS Labs Open House has been held annually with the aim of introducing the results of the labs’ basic research and innovative leading-edge research to both NTT Group employees and visitors from industries, universities, and research institutions who are engaged in research, development, business, and education.

This year, Open House was held at the NTT Keihanna Building in Kyoto on the afternoon of June 5 and all day on June 6, and a total of around 1070 visitors attended it over the two days. At this event, we prepared many hands-on exhibits to allow visitors to intuitively understand our latest research results and to share a vision of the future where new products based on the research results are widely used. We also organized an invited talk on the theme of philosophy, which differs from our research fields, so that people in various fields could take an interest in our activities. This report summarizes the event’s research talks and exhibits.

2. Keynote speech

Open House started with a speech by the Director of NTT CS Labs, Dr. Eisaku Maeda, entitled “Basic research: Defining our age and the future—The origin of ideas and the seeds of innovation” (Photo 1).

Photo 1. Dr. Eisaku Maeda, Director of NTT CS Labs, giving keynote speech.

It has been 14 years since NTT CS Labs was reorganized as the sole basic research institution for human and information sciences under the new NTT research and development (R&D) scheme instituted by the reorganization of NTT in 1999. During this time, NTT CS Labs has established a framework that has enabled the gradual penetration into the world of the technologies developed from their basic research. Dr. Maeda considered this time to be a major turning point for the next step of NTT CS Labs, and he talked about how important it is that basic research tackles problems that have to be selected and solved in line with the times. He also stressed the importance of launching products onto the market based on a sense of urgency required by the times. He then introduced two representative products, i.e., the seeds of innovation: an extremely large vocabulary recognition decoder that is a core part of a minute-taking system used at the House of Representatives, and the Robust Media Search (RMS) technology for music copyright clearance that has been adopted by broadcasters. He also demonstrated Buru-Navi3, the newest version of a haptic compass, which utilizes human sensory properties to induce a pseudo-attraction force. It was successfully miniaturized through a consistent research effort, which is the “origin of ideas” he refers to in the title of his speech.

3. Research talks

There were three talks, which highlighted recent significant research results and high-profile research themes.

  • “Mind changes body, body leads mind—Feasibility and potential of mind-reading technology,” by Dr. Makio Kashino, Human and Information Science Laboratory. Dr. Kashino introduced the basic concepts and some examples of mind-reading technology that is based on methods of decoding the implicit mind from involuntary body movements and physiological responses (Photo 2).

  • Photo 2. Research presentation by Dr. Makio Kashino.

  • “Enhancing speech quality and music experience—Opening up new vistas for audio experience with reverberation control technology,” by Dr. Keisuke Kinoshita, Media Information Laboratory. Dr. Kinoshita clarified both positive and negative aspects of reverberation in audio signal processing, presented his lab’s novel reverberation control technology that can be used to enhance speech and music experiences, and explained how they are actually utilized in the market (Photo 3).

  • Photo 3. Research presentation by Dr. Keisuke Kinoshita.

  • “Quantum computing beyond integer factorization—Exploring the potential of quantum search,” by Dr. Seiichiro Tani, Innovative Communication Laboratory. Dr. Tani reviewed the theory and applications of quantum search to show that the potential advantages of quantum computing are not limited to integer factorization, and he emphasized the importance of research on quantum algorithms (software) as well as quantum computers (hardware), by comparing them to our conventional computing systems (Photo 4).

  • Photo 4. Research presentation by Dr. Seiichiro Tani.

Each presentation introduced some of the latest research results and provided some background and an overview of the research. All of the talks were very well received.

4. Research exhibits

Open House featured 23 exhibits displaying NTT CS Labs’ latest research results. They were classified into three categories: computer science, media intelligence, and communication and human science. Open House also included a special category on big data science that consisted of three exhibits from NTT CS Labs and three from other NTT laboratories.

Each exhibit was housed in a booth and employed techniques such as slides on a large-screen monitor or hands-on demonstrations, with researchers explaining the latest results directly to visitors. The following list summarizes the research exhibits in each category.

4.1 Big Data Science

  • Finding latent relationships between different data sets—Unsupervised object matching
  • Extracting common patterns from multiple data sets—Non-negative multiple matrix factorization: NM2F
  • Knowledge discovery from large-scale graph data—Efficient graph clustering and distributed query optimization
  • Smarter and instant analysis for huge amounts of video—Jubatus, a scalable big data real-time analysis framework
  • Optimizing network operation through NW data analytics—Inferring latent network status through machine learning
  • Monitoring remote habitats of endangered species—Online environment monitoring with a wireless sensor network

4.2 Computer Science

  • Formal evaluation of network security—Verification of cryptographic protocols using formal methods
  • Generating a common secret based on bounded observability—Secret key distribution using broadband random light
  • Opening the possibility of realizing quantum computers—Constant-step quantum circuits can compute the OR function
  • Programming for everyone—Introduction to computer programming in VISCUIT
  • Let’s chat with a computer!—Dialogue system with various utterance generation methods
  • Reordering Japanese for better translation—Translation using Japanese predicate argument structure
  • Generating coherent summaries from documents—Document summarization by discourse tree trimming

4.3 Media Intelligence

  • Single frame level detection from dailies—Media search-based collaboration system for movie production
  • Retrieving video immediately with camera shots—Instance search for specific objects in movies
  • You may know the lion by its TWO claws—Image matching based on affine-invariant spatial context
  • Understanding multimedia content without seeing it—User behavior reveals meaning of multimedia content
  • Capturing sound by light—Towards massive-channel audio sensing via LEDs and a camera
  • Making computers listen to desired sounds anywhere—Probabilistic modeling and integration for speech enhancement
  • Defeat reverberation: enemy of speech recognition—Advanced speech enhancement and recognition
  • How accurate are speech recognition results?—Estimating speech recognition accuracy without references

4.4 Communication and Human Science

  • Feeling conversation in motion—Recreating a conversation space with augmented body motions
  • You may feel your eyes meet with others—Determining factors related to the eye-contact perception area
  • Reading mind from body—Body movements and physiological responses reveal emotions
  • I’ve got the knack!—Visualization and sonification of action in sports
  • Seeing materials from image movements—Motion-based liquid perception by human vision
  • What determines a person’s hearing performance?—Exploring sources of inter-individual variation
  • Texture integration in touch—Integration process of tactile perception
  • Buru-Navi3: tiny but powerful sensation of being pulled—Asymmetric oscillation induces clear kinesthetic illusion

The exhibit “Capturing sound by light” introduced a new multichannel system that is capable of capturing audio signals of huge microphone arrays via LEDs (light-emitting diodes) and a high speed video camera. The system achieves real-time performance by massive parallel processing with a single graphics processing unit. Visitors to this exhibit were able to experience demonstrations in which an observed sound space was quickly rebuilt with realistic sensations (Photo 5).

Photo 5. Exhibit: “Capturing sound by light.”

The “I’ve got the knack!” exhibit introduced effective ways of providing motor information, i.e., motor feedback techniques, to facilitate motor learning in sports. These feedback techniques were designed to visualize and convert to sound certain key features of an action. They can be applied not only in the field of sports but also in the rehabilitation and entertainment fields (Photo 6).

Photo 6. Exhibit: “I’ve got the knack!”

5. Invited talk

This year’s event also featured two invited talks by Associate Prof. Masaya Chiba, Graduate School of Core Ethics and Frontier Sciences, Ritsumeikan University, and Prof. Shin-ichi Minato, Graduate School of Information Science and Technology, Hokkaido University. The titles of their respective talks were “Considering the information society in terms of ‘After post-structuralism’” and “Science and engineering of discrete structure manipulation based on ‘Power of enumeration.’”

Associate Prof. Masaya Chiba began with a brief review of his research field. Then he described the concepts of structuralism and post-structuralism stemming from 20th-century French philosophy, and provided a simple explanation of the discussions and considerations arising after post-structuralism in relationship to social networks and communications. He suggested that in contemporary society, we need to appropriately control connection and disconnection with other people since we have lapsed into a state of excess connection due to the always-on Internet connection.

Prof. Shin-ichi Minato talked about his concept of discrete structure manipulation. In the first half of his talk, he simply explained the technical aspects of the concept using some examples of set expressions and set operations based on the zero-suppressed decision diagram (ZDD) that he developed. In the second half, he explained how discrete structure manipulation was applied to actual problems. He focused on enumeration problems and discussed detailed applications of ZDD as shown in a popular and interesting YouTube video called “Don’t count naively” produced by his group. He also discussed the Graphillion software package for search, optimization, and enumeration for large-scale graphs, and optimization of power distribution networks.

6. Information transmission using web

NTT CS Labs has made continuous efforts to inform a large number of people both domestically and internationally about their research activities and results. As part of the ongoing effort, we simultaneously released both Japanese and English websites [1, 2] for Open House 2014, which included a booklet, exhibition posters, and reference information (Fig. 1). We plan to upload photos of the presentation and exhibition halls and videos of the director’s keynote speech and the three research talks.

Fig. 1. Website of NTT CS Labs’ Open House 2014.

The members of NTT CS Labs consider it important to transmit high-quality and attractive information on a timely basis. They also have a clear awareness that it is important to convey information on the professional research activities that are underway at the basic research laboratories to a wide range of people in ways that are easy to understand. Consequently, we simply tweeted about the exhibition contents via Twitter through NTT’s Public Relations Office, and we gathered feedback by putting up a questionnaire page on the Open House 2014 websites. NTT CS Labs is continuously trying to improve the ways of disseminating our research activities and results.

7. Concluding remarks

Just as they did last year, many visitors came to NTT CS Labs’ Open House 2014 and engaged in lively discussions on the research talks and exhibits and provided many valuable opinions on the presented results. In closing, we would like to offer our sincere thanks to all of the visitors and participants who attended this event.


[1] Website of NTT Communication Science Laboratories Open House 2014 (in Japanese).
[2] Website of NTT Communication Science Laboratories Open House 2014 (in English).
Kazuo Aoyama
Senior Research Scientist, Learning and Intelligent Systems Research Group, Innovative Communication Laboratory, NTT Communication Science Laboratories.
He received a B.E. in applied physics from Waseda University, Tokyo, in 1986 and an M.E. from Tokyo Institute of Technology in 1988. He joined NTT in 1988 and worked on device modeling of various types of MOSFETs for circuit simulation and studied reconfigurable computer architectures and circuit design methodology. He is currently engaged in research on data structures and algorithms. He is a member of the Institute of Electrical and Electronics Engineers (IEEE), the Institute of Electronics, Information and Communication Engineers (IEICE), the Information Processing Society of Japan (IPSJ), and the Japan Society of Applied Physics.
Hidehisa Nagano
Senior Research Scientist, Media Recognition Research Group, Media Information Laboratory, NTT Communication Science Laboratories.
He received the B.Eng. and M.Eng. in information and computer sciences in 1994 and 1996, respectively, and the Ph.D. in information science and technology in 2005, all from Osaka University, Japan. He joined NTT in 1996. From 2011 to 2012, he was a visiting researcher at the Centre for Digital Music, Queen Mary University of London, UK. He has been working on audio and video analysis, search, retrieval, and recognition algorithms and their implementation. He is a senior member of IEEE and a member of IEICE and IPSJ.
Shin Mizutani
Research Scientist, Learning and Intelligent Systems Research Group, Innovative Communication Laboratory, NTT Communication Science Laboratories.
He received the B.E. in physics from Tokyo University of Science in 1990, the M.E. in biophysical engineering from Osaka University in 1992, and the Ph.D. from Osaka University in 1999. He joined NTT Human Interface Laboratories in 1992 and studied neural networks and nonlinear science to understand the information processing mechanisms in the nerve system. He has been a researcher at NTT Communication Science Laboratories since 1998.
Takaaki Tanaka
Research Scientist, Linguistic Intelligence Research Group, Innovative Communication Laboratory, NTT Communication Science Laboratories.
He received the B.E. and M.E. from Osaka University in 1994 and 1996, respectively. He joined NTT Communication Science Laboratories in 1996 and studied natural language processing including bilingual knowledge acquisition for machine translation. He stayed at the Center for the Study of Language and Information (CSLI) at Stanford University as a guest researcher in 2002 to study multiword expressions such as idioms and compound nouns. He is currently studying deep parsing in Japanese, which integrates syntactic and semantic information. He is a member of the Association for Computational Linguistics, the Association for Natural Language Processing, and the Japanese Society for Artificial Intelligence.
Naotoshi Abekawa
Research Scientist, Human and Information Science Laboratory, NTT Communication Science Laboratories.
He received the B.E. from Tokyo Metropolitan University in 2003, the M.E. from Tokyo Institute of Technology in 2005, and the Ph.D. from Kyoto University in 2014. He joined NTT in 2005 and has been engaged in research on human information processing. His research interests include human sensorimotor mechanisms, especially visuomotor control properties. He is a member of the Society for Neuroscience, the Japan Neuroscience Society, and the Japanese Neural Network Society.