書籍
Shuichi Nishio, Hideyuki Nakanishi, Tsumomu Fujinami, "Investigating Human Nature and Communication through Robots", Frontiers Media, January, 2017.
Abstract: The development of information technology enabled us to exchange more items of information among us no matter how far we are apart from each other. It also changed our way of communication. Various types of robots recently promoted to be sold to general public hint that these robots may further influence our daily life as they physically interact with us and handle objects in environment. We may even recognize a feel of presence similar to that of human beings when we talk to a robot or when a robot takes part in our conversation. The impact will be strong enough for us to think about the meaning of communication. This e-book consists of various studies that examine our communication influenced by robots. Topics include our attitudes toward robot behaviors, designing robots for better communicating with people, and how people can be affected by communicating through robots.
BibTeX:
@Book{Nishio2017,
  title     = {Investigating Human Nature and Communication through Robots},
  publisher = {Frontiers Media},
  year      = {2017},
  editor    = {Shuichi Nishio and Hideyuki Nakanishi and Tsumomu Fujinami},
  month     = Jan,
  isbn      = {9782889450862},
  abstract  = {The development of information technology enabled us to exchange more items of information among us no matter how far we are apart from each other. It also changed our way of communication. Various types of robots recently promoted to be sold to general public hint that these robots may further influence our daily life as they physically interact with us and handle objects in environment. We may even recognize a feel of presence similar to that of human beings when we talk to a robot or when a robot takes part in our conversation. The impact will be strong enough for us to think about the meaning of communication. This e-book consists of various studies that examine our communication influenced by robots. Topics include our attitudes toward robot behaviors, designing robots for better communicating with people, and how people can be affected by communicating through robots.},
  file      = {Nishio2017.pdf:pdf/Nishio2017.pdf:PDF},
  url       = {http://www.frontiersin.org/books/Investigating_Human_Nature_and_Communication_through_Robots/1098},
}
書籍の章
Maryam Alimardani, Shuichi Nishio, Hiroshi Ishiguro, "Brain-computer interface and motor imagery training: The role of visual feedback and embodiment", Chapter in Evolving BCI Therapy - Engaging Brain State Dynamics, pp. 73-88, October, 2018.
Abstract: We review the impact of humanlike visual feedback in optimized modulation of brain activity by the BCI users.
BibTeX:
@Incollection{Alimardani2018,
  author    = {Maryam Alimardani and Shuichi Nishio and Hiroshi Ishiguro},
  title     = {Brain-computer interface and motor imagery training: The role of visual feedback and embodiment},
  booktitle = {Evolving BCI Therapy - Engaging Brain State Dynamics},
  year      = {2018},
  chapter   = {5},
  pages     = {73-88},
  month     = oct,
  isbn      = {978-1-78984-070-4},
  abstract  = {We review the impact of humanlike visual feedback in optimized modulation of brain activity by the BCI users.},
}
西尾修一, "アンドロイドへの身体感覚転移とニューロフィードバック", Chapter in ロボットと共生する社会脳 ーー 神経社会ロボット学, 新曜社, no. 第9巻, pp. 175-208, 2016.
BibTeX:
@Incollection{西尾修一2016a,
  author    = {西尾修一},
  title     = {アンドロイドへの身体感覚転移とニューロフィードバック},
  booktitle = {ロボットと共生する社会脳 ーー 神経社会ロボット学},
  publisher = {新曜社},
  year      = {2016},
  number    = {第9巻},
  series    = {社会脳シリーズ},
  pages     = {175-208},
  doi       = {ISBN 978-4-7885-1456-0},
  file      = {西尾修一2016a.pdf:pdf/西尾修一2016a.pdf:PDF},
}
西尾修一, "遠隔操作アンドロイドを通じて感じる他者の存在", Chapter in ロボットと共生する社会脳 ーー 神経社会ロボット学, 新曜社, no. 第9巻, pp. 141-169, 2016.
BibTeX:
@Incollection{西尾修一2016,
  author    = {西尾修一},
  title     = {遠隔操作アンドロイドを通じて感じる他者の存在},
  booktitle = {ロボットと共生する社会脳 ーー 神経社会ロボット学},
  publisher = {新曜社},
  year      = {2016},
  number    = {第9巻},
  series    = {社会脳シリーズ},
  pages     = {141-169},
  doi       = {ISBN 978-4-7885-1456-0},
  file      = {西尾修一2016.pdf:pdf/西尾修一2016.pdf:PDF},
}
Shuichi Nishio, Hiroshi Ishiguro, Norihiro Hagita, "Geminoid: Teleoperated Android of an Existing Person", Chapter in Humanoid Robots: New Developments, I-Tech Education and Publishing, Vienna, Austria, pp. 343-352, June, 2007.
BibTeX:
@Incollection{Nishio2007a,
  author          = {Shuichi Nishio and Hiroshi Ishiguro and Norihiro Hagita},
  title           = {Geminoid: Teleoperated Android of an Existing Person},
  booktitle       = {Humanoid Robots: New Developments},
  publisher       = {I-Tech Education and Publishing},
  year            = {2007},
  editor          = {Armando Carlos de Pina Filho},
  pages           = {343--352},
  address         = {Vienna, Austria},
  month           = Jun,
  file            = {Nishio2007a.pdf:Nishio2007a.pdf:PDF;InTech-Geminoid_teleoperated_android_of_an_existing_person.pdf:http\://www.intechopen.com/source/pdfs/240/InTech-Geminoid_teleoperated_android_of_an_existing_person.pdf:PDF},
  url             = {http://www.intechopen.com/articles/show/title/geminoid__teleoperated_android_of_an_existing_person},
}
解説記事
Shuichi Nishio, Takashi Minato, Hiroshi Ishiguro, "Using Androids to Provide Communication Support for the Elderly", New Breeze, vol. 27, no. 4, pp. 14-17, October, 2015.
BibTeX:
@Article{Nishio2015c,
  author   = {Shuichi Nishio and Takashi Minato and Hiroshi Ishiguro},
  title    = {Using Androids to Provide Communication Support for the Elderly},
  journal  = {New Breeze},
  year     = {2015},
  volume   = {27},
  number   = {4},
  pages    = {14-17},
  month    = Oct,
  day      = {9},
  url      = {https://www.ituaj.jp/wp-content/uploads/2015/10/nb27-4_web_05_ROBOTS_usingandroids.pdf},
  file     = {Nishio2015c.pdf:pdf/Nishio2015c.pdf:PDF},
}
西尾修一, 港隆史, 石黒浩, "アンドロイドによる高齢者のコミュニケーション支援", ITUジャーナル, vol. 45, no. 9, pp. 18-21, September, 2015.
BibTeX:
@Article{西尾修一2015b,
  author   = {西尾修一 and 港隆史 and 石黒浩},
  title    = {アンドロイドによる高齢者のコミュニケーション支援},
  journal  = {ITUジャーナル},
  year     = {2015},
  volume   = {45},
  number   = {9},
  pages    = {18-21},
  month    = SEP,
  url      = {https://www.ituaj.jp/?itujournal=2015_09},
  file     = {Nishio2015b.pdf:pdf/Nishio2015b.pdf:PDF},
}
西尾修一, 石黒浩, Ayse P. Saygin, "アンドロイドと不気味の谷", Clinical Neuroscience, vol. 33, no. 2, pp. 175-176, 2014.
Abstract: アンドロイドと不気味の谷仮説について解読する。
BibTeX:
@Article{西尾修一2014,
  author    = {西尾修一 and 石黒浩 and Ayse P. Saygin},
  title     = {アンドロイドと不気味の谷},
  journal   = {Clinical Neuroscience},
  year      = {2014},
  volume    = {33},
  number    = {2},
  pages     = {175-176},
  abstract  = {アンドロイドと不気味の谷仮説について解読する。},
  booktitle = {Cliical Neuroscience},
  file      = {西尾修一2015.pdf:pdf/西尾修一2015.pdf:PDF},
}
西尾修一, アリマルダニ マリヤム, 石黒浩, "遠隔操作アンドロイドへの身体感覚転移", 日本ロボット学会誌, vol. 31, no. 9, pp. 26-29, November, 2013.
BibTeX:
@Article{西尾修一2013,
  author          = {西尾修一 and アリマルダニ マリヤム and 石黒浩},
  title           = {遠隔操作アンドロイドへの身体感覚転移},
  journal         = {日本ロボット学会誌},
  year            = {2013},
  volume          = {31},
  number          = {9},
  pages           = {26-29},
  month           = Nov,
  day             = {15},
  doi             = {10.7210/jrsj.31.854},
  etitle          = {Body Ownership Transfer to Teleoperated Android},
  file            = {西尾修一2013.pdf:pdf/西尾修一2013.pdf:PDF},
}
石黒浩, 港隆史, 西尾修一, "人としてのミニマルデザインを持つ遠隔操作型ロボット", 情報処理, vol. 54, no. 7, pp. 694-697, July, 2013.
BibTeX:
@Article{石黒浩2013,
  author   = {石黒浩 and 港隆史 and 西尾修一},
  title    = {人としてのミニマルデザインを持つ遠隔操作型ロボット},
  journal  = {情報処理},
  year     = {2013},
  volume   = {54},
  number   = {7},
  pages    = {694--697},
  month    = Jul,
  day      = {15},
  url      = {ttps://ipsj.ixsq.nii.ac.jp/ej/?action=pages_view_main&active_action=repository_view_main_item_detail&item_id=92591&item_no=1&page_id=13&block_id=8},
  etitle   = {Tele-operated Robot with a Minimal Design of Human},
  file     = {:pdf/石黒浩2013.pdf:PDF},
}
西尾修一, 山崎竜二, 石黒浩, "遠隔操作アンドロイドを用いた認知症高齢者のコミュニケーション支援", システム/制御/情報, vol. 57, no. 1, pp. 31-36, January, 2013.
BibTeX:
@Article{西尾修一2012,
  author          = {西尾修一 and 山崎竜二 and 石黒浩},
  title           = {遠隔操作アンドロイドを用いた認知症高齢者のコミュニケーション支援},
  journal         = {システム/制御/情報},
  year            = {2013},
  volume          = {57},
  number          = {1},
  pages           = {31--36},
  month           = Jan,
  etitle          = {Communication Support for Demented Elderies using Teleoperated Android},
  file            = {西尾修一2012.pdf:pdf/西尾修一2012.pdf:PDF},
  keywords        = {dementia; elderly care; teleoperated android; communication support},
}
Kohei Ogawa, Shuichi Nishio, Takashi Minato, Hiroshi Ishiguro, "Android Robots as Tele-presence Media", Biomedical Engineering and Cognitive Neuroscience for Healthcare: Interdisciplinary Applications, Medical Information Science Reference, Pennsylvania, USA, pp. 54-63, September, 2012.
Abstract: In this chapter, the authors describe two human-like android robots, known as Geminoid and Telenoid, which they have developed. Geminoid was developed for two reasons: (1) to explore how humans react or respond the android during face-to-face communication and (2) to investigate the advantages of the android as a communication medium compared to traditional communication media, such as the telephone or the television conference system. The authors conducted two experiments: the first was targeted to an interlocutor of Geminoid, and the second was targeted to an operator of it. The results of these experiments showed that Geminoid could emulate a human's presence in a natural-conversation situation. Additionally, Geminoid could be as persuasive to the interlocutor as a human. The operators of Geminoid were also influenced by the android: during operation, they felt as if their bodies were one and the same with the Geminoid body. The latest challenge has been to develop Telenoid, an android with a more abstract appearance than Geminoid, which looks and behaves as a minimalistic human. At first glance, Telenoid resembles a human; however, its appearance can be interpreted as any sex or any age. Two field experiments were conducted with Telenoid. The results of these experiments showed that Telenoid could be an acceptable communication medium for both young and elderly people. In particular, physical interaction, such as a hug, positively affected the experience of communicating with Telenoid.
BibTeX:
@Article{Ogawa2012b,
  author    = {Kohei Ogawa and Shuichi Nishio and Takashi Minato and Hiroshi Ishiguro},
  title     = {Android Robots as Tele-presence Media},
  journal   = {Biomedical Engineering and Cognitive Neuroscience for Healthcare: Interdisciplinary Applications},
  year      = {2012},
  pages     = {54-63},
  month     = Sep,
  abstract  = {In this chapter, the authors describe two human-like android robots, known as Geminoid and Telenoid, which they have developed. Geminoid was developed for two reasons: (1) to explore how humans react or respond the android during face-to-face communication and (2) to investigate the advantages of the android as a communication medium compared to traditional communication media, such as the telephone or the television conference system. The authors conducted two experiments: the first was targeted to an interlocutor of Geminoid, and the second was targeted to an operator of it. The results of these experiments showed that Geminoid could emulate a human's presence in a natural-conversation situation. Additionally, Geminoid could be as persuasive to the interlocutor as a human. The operators of Geminoid were also influenced by the android: during operation, they felt as if their bodies were one and the same with the Geminoid body. The latest challenge has been to develop Telenoid, an android with a more abstract appearance than Geminoid, which looks and behaves as a minimalistic human. At first glance, Telenoid resembles a human; however, its appearance can be interpreted as any sex or any age. Two field experiments were conducted with Telenoid. The results of these experiments showed that Telenoid could be an acceptable communication medium for both young and elderly people. In particular, physical interaction, such as a hug, positively affected the experience of communicating with Telenoid.},
  url       = {http://www.igi-global.com/chapter/android-robots-telepresence-media/69905},
  doi       = {10.4018/978-1-4666-2113-8.ch006},
  address   = {Pennsylvania, USA},
  chapter   = {6},
  editor    = {Jinglong Wu},
  file      = {Ogawa2012b.pdf:Ogawa2012b.pdf:PDF},
  isbn      = {9781466621138},
  publisher = {Medical Information Science Reference},
}
西尾修一, 石黒浩, "人として人とつながるロボット研究", 電子情報通信学会学会誌, vol. 91, no. 5, pp. 411-416, May, 2008.
Abstract: 人間の対象を擬人化するという能力をかんがみれば,人間型や人間酷似型ロボットの研究が,人とかかわるロボットを開発する上で重要な意味を持つことは明らかである.本稿では,筆者らが最近開発したジェミノイドの研究を基に,人とロボットをつなぐ研究がどのように発展していくかを議論する.
BibTeX:
@Article{西尾修一2008,
  author   = {西尾修一 and 石黒浩},
  title    = {人として人とつながるロボット研究},
  journal  = {電子情報通信学会学会誌},
  year     = {2008},
  volume   = {91},
  number   = {5},
  pages    = {411--416},
  month    = May,
  abstract = {人間の対象を擬人化するという能力をかんがみれば,人間型や人間酷似型ロボットの研究が,人とかかわるロボットを開発する上で重要な意味を持つことは明らかである.本稿では,筆者らが最近開発したジェミノイドの研究を基に,人とロボットをつなぐ研究がどのように発展していくかを議論する.},
  url      = {http://ci.nii.ac.jp/naid/110006664712},
  etitle   = {Android Science Research for Bridging Humans and Robots},
  file     = {西尾修一2008.pdf:西尾修一2008.pdf:PDF},
}
招待講演
Shuichi Nishio, "Portable android robot "Telenoid" for aged citizens: overview and results in Japan and Denmark", In 2016 MOST&JST Workshop on ICT for Accessibility and Support of Older People, Tainan, Taiwan, April, 2016.
BibTeX:
@Inproceedings{Nishio2016,
  author    = {Shuichi Nishio},
  title     = {Portable android robot "Telenoid" for aged citizens: overview and results in Japan and Denmark},
  booktitle = {2016 MOST\&JST Workshop on ICT for Accessibility and Support of Older People},
  year      = {2016},
  address   = {Tainan, Taiwan},
  month     = Apr,
  day       = {11},
}
西尾修一, "人の存在を伝達する遠隔操作型アンドロイドの未来 ~人間社会の新たな可能性を探る~", 第10回スマートウェルネス研究会, グランフロント大阪タワー ナレッジキャピタル, 大阪, October, 2015.
Abstract: 近年、介護者を支援する等のロボティクス介護が注目されていますが、今回のセミナーでは、それとは一線を画し、人の疑似存在としての“アンドロイド"にヘルスケアの視点からフォーカスします。人間としての必要最低限の見かけと動きの要素だけからなる、人間のミニマルデザインを取り入れたアンドロイドによる最先端の心のケアサービスモデルの可能性についても学びます。さらに、新たなメディアとしての可能性や新たなコミュニケーションスタイル、ビジネスモデル創出の可能性についても探ってみたいと思います。
BibTeX:
@Inproceedings{西尾修一2015a,
  author    = {西尾修一},
  title     = {人の存在を伝達する遠隔操作型アンドロイドの未来 ~人間社会の新たな可能性を探る~},
  booktitle = {第10回スマートウェルネス研究会},
  year      = {2015},
  address   = {グランフロント大阪タワー ナレッジキャピタル, 大阪},
  month     = Oct,
  abstract  = {近年、介護者を支援する等のロボティクス介護が注目されていますが、今回のセミナーでは、それとは一線を画し、人の疑似存在としての“アンドロイド"にヘルスケアの視点からフォーカスします。人間としての必要最低限の見かけと動きの要素だけからなる、人間のミニマルデザインを取り入れたアンドロイドによる最先端の心のケアサービスモデルの可能性についても学びます。さらに、新たなメディアとしての可能性や新たなコミュニケーションスタイル、ビジネスモデル創出の可能性についても探ってみたいと思います。},
}
西尾修一, "テレノイドによる認知症高齢者とのコミュニケーション", 認知症カフェスペシャル「身体コミュニケーションの可能性 -ダンスとロボット-」, 大阪, March, 2015.
BibTeX:
@Inproceedings{西尾修一2015,
  author    = {西尾修一},
  title     = {テレノイドによる認知症高齢者とのコミュニケーション},
  booktitle = {認知症カフェスペシャル「身体コミュニケーションの可能性 -ダンスとロボット-」},
  year      = {2015},
  address   = {大阪},
  month     = Mar,
  file      = {西尾修一2015a.pdf:pdf/西尾修一2015a.pdf:PDF},
}
Shuichi Nishio, "Teleoperated android robots - Fundamentals, applications and future", In China International Advanced Manufacturing Conference 2014, Mianyang, China, October, 2014.
Abstract: I will introduce our various experiences on teleoperated android robots, how their are manufactured, scientific findings, applications to real world issues and how they will be used in our society in future.
BibTeX:
@Inproceedings{Nishio2014a,
  author    = {Shuichi Nishio},
  title     = {Teleoperated android robots - Fundamentals, applications and future},
  booktitle = {China International Advanced Manufacturing Conference 2014},
  year      = {2014},
  address   = {Mianyang, China},
  month     = Oct,
  abstract  = {I will introduce our various experiences on teleoperated android robots, how their are manufactured, scientific findings, applications to real world issues and how they will be used in our society in future.},
}
西尾修一, "遠隔操作アンドロイドを通じた他者の認識", 第16回日本感性工学会大会, 東京, September, 2014.
BibTeX:
@Inproceedings{西尾修一,
  author    = {西尾修一},
  title     = {遠隔操作アンドロイドを通じた他者の認識},
  booktitle = {第16回日本感性工学会大会},
  year      = {2014},
  address   = {東京},
  month     = SEP,
  file      = {Nishio2014a.pdf:pdf/Nishio2014a.pdf:PDF},
}
Shuichi Nishio, "The Impact of the Care‐Robot ‘Telenoid' on Elderly Persons in Japan", In International Conference : Going Beyond the Laboratory - Ethical and Societal Challenges for Robotics, Delmenhorst, Germany, February, 2014.
BibTeX:
@Inproceedings{Nishio2014,
  author    = {Shuichi Nishio},
  title     = {The Impact of the Care‐Robot ‘Telenoid' on Elderly Persons in Japan},
  booktitle = {International Conference : Going Beyond the Laboratory - Ethical and Societal Challenges for Robotics},
  year      = {2014},
  address   = {Delmenhorst, Germany},
  month     = Feb,
  day       = {13-15},
}
港隆史, 中西惇也, 桑村海光, 西尾修一, 石黒浩, "ロボットメディアとの身体的相互作用による感情喚起", 信学技報(クラウドネットワークロボット研究会), no. CNR2013-23, 東京, pp. 13-18, December, 2013.
Abstract: 本研究では,ユーザの感情を喚起することでコミュニケーションを支援するメディアの実現に向けて,ロボットメディアとの相互作用における身体的状態が感情変化をもたらすメカニズムを明らかにする研究に着手している.これまでに,人型ロボットメディアを抱擁しながら対話することが,対話相手への関心や好意を高めることを確かめる実験をいくつか行ってきたので,本報告ではそれらの実験を紹介する.
BibTeX:
@Inproceedings{港隆史2013,
  author          = {港隆史 and 中西惇也 and 桑村海光 and 西尾修一 and 石黒浩},
  title           = {ロボットメディアとの身体的相互作用による感情喚起},
  booktitle       = {信学技報(クラウドネットワークロボット研究会)},
  year            = {2013},
  number          = {CNR2013-23},
  pages           = {13-18},
  address         = {東京},
  month           = {Dec},
  day             = {20},
  url             = {http://www.ieice.org/ken/program/index.php?tgs_regid=5802ef7c9533d904b64bd7870b994f877e54bc26c06845254e7fff21647f7176&tgid=IEICE-CNR&lang=},
  etitle          = {Emotional Arousal by Physical Interaction with Robotic Media},
  abstract        = {本研究では,ユーザの感情を喚起することでコミュニケーションを支援するメディアの実現に向けて,ロボットメディアとの相互作用における身体的状態が感情変化をもたらすメカニズムを明らかにする研究に着手している.これまでに,人型ロボットメディアを抱擁しながら対話することが,対話相手への関心や好意を高めることを確かめる実験をいくつか行ってきたので,本報告ではそれらの実験を紹介する.},
  eabstract       = {We are studying a mechanism of an emotional arousal owing to person's bodily state (e.g., body posture and motion) in human-robotic media interaction towards a development of robotic media to support users' communication by controlling their emotion. This paper shows several experimental results in which persons show an interest or affection in their communication partner by talking while hugging a robotic media.},
  file            = {港隆史2013.pdf:pdf/港隆史2013.pdf:PDF},
  funding         = {{CREST}},
  keywords        = {ロボットメディア; 身体的相互作用; 感情喚起; 抱擁},
}
Mari Velonaki, David C. Rye, Steve Scheding, Karl F. MacDorman, Stephen J. Cowley, Hiroshi Ishiguro, Shuichi Nishio, "Panel Discussion: Engagement, Trust and Intimacy: Are these the Essential Elements for a Successful Interaction between a Human and a Robot?", In AAAI Spring Symposium on Emotion, Personality, and Social Behavior, California, USA, pp. 141-147, March, 2008. (2008.3.26)
BibTeX:
@Inproceedings{Nishio2008b,
  author    = {Mari Velonaki and David C. Rye and Steve Scheding and Karl F. MacDorman and Stephen J. Cowley and Hiroshi Ishiguro and Shuichi Nishio},
  title     = {Panel Discussion: Engagement, Trust and Intimacy: Are these the Essential Elements for a Successful Interaction between a Human and a Robot?},
  booktitle = {{AAAI} Spring Symposium on Emotion, Personality, and Social Behavior},
  year      = {2008},
  pages     = {141-147},
  address   = {California, USA},
  month     = Mar,
  url       = {http://www.aaai.org/Library/Symposia/Spring/2008/ss08-04-022.php},
  file      = {Rye_Panel.pdf:http\://psychometrixassociates.com/Rye_Panel.pdf:PDF},
  note      = {2008.3.26},
}
論文
Ryuji Yamazaki, Shuichi Nishio, Hiroshi Ishiguro, Hiroko Kase, "Use of Robotic Media as Persuasive Technology and Its Ethical Implications in Care Settings", Journal of Philosophy and Ethics in Health Care and Medicine, no. 12, pp. 45-58, December, 2018.
Abstract: Communication support for older adults has become a growing need, and as assistive technology robotic media are expected to facilitate social interactions in both verbal and nonverbal ways. Focusing on dementia care, we look into two studies exploring the potential of robotic media that could promote changes in subjectivity in older adults with behavioral and psychological symptoms of dementia (BPSD). Furthermore, we investigate the conditions that might facilitate such media’s use in therapeutic improvement. Based on case studies in dementia care, this paper aims to investigate the potential and conditions that allow robotic media to mediate changes in human subjects. The case studies indicate that those with dementia become open and prosocial through robotic intervention and that by setting suitable conversational topics their reactions can be extracted efficiently. Previous studies also mentioned the requirement of considering both the positive and negative aspects of using robotic media. With social robots being developed as persuasive agents, users have difficulty controlling the information flow, and thus when personal data is dealt with ethical concerns arise. The ethical implication is that persuasive technology puts human autonomy at risk. Finally, we discuss the ethical implications and the effects on emotions and behaviors by applying persuasive robotic media in care settings.
BibTeX:
@Article{Yamazaki2018,
  author   = {Ryuji Yamazaki and Shuichi Nishio and Hiroshi Ishiguro and Hiroko Kase},
  title    = {Use of Robotic Media as Persuasive Technology and Its Ethical Implications in Care Settings},
  journal  = {Journal of Philosophy and Ethics in Health Care and Medicine},
  year     = {2018},
  number   = {12},
  pages    = {45-58},
  month    = dec,
  abstract = {Communication support for older adults has become a growing need, and as assistive technology robotic media are expected to facilitate social interactions in both verbal and nonverbal ways. Focusing on dementia care, we look into two studies exploring the potential of robotic media that could promote changes in subjectivity in older adults with behavioral and psychological symptoms of dementia (BPSD). Furthermore, we investigate the conditions that might facilitate such media’s use in therapeutic improvement. Based on case studies in dementia care, this paper aims to investigate the potential and conditions that allow robotic media to mediate changes in human subjects. The case studies indicate that those with dementia become open and prosocial through robotic intervention and that by setting suitable conversational topics their reactions can be extracted efficiently. Previous studies also mentioned the requirement of considering both the positive and negative aspects of using robotic media. With social robots being developed as persuasive agents, users have difficulty controlling the information flow, and thus when personal data is dealt with ethical concerns arise. The ethical implication is that persuasive technology puts human autonomy at risk. Finally, we discuss the ethical implications and the effects on emotions and behaviors by applying persuasive robotic media in care settings.},
  url      = {https://www.google.com/url?sa=t&rct=j&q=&esrc=s&source=web&cd=1&ved=2ahUKEwit1fCiy5DiAhV7yIsBHUlkACkQFjAAegQIAhAC&url=http%3A%2F%2Fitetsu.jp%2Fmain%2Fwp-content%2Fuploads%2F2019%2F03%2FPEHCM12-yamazaki.pdf&usg=AOvVaw0ie8swnUm_nlGMgx2CPByB},
}
Rosario Sorbello, Carmelo Cali, Salvatore Tramonte, Shuichi Nishio, Hiroshi Ishiguro, Antonio Chella, "A Cognitive Model of Trust for Biological and Artificial Humanoid Robots", Procedia Computer Science, vol. 145, pp. 526-532, December, 2018.
Abstract: This paper presents a model of trust for biological and artificial humanoid robots and agents as antecedent condition of interaction. We discuss the cognitive engines of social perception that accounts for the units on which agents operate and the rules they follow when they bestow trust and assess trustworthiness. We propose that this structural information is the domain of the model. The model represents it in terms of modular cognitive structures connected by a parallel architecture. Finally we give a preliminary formalization of the model in the mathematical framework of the I/O automata for future computational and human-humanoid application.
BibTeX:
@Article{Sorbello2018b,
  author   = {Rosario Sorbello and Carmelo Cali and Salvatore Tramonte and Shuichi Nishio and Hiroshi Ishiguro and Antonio Chella},
  title    = {A Cognitive Model of Trust for Biological and Artificial Humanoid Robots},
  journal  = {Procedia Computer Science},
  year     = {2018},
  volume   = {145},
  pages    = {526-532},
  month    = Dec,
  abstract = {This paper presents a model of trust for biological and artificial humanoid robots and agents as antecedent condition of interaction. We discuss the cognitive engines of social perception that accounts for the units on which agents operate and the rules they follow when they bestow trust and assess trustworthiness. We propose that this structural information is the domain of the model. The model represents it in terms of modular cognitive structures connected by a parallel architecture. Finally we give a preliminary formalization of the model in the mathematical framework of the I/O automata for future computational and human-humanoid application.},
  day      = {11},
  url      = {https://www.sciencedirect.com/science/article/pii/S1877050918324050},
  doi      = {10.1016/j.procs.2018.11.117},
}
Christian Penaloza, Shuichi Nishio, "BMI control of a third arm for multitasking", Science Robotics, vol. 3, Issue20, July, 2018.
Abstract: Brain-machine interface (BMI) systems have been widely studied to allow people with motor paralysis conditions to control assistive robotic devices that replace or recover lost function but not to extend the capabilities of healthy users. We report an experiment in which healthy participants were able to extend their capabilities by using a noninvasive BMI to control a human-like robotic arm and achieve multitasking. Experimental results demonstrate that participants were able to reliably control the robotic arm with the BMI to perform a goal-oriented task while simultaneously using their own arms to do a different task. This outcome opens possibilities to explore future human body augmentation applications for healthy people that not only enhance their capability to perform a particular task but also extend their physical capabilities to perform multiple tasks simultaneously.
BibTeX:
@Article{Penaloza2018a,
  author   = {Christian Penaloza and Shuichi Nishio},
  title    = {BMI control of a third arm for multitasking},
  journal  = {Science Robotics},
  year     = {2018},
  volume   = {3, Issue20},
  month    = Jul,
  abstract = {Brain-machine interface (BMI) systems have been widely studied to allow people with motor paralysis conditions to control assistive robotic devices that replace or recover lost function but not to extend the capabilities of healthy users. We report an experiment in which healthy participants were able to extend their capabilities by using a noninvasive BMI to control a human-like robotic arm and achieve multitasking. Experimental results demonstrate that participants were able to reliably control the robotic arm with the BMI to perform a goal-oriented task while simultaneously using their own arms to do a different task. This outcome opens possibilities to explore future human body augmentation applications for healthy people that not only enhance their capability to perform a particular task but also extend their physical capabilities to perform multiple tasks simultaneously.},
  day      = {25},
  url      = {http://www.geminoid.jp/misc/scirobotics.aat1228.html},
  doi      = {10.1126/scirobotics.aat1228},
}
Abdelkader Nasreddine Belkacem, Shuichi Nishio, Takafumi Suzuki, Hiroshi Ishiguro, Masayuki Hirata, "Neuromagnetic decoding of simultatenous bilateral hand movements for multidimensional brain-machine interfaces", IEEE Transactions on Neural Systems and Rehalibitaion Engineering, vol. 26, no. Issue 6, pp. 1301-1310, May, 2018.
Abstract: To provide multidimensional control, we describe the first reported decoding of bilateral hand movements by using single-trial magnetoencephalography signals as a new approach to enhance a user's ability to interact with a complex environment through a multidimensional brain-machine interface. Ten healthy participants performed or imagined four types of bilateral hand movements during neuromagnetic measurements. By applying a support vector machine (SVM) method to classify the four movements regarding the sensor data obtained from the sensorimotor area, we found the mean accuracy of a two-class classification using the amplitudes of neuromagnetic fields to be particularly suitable for real-time applications, with accuracies comparable to those obtained in previous studies involving unilateral movement. The sensor data from over the sensorimotor cortex showed discriminative time-series waveforms and time-frequency maps in the bilateral hemispheres according to the four tasks. Furthermore, we used four-class classification algorithms based on the SVM method to decode all types of bilateral movements. Our results provided further proof that the slow components of neuromagnetic fields carry sufficient neural information to classify even bilateral hand movements and demonstrated the potential utility of decoding bilateral movements for engineering purposes such as multidimensional motor control.
BibTeX:
@Article{Belkacem2018d,
  author   = {Abdelkader Nasreddine Belkacem and Shuichi Nishio and Takafumi Suzuki and Hiroshi Ishiguro and Masayuki Hirata},
  title    = {Neuromagnetic decoding of simultatenous bilateral hand movements for multidimensional brain-machine interfaces},
  journal  = {IEEE Transactions on Neural Systems and Rehalibitaion Engineering},
  year     = {2018},
  volume   = {26},
  number   = {Issue 6},
  pages    = {1301-1310},
  month    = May,
  abstract = {To provide multidimensional control, we describe the first reported decoding of bilateral hand movements by using single-trial magnetoencephalography signals as a new approach to enhance a user's ability to interact with a complex environment through a multidimensional brain-machine interface. Ten healthy participants performed or imagined four types of bilateral hand movements during neuromagnetic measurements. By applying a support vector machine (SVM) method to classify the four movements regarding the sensor data obtained from the sensorimotor area, we found the mean accuracy of a two-class classification using the amplitudes of neuromagnetic fields to be particularly suitable for real-time applications, with accuracies comparable to those obtained in previous studies involving unilateral movement. The sensor data from over the sensorimotor cortex showed discriminative time-series waveforms and time-frequency maps in the bilateral hemispheres according to the four tasks. Furthermore, we used four-class classification algorithms based on the SVM method to decode all types of bilateral movements. Our results provided further proof that the slow components of neuromagnetic fields carry sufficient neural information to classify even bilateral hand movements and demonstrated the potential utility of decoding bilateral movements for engineering purposes such as multidimensional motor control.},
  day      = {15},
  url      = {https://ieeexplore.ieee.org/document/8359204},
  doi      = {10.1109/TNSRE.2018.2837003},
}
Jakub Złotowski, Hidenobu Sumioka, Friederike Eyssel, Shuichi Nishio, Christoph Bartneck, Hiroshi Ishiguro, "Model of Dual Anthropomorphism: The Relationship Between the Media Equation Effect and Implicit Anthropomorphism", International Journal of Social Robotics, pp. 1-14, April, 2018.
Abstract: Anthropomorphism, the attribution of humanlike characteristics to nonhuman entities, may be resulting from a dual process: first, a fast and intuitive (Type 1) process permits to quickly classify an object as humanlike and results in implicit anthropomorphism. Second, a reflective (Type 2) process may moderate the initial judgment based on conscious effort and result in explicit anthropomorphism. In this study, we manipulated both participants’ motivation for Type 2 processing and a robot’s emotionality to investigate the role of Type 1 versus Type 2 processing in forming judgments about the robot Robovie R2. We did so by having participants play the “Jeopardy!” game with the robot. Subsequently, we directly and indirectly measured anthropomorphism by administering self-report measures and a priming task, respectively. Furthermore, we measured treatment of the robot as a social actor to establish its relation with implicit and explicit anthropomorphism. The results suggested that the model of dual anthropomorphism can explain when responses are likely to reflect judgments based on Type 1 and Type 2 processes. Moreover, we showed that the social treatment of a robot, as described by the Media Equation theory, is related with implicit, but not explicit anthropomorphism.
BibTeX:
@Article{Zlotowski2018,
  author   = {Jakub Złotowski and Hidenobu Sumioka and Friederike Eyssel and Shuichi Nishio and Christoph Bartneck and Hiroshi Ishiguro},
  title    = {Model of Dual Anthropomorphism: The Relationship Between the Media Equation Effect and Implicit Anthropomorphism},
  journal  = {International Journal of Social Robotics},
  year     = {2018},
  pages    = {1-14},
  month    = Apr,
  abstract = {Anthropomorphism, the attribution of humanlike characteristics to nonhuman entities, may be resulting from a dual process: first, a fast and intuitive (Type 1) process permits to quickly classify an object as humanlike and results in implicit anthropomorphism. Second, a reflective (Type 2) process may moderate the initial judgment based on conscious effort and result in explicit anthropomorphism. In this study, we manipulated both participants’ motivation for Type 2 processing and a robot’s emotionality to investigate the role of Type 1 versus Type 2 processing in forming judgments about the robot Robovie R2. We did so by having participants play the “Jeopardy!” game with the robot. Subsequently, we directly and indirectly measured anthropomorphism by administering self-report measures and a priming task, respectively. Furthermore, we measured treatment of the robot as a social actor to establish its relation with implicit and explicit anthropomorphism. The results suggested that the model of dual anthropomorphism can explain when responses are likely to reflect judgments based on Type 1 and Type 2 processes. Moreover, we showed that the social treatment of a robot, as described by the Media Equation theory, is related with implicit, but not explicit anthropomorphism.},
  day      = {4},
  url      = {https://link.springer.com/article/10.1007/s12369-018-0476-5},
  doi      = {10.1007/s12369-018-0476-5},
}
Christian Penaloza, Maryam Alimardani, Shuichi Nishio, "Android Feedback-based Training modulates Sensorimotor Rhythms during Motor Imagery", IEEE Transactions on Neural Systems and Rehabilitation Engineering, vol. 26, Issue 3, pp. 666-674, March, 2018.
Abstract: EEG-based brain computer interface (BCI) systems have demonstrated potential to assist patients with devastating motor paralysis conditions. However, there is great interest in shifting the BCI trend towards applications aimed to healthy users. Although BCI operation depends on technological factors (i.e. EEG pattern classification algorithm) and human factors (i.e. how well the person is able to generate good quality EEG patterns), it is the latter the least investigated. In order to control a Motor Imagery based BCI, the user needs to learn to modulate his/her sensorimotor brain rhythms by practicing Motor Imagery using a classical training protocol with an abstract visual feedback. In this paper, we investigate a different BCI training protocol using a human-like android robot (Geminoid HI-2) to provide realistic visual feedback. The proposed training protocol addresses deficiencies of the classical approach and takes advantage of body-abled user capabilities. Experimental results suggest that android feedback based BCI training improves the modulation of sensorimotor rhythms during motor imagery task. Moreover, we discuss how the influence of body ownership transfer illusion towards the android might have an effect in the modulation of event related desynchronization/synchronization (ERD/ERS) activity.
BibTeX:
@Article{Penaloza2018,
  author   = {Christian Penaloza and Maryam Alimardani and Shuichi Nishio},
  title    = {Android Feedback-based Training modulates Sensorimotor Rhythms during Motor Imagery},
  journal  = {IEEE Transactions on Neural Systems and Rehabilitation Engineering},
  year     = {2018},
  volume   = {26, Issue 3},
  pages    = {666-674},
  month    = Mar,
  abstract = {EEG-based brain computer interface (BCI) systems have demonstrated potential to assist patients with devastating motor paralysis conditions. However, there is great interest in shifting the BCI trend towards applications aimed to healthy users. Although BCI operation depends on technological factors (i.e. EEG pattern classification algorithm) and human factors (i.e. how well the person is able to generate good quality EEG patterns), it is the latter the least investigated. In order to control a Motor Imagery based BCI, the user needs to learn to modulate his/her sensorimotor brain rhythms by practicing Motor Imagery using a classical training protocol with an abstract visual feedback. In this paper, we investigate a different BCI training protocol using a human-like android robot (Geminoid HI-2) to provide realistic visual feedback. The proposed training protocol addresses deficiencies of the classical approach and takes advantage of body-abled user capabilities. Experimental results suggest that android feedback based BCI training improves the modulation of sensorimotor rhythms during motor imagery task. Moreover, we discuss how the influence of body ownership transfer illusion towards the android might have an effect in the modulation of event related desynchronization/synchronization (ERD/ERS) activity.},
  url      = {http://ieeexplore.ieee.org/document/8255672/},
  doi      = {10.1109/TNSRE.2018.2792481},
}
Rosario Sorbello, Salvatore Tramonte, Carmelo Cali, Marcello Giardina, Shuichi Nishio, Hiroshi Ishiguro, Antonio Chella, "An android architecture for bio-inspired honest signalling in Human- Humanoid Interaction", Biologically Inspired Cognitive Architectures, vol. 23, pp. 27-34, January, 2018.
Abstract: This paper outlines an augmented robotic architecture to study the conditions of successful Human-Humanoid Interaction (HHI). The architecture is designed as a testable model generator for interaction centred on the ability to emit, display and detect honest signals. First we overview the biological theory in which the concept of honest signals has been put forward in order to assess its explanatory power. We reconstruct the application of the concept of honest signalling in accounting for interaction in strategic contexts and in laying bare the foundation for an automated social metrics. We describe the modules of the architecture, which is intended to implement the concept of honest signalling in connection with a refinement provided by delivering the sense of co-presence in a shared environment. Finally, an analysis of Honest Signals, in term of body postures, exhibited by participants during the preliminary experiment with the Geminoid Hi-1 is provided.
BibTeX:
@Article{Sorbello2018a,
  author   = {Rosario Sorbello and Salvatore Tramonte and Carmelo Cali and Marcello Giardina and Shuichi Nishio and Hiroshi Ishiguro and Antonio Chella},
  title    = {An android architecture for bio-inspired honest signalling in Human- Humanoid Interaction},
  journal  = {Biologically Inspired Cognitive Architectures},
  year     = {2018},
  volume   = {23},
  pages    = {27-34},
  month    = Jan,
  abstract = {This paper outlines an augmented robotic architecture to study the conditions of successful Human-Humanoid Interaction (HHI). The architecture is designed as a testable model generator for interaction centred on the ability to emit, display and detect honest signals. First we overview the biological theory in which the concept of honest signals has been put forward in order to assess its explanatory power. We reconstruct the application of the concept of honest signalling in accounting for interaction in strategic contexts and in laying bare the foundation for an automated social metrics. We describe the modules of the architecture, which is intended to implement the concept of honest signalling in connection with a refinement provided by delivering the sense of co-presence in a shared environment. Finally, an analysis of Honest Signals, in term of body postures, exhibited by participants during the preliminary experiment with the Geminoid Hi-1 is provided.},
  url      = {https://www.sciencedirect.com/science/article/pii/S2212683X17301032},
  doi      = {10.1016/j.bica.2017.12.001},
}
Rosario Sorbello, Salvatore Tramonte, Carmelo Cali, Marcello Giardina, Shuichi Nishio, Hiroshi Ishiguro, Antonio Chella, "Embodied responses to musical experience detected by human bio-feedback brain features in a Geminoid augmented architecture", Biologically Inspired Cognitive Architectures, vol. 23, pp. 19-26, January, 2018.
Abstract: This paper presents the conceptual framework for a study of musical experience and the associated architecture centred on Human-Humanoid Interaction (HHI). On the grounds of the theoretical and experimental literature on the biological foundation of music, the grammar of music perception and the perception and feeling of emotions in music hearing, we argue that music cognition is specific and that it is realized by a cognitive capacity for music that consists of conceptual and affective constituents. We discuss the relationship between such constituents that enables understanding, that is extracting meaning from music at the different levels of the organization of sounds that are felt as bearers of affects and emotions. To account for the way such cognitive mechanisms are realized in music hearing and extended to movements and gestures we bring in the construct of tensions and of music experience as a cognitive frame. Finally, we describe the principled approach to the design and the architecture of a BCI-controlled robotic system that can be employed to map and specify the constituents of the cognitive capacity for music as well as to simulate their contribution to music meaning understanding in the context of music experience by displaying it through the Geminoid robot movements.
BibTeX:
@Article{Sorbello2018,
  author   = {Rosario Sorbello and Salvatore Tramonte and Carmelo Cali and Marcello Giardina and Shuichi Nishio and Hiroshi Ishiguro and Antonio Chella},
  title    = {Embodied responses to musical experience detected by human bio-feedback brain features in a Geminoid augmented architecture},
  journal  = {Biologically Inspired Cognitive Architectures},
  year     = {2018},
  volume   = {23},
  pages    = {19-26},
  month    = Jan,
  abstract = {This paper presents the conceptual framework for a study of musical experience and the associated architecture centred on Human-Humanoid Interaction (HHI). On the grounds of the theoretical and experimental literature on the biological foundation of music, the grammar of music perception and the perception and feeling of emotions in music hearing, we argue that music cognition is specific and that it is realized by a cognitive capacity for music that consists of conceptual and affective constituents. We discuss the relationship between such constituents that enables understanding, that is extracting meaning from music at the different levels of the organization of sounds that are felt as bearers of affects and emotions. To account for the way such cognitive mechanisms are realized in music hearing and extended to movements and gestures we bring in the construct of tensions and of music experience as a cognitive frame. Finally, we describe the principled approach to the design and the architecture of a BCI-controlled robotic system that can be employed to map and specify the constituents of the cognitive capacity for music as well as to simulate their contribution to music meaning understanding in the context of music experience by displaying it through the Geminoid robot movements.},
  url      = {https://www.sciencedirect.com/science/article/pii/S2212683X17301044},
  doi      = {10.1016/j.bica.2018.01.001},
}
Takashi Ikeda, Masayuki Hirata, Masashi Kasaki, Maryam Alimardani, Kojiro Matsushita, Tomoyuki Yamamoto, Shuichi Nishio, Hiroshi Ishiguro, "Subthalamic nucleus detects unnatural android movement", Scientific Reports, vol. 7, no. 17851, December, 2017.
Abstract: An android, i.e., a realistic humanoid robot with human-like capabilities, may induce an uncanny feeling in human observers. The uncanny feeling about an android has two main causes: its appearance and movement. The uncanny feeling about an android increases when its appearance is almost human-like but its movement is not fully natural or comparable to human movement. Even if an android has human-like flexible joints, its slightly jerky movements cause a human observer to detect subtle unnaturalness in them. However, the neural mechanism underlying the detection of unnatural movements remains unclear. We conducted an fMRI experiment to compare the observation of an android and the observation of a human on which the android is modelled, and we found differences in the activation pattern of the brain regions that are responsible for the production of smooth and natural movement. More specifically, we found that the visual observation of the android, compared with that of the human model, caused greater activation in the subthalamic nucleus (STN). When the android's slightly jerky movements are visually observed, the STN detects their subtle unnaturalness. This finding suggests that the detection of unnatural movements is attributed to an error signal resulting from a mismatch between a visual input and an internal model for smooth movement.
BibTeX:
@Article{Ikeda2017,
  author   = {Takashi Ikeda and Masayuki Hirata and Masashi Kasaki and Maryam Alimardani and Kojiro Matsushita and Tomoyuki Yamamoto and Shuichi Nishio and Hiroshi Ishiguro},
  title    = {Subthalamic nucleus detects unnatural android movement},
  journal  = {Scientific Reports},
  year     = {2017},
  volume   = {7},
  number   = {17851},
  month    = Dec,
  abstract = {An android, i.e., a realistic humanoid robot with human-like capabilities, may induce an uncanny feeling in human observers. The uncanny feeling about an android has two main causes: its appearance and movement. The uncanny feeling about an android increases when its appearance is almost human-like but its movement is not fully natural or comparable to human movement. Even if an android has human-like flexible joints, its slightly jerky movements cause a human observer to detect subtle unnaturalness in them. However, the neural mechanism underlying the detection of unnatural movements remains unclear. We conducted an fMRI experiment to compare the observation of an android and the observation of a human on which the android is modelled, and we found differences in the activation pattern of the brain regions that are responsible for the production of smooth and natural movement. More specifically, we found that the visual observation of the android, compared with that of the human model, caused greater activation in the subthalamic nucleus (STN). When the android's slightly jerky movements are visually observed, the STN detects their subtle unnaturalness. This finding suggests that the detection of unnatural movements is attributed to an error signal resulting from a mismatch between a visual input and an internal model for smooth movement.},
  day      = {19},
  url      = {https://www.nature.com/articles/s41598-017-17849-2},
  doi      = {10.1038/s41598-017-17849-2},
}
Jakub Zlotowski, Hidenobu Sumioka, Shuichi Nishio, Dylan F. Glas, Christoph Bartneck, Hiroshi Ishiguro, "Appearance of a Robot Affects the Impact of its Behaviour on Perceived Trustworthiness and Empathy", Paladyn, Journal of Behavioral Robotics, vol. 7, no. 1, pp. 55-66, December, 2016.
Abstract: An increasing number of companion robots started reaching the public in the recent years. These robots vary in their appearance and behavior. Since these two factors can have an impact on lasting human-robot relationships, it is important to understand their effect for companion robots. We have conducted an experiment that evaluated the impact of a robot's appearance and its behaviour in repeated interactions on its perceived empathy, trustworthiness and anxiety experienced by a human. The results indicate that a highly humanlike robot is perceived as less trustworthy and empathic than a more machinelike robot. Moreover, negative behaviour of a machinelike robot reduces its trustworthiness and perceived empathy stronger than for highly humanlike robot. In addition, we found that a robot which disapproves of what a human says can induce anxiety felt towards its communication capabilities. Our findings suggest that more machinelike robots can be more suitable as companions than highly humanlike robots. Moreover, a robot disagreeing with a human interaction partner should be able to provide feedback on its understanding of the partner's message in order to reduce her anxiety.
BibTeX:
@Article{Zlotowski2016a,
  author   = {Jakub Zlotowski and Hidenobu Sumioka and Shuichi Nishio and Dylan F. Glas and Christoph Bartneck and Hiroshi Ishiguro},
  title    = {Appearance of a Robot Affects the Impact of its Behaviour on Perceived Trustworthiness and Empathy},
  journal  = {Paladyn, Journal of Behavioral Robotics},
  year     = {2016},
  volume   = {7},
  number   = {1},
  pages    = {55-66},
  month    = Dec,
  abstract = {An increasing number of companion robots started reaching the public in the recent years. These robots vary in their appearance and behavior. Since these two factors can have an impact on lasting human-robot relationships, it is important to understand their effect for companion robots. We have conducted an experiment that evaluated the impact of a robot's appearance and its behaviour in repeated interactions on its perceived empathy, trustworthiness and anxiety experienced by a human. The results indicate that a highly humanlike robot is perceived as less trustworthy and empathic than a more machinelike robot. Moreover, negative behaviour of a machinelike robot reduces its trustworthiness and perceived empathy stronger than for highly humanlike robot. In addition, we found that a robot which disapproves of what a human says can induce anxiety felt towards its communication capabilities. Our findings suggest that more machinelike robots can be more suitable as companions than highly humanlike robots. Moreover, a robot disagreeing with a human interaction partner should be able to provide feedback on its understanding of the partner's message in order to reduce her anxiety.},
  url      = {https://www.degruyter.com/view/j/pjbr.2016.7.issue-1/pjbr-2016-0005/pjbr-2016-0005.xml},
  file     = {Zlotowski2016a.pdf:pdf/Zlotowski2016a.pdf:PDF},
}
Maryam Alimardani, Shuichi Nishio, Hiroshi Ishiguro, "Removal of proprioception by BCI raises a stronger body ownership illusion in control of a humanlike robot", Scientific Reports, vol. 6, no. 33514, September, 2016.
Abstract: Body ownership illusions provide evidence that our sense of self is not coherent and can be extended to non-body objects. Studying about these illusions gives us practical tools to understand the brain mechanisms that underlie body recognition and the experience of self. We previously introduced an illusion of body ownership transfer (BOT) for operators of a very humanlike robot. This sensation of owning the robot's body was confirmed when operators controlled the robot either by performing the desired motion with their body (motion-control) or by employing a brain-computer interface (BCI) that translated motor imagery commands to robot movement (BCI-control). The interesting observation during BCI-control was that the illusion could be induced even with a noticeable delay in the BCI system. Temporal discrepancy has always shown critical weakening effects on body ownership illusions. However the delay-robustness of BOT during BCI-control raised a question about the interaction between the proprioceptive inputs and delayed visual feedback in agency-driven illusions. In this work, we compared the intensity of BOT illusion for operators in two conditions; motion-control and BCI-control. Our results revealed a significantly stronger BOT illusion for the case of BCI-control. This finding highlights BCI's potential in inducing stronger agency-driven illusions by building a direct communication between the brain and controlled body, and therefore removing awareness from the subject's own body.
BibTeX:
@Article{Alimardani2016,
  author          = {Maryam Alimardani and Shuichi Nishio and Hiroshi Ishiguro},
  title           = {Removal of proprioception by BCI raises a stronger body ownership illusion in control of a humanlike robot},
  journal         = {Scientific Reports},
  year            = {2016},
  volume          = {6},
  number          = {33514},
  month           = Sep,
  abstract        = {Body ownership illusions provide evidence that our sense of self is not coherent and can be extended to non-body objects. Studying about these illusions gives us practical tools to understand the brain mechanisms that underlie body recognition and the experience of self. We previously introduced an illusion of body ownership transfer (BOT) for operators of a very humanlike robot. This sensation of owning the robot's body was confirmed when operators controlled the robot either by performing the desired motion with their body (motion-control) or by employing a brain-computer interface (BCI) that translated motor imagery commands to robot movement (BCI-control). The interesting observation during BCI-control was that the illusion could be induced even with a noticeable delay in the BCI system. Temporal discrepancy has always shown critical weakening effects on body ownership illusions. However the delay-robustness of BOT during BCI-control raised a question about the interaction between the proprioceptive inputs and delayed visual feedback in agency-driven illusions. In this work, we compared the intensity of BOT illusion for operators in two conditions; motion-control and BCI-control. Our results revealed a significantly stronger BOT illusion for the case of BCI-control. This finding highlights BCI's potential in inducing stronger agency-driven illusions by building a direct communication between the brain and controlled body, and therefore removing awareness from the subject's own body.},
  url             = {http://www.nature.com/articles/srep33514},
  doi             = {10.1038/srep33514},
  file            = {Alimardani2016.pdf:pdf/Alimardani2016.pdf:PDF},
}
Maryam Alimardani, Shuichi Nishio, Hiroshi Ishiguro, "The Importance of Visual Feedback Design in BCIs; from Embodiment to Motor Imagery Learning", PLOS ONE, pp. 1-17, September, 2016.
Abstract: Brain computer interfaces (BCIs) have been developed and implemented in many areas as a new communication channel between the human brain and external devices. Despite their rapid growth and broad popularity, the inaccurate performance and cost of user-training are yet the main issues that prevent their application out of the research and clinical environment. We previously introduced a BCI system for the control of a very humanlike android that could raise a sense of embodiment and agency in the operators only by imagining a movement (motor imagery) and watching the robot perform it. Also using the same setup, we further discovered that the positive bias of subjects' performance both increased their sensation of embodiment and improved their motor imagery skills in a short period. In this work, we studied the shared mechanism between the experience of embodiment and motor imagery. We compared the trend of motor imagery learning when two groups of subjects BCI-operated different looking robots, a very humanlike android's hands and a pair of metallic gripper. Although our experiments did not show a significant change of learning between the two groups immediately during one session, the android group revealed better motor imagery skills in the follow up session when both groups repeated the task using the non-humanlike gripper. This result shows that motor imagery skills learnt during the BCI-operation of humanlike hands are more robust to time and visual feedback changes. We discuss the role of embodiment and mirror neuron system in such outcome and propose the application of androids for efficient BCI training.
BibTeX:
@Article{Alimardani2016a,
  author          = {Maryam Alimardani and Shuichi Nishio and Hiroshi Ishiguro},
  title           = {The Importance of Visual Feedback Design in BCIs; from Embodiment to Motor Imagery Learning},
  journal         = {PLOS ONE},
  year            = {2016},
  pages           = {1-17},
  month           = Sep,
  abstract        = {Brain computer interfaces (BCIs) have been developed and implemented in many areas as a new communication channel between the human brain and external devices. Despite their rapid growth and broad popularity, the inaccurate performance and cost of user-training are yet the main issues that prevent their application out of the research and clinical environment. We previously introduced a BCI system for the control of a very humanlike android that could raise a sense of embodiment and agency in the operators only by imagining a movement (motor imagery) and watching the robot perform it. Also using the same setup, we further discovered that the positive bias of subjects' performance both increased their sensation of embodiment and improved their motor imagery skills in a short period. In this work, we studied the shared mechanism between the experience of embodiment and motor imagery. We compared the trend of motor imagery learning when two groups of subjects BCI-operated different looking robots, a very humanlike android's hands and a pair of metallic gripper. Although our experiments did not show a significant change of learning between the two groups immediately during one session, the android group revealed better motor imagery skills in the follow up session when both groups repeated the task using the non-humanlike gripper. This result shows that motor imagery skills learnt during the BCI-operation of humanlike hands are more robust to time and visual feedback changes. We discuss the role of embodiment and mirror neuron system in such outcome and propose the application of androids for efficient BCI training.},
  day             = {6},
  url             = {http://journals.plos.org/plosone/article?id=10.1371/journal.pone.0161945},
  doi             = {10.1371/journal.pone.0161945},
  file            = {Alimardani2016a.pdf:pdf/Alimardani2016a.pdf:PDF},
}
Kaiko Kuwamura, Shuichi Nishio, Shinichi Sato, "Can We Talk through a Robot As if Face-to-Face? Long-Term Fieldwork Using Teleoperated Robot for Seniors with Alzheimer's Disease", Frontiers in Psychology, vol. 7, no. 1066, pp. 1-13, July, 2016.
Abstract: This work presents a case study on fieldwork in a group home for the elderly with dementia using a teleoperated robot called Telenoid. We compared Telenoid-mediated and face-to-face conditions with three residents with Alzheimer's disease (AD). The result indicates that two of the three residents with moderate AD showed a positive reaction to Telenoid. Both became less nervous while communicating with Telenoid from the time they were first introduced to it. Moreover, they started to use more body gestures in the face-to-face condition and more physical interactions in the Telenoid-mediated condition. In this work, we present all the results and discuss the possibilities of using Telenoid as a tool to provide opportunities for seniors to communicate over the long term.
BibTeX:
@Article{Kuwamura2016a,
  author          = {Kaiko Kuwamura and Shuichi Nishio and Shinichi Sato},
  title           = {Can We Talk through a Robot As if Face-to-Face? Long-Term Fieldwork Using Teleoperated Robot for Seniors with Alzheimer's Disease},
  journal         = {Frontiers in Psychology},
  year            = {2016},
  volume          = {7},
  number          = {1066},
  pages           = {1-13},
  month           = Jul,
  abstract        = {This work presents a case study on fieldwork in a group home for the elderly with dementia using a teleoperated robot called Telenoid. We compared Telenoid-mediated and face-to-face conditions with three residents with Alzheimer's disease (AD). The result indicates that two of the three residents with moderate AD showed a positive reaction to Telenoid. Both became less nervous while communicating with Telenoid from the time they were first introduced to it. Moreover, they started to use more body gestures in the face-to-face condition and more physical interactions in the Telenoid-mediated condition. In this work, we present all the results and discuss the possibilities of using Telenoid as a tool to provide opportunities for seniors to communicate over the long term.},
  day             = {19},
  url             = {http://journal.frontiersin.org/article/10.3389/fpsyg.2016.01066},
  doi             = {10.3389/fpsyg.2016.01066},
  file            = {Kuwamura2016a.pdf:pdf/Kuwamura2016a.pdf:PDF},
  keywords        = {Elderly care robot, Teleoperated robot, Alzheimer's disease, Elderly care facility, Gerontology},
}
Ryuji Yamazaki, Louise Christensen, Kate Skov, Chi-Chih Chang, Malene F. Damholdt, Hidenobu Sumioka, Shuichi Nishio, Hiroshi Ishiguro, "Intimacy in Phone Conversations: Anxiety Reduction for Danish Seniors with Hugvie", Frontiers in Psychology, vol. 7, no. 537, April, 2016.
Abstract: There is a lack of physical contact in current telecommunications such as text messaging and Internet access. To challenge the limitation and re-embody telecommunication, researchers have attempted to introduce tactile stimulation to media and developed huggable devices. Previous experiments in Japan showed that a huggable communication technology, i.e., Hugvie decreased stress level of its female users. In the present experiment in Denmark, we aim to investigate (i) whether Hugvie can decrease stress cross-culturally, i.e., Japanese vs. Danish participants (ii), investigate whether gender plays a role in this psychological effect (stress reduction) and (iii) if there is a preference of this type of communication technology (Hugvie vs. a regular telephone). Twenty-nine healthy elderly participated (15 female and 14 male, M = 64.52 years, SD = 5.67) in Jutland, Denmark. The participants filled out questionnaires including State-Trait Anxiety Inventory, NEO Five Factor Inventory (NEO-FFI), and Becks Depression Inventory, had a 15 min conversation via phone or Hugvie and were interviewed afterward. They spoke with an unknown person of opposite gender during the conversation; the same two conversation partners were used during the experiment and the Phone and Hugvie groups were equally balanced. There was no baseline difference between the Hugvie and Phone groups on age or anxiety or depression scores. In the Hugvie group, there was a statistically significant reduction on state anxiety after meeting Hugvie (p = 0.013). The change in state anxiety for the Hugvie group was positively correlated with openness (r = 0.532, p = 0.041) as measured by the NEO-FFI. This indicates that openness to experiences may increase the chances of having an anxiety reduction from being with Hugvie. Based on the results, we see that personality may affect the participants' engagement and benefits from Hugvie. We discuss the implications of the results and further elaborations.
BibTeX:
@Article{Yamazaki2016,
  author   = {Ryuji Yamazaki and Louise Christensen and Kate Skov and Chi-Chih Chang and Malene F. Damholdt and Hidenobu Sumioka and Shuichi Nishio and Hiroshi Ishiguro},
  title    = {Intimacy in Phone Conversations: Anxiety Reduction for Danish Seniors with Hugvie},
  journal  = {Frontiers in Psychology},
  year     = {2016},
  volume   = {7},
  number   = {537},
  month    = Apr,
  abstract = {There is a lack of physical contact in current telecommunications such as text messaging and Internet access. To challenge the limitation and re-embody telecommunication, researchers have attempted to introduce tactile stimulation to media and developed huggable devices. Previous experiments in Japan showed that a huggable communication technology, i.e., Hugvie decreased stress level of its female users. In the present experiment in Denmark, we aim to investigate (i) whether Hugvie can decrease stress cross-culturally, i.e., Japanese vs. Danish participants (ii), investigate whether gender plays a role in this psychological effect (stress reduction) and (iii) if there is a preference of this type of communication technology (Hugvie vs. a regular telephone). Twenty-nine healthy elderly participated (15 female and 14 male, M = 64.52 years, SD = 5.67) in Jutland, Denmark. The participants filled out questionnaires including State-Trait Anxiety Inventory, NEO Five Factor Inventory (NEO-FFI), and Becks Depression Inventory, had a 15 min conversation via phone or Hugvie and were interviewed afterward. They spoke with an unknown person of opposite gender during the conversation; the same two conversation partners were used during the experiment and the Phone and Hugvie groups were equally balanced. There was no baseline difference between the Hugvie and Phone groups on age or anxiety or depression scores. In the Hugvie group, there was a statistically significant reduction on state anxiety after meeting Hugvie (p = 0.013). The change in state anxiety for the Hugvie group was positively correlated with openness (r = 0.532, p = 0.041) as measured by the NEO-FFI. This indicates that openness to experiences may increase the chances of having an anxiety reduction from being with Hugvie. Based on the results, we see that personality may affect the participants' engagement and benefits from Hugvie. We discuss the implications of the results and further elaborations.},
  url      = {http://journal.frontiersin.org/researchtopic/investigating-human-nature-and-communication-through-robots-3705},
  doi      = {10.3389/fpsyg.2016.00537},
  file     = {Yamazaki2016.pdf:pdf/Yamazaki2016.pdf:PDF},
}
中西惇也, 桑村海光, 港隆史, 西尾修一, 石黒浩, "人型対話メディアにおける抱擁から生まれる好意", 電子情報通信学会和文論文誌, vol. J99-A, no. 1, pp. 36-44, January, 2016.
Abstract: 本研究は人型対話メディアを用いた身体的相互作用が,使用者の対話相手に対する感情に与える影響を検証した.身体的相互作用として抱擁に着目し,人型対話メディアの抱擁が対話者が感じる対話相手への関心や好意を向上させるという仮説を立てた.身体的相互作用を促す仕様の対話メディアを提案し,従来の対話メディアと違い,親密な人間関係を築くサポートメディアとしての可能性を示した.
BibTeX:
@Article{中西惇也2016,
  author          = {中西惇也 and 桑村海光 and 港隆史 and 西尾修一 and 石黒浩},
  title           = {人型対話メディアにおける抱擁から生まれる好意},
  journal         = {電子情報通信学会和文論文誌},
  year            = {2016},
  volume          = {J99-A},
  number          = {1},
  pages           = {36-44},
  month           = Jan,
  abstract        = {本研究は人型対話メディアを用いた身体的相互作用が,使用者の対話相手に対する感情に与える影響を検証した.身体的相互作用として抱擁に着目し,人型対話メディアの抱擁が対話者が感じる対話相手への関心や好意を向上させるという仮説を立てた.身体的相互作用を促す仕様の対話メディアを提案し,従来の対話メディアと違い,親密な人間関係を築くサポートメディアとしての可能性を示した.},
  etitle          = {Evoking affection by hugging a human-like telecommunication medium},
  file            = {中西惇也2015.pdf:pdf/中西惇也2015.pdf:PDF},
}
中道大介, 西尾修一, "遠隔操作型コミュニケーションロボットにおける頷き動作の半自律化による操作主体感への影響", 人工知能学会論文誌, vol. 31, no. 2, 2016.
Abstract: Teleoperation enables us to act in remote location through operated entities such as robots or virtual agents. This advantage allows us to work in places dangerous for humans or places not designed for humans such as in volcano disaster site or in narrow maintenance pipes. However, teleoperation also has a weakness, namely, several gaps (operation interface, environment, appearance, and intentionality) among ourselves and the teleoperated entities in remote. As teleoperated robots own physical bodies different from us, teleoperation requires special interfacing systems that are usually not so intuitive. Such a system requires rather long period of training for one to become familiar with it. One possible solution for this issue is to implement semi-autonomous teleoperation (SAT) facility which combines manual operation and autonomous action.
BibTeX:
@Article{中道大介2016,
  author   = {中道大介 and 西尾修一},
  title    = {遠隔操作型コミュニケーションロボットにおける頷き動作の半自律化による操作主体感への影響},
  journal  = {人工知能学会論文誌},
  year     = {2016},
  volume   = {31},
  number   = {2},
  abstract = {Teleoperation enables us to act in remote location through operated entities such as robots or virtual agents. This advantage allows us to work in places dangerous for humans or places not designed for humans such as in volcano disaster site or in narrow maintenance pipes. However, teleoperation also has a weakness, namely, several gaps (operation interface, environment, appearance, and intentionality) among ourselves and the teleoperated entities in remote. As teleoperated robots own physical bodies different from us, teleoperation requires special interfacing systems that are usually not so intuitive. Such a system requires rather long period of training for one to become familiar with it. One possible solution for this issue is to implement semi-autonomous teleoperation (SAT) facility which combines manual operation and autonomous action.},
  url      = {https://www.jstage.jst.go.jp/article/tjsai/advpub/0/advpub_H-F81/_article/-char/ja/},
  doi      = {10.1527/tjsai.H-F81},
  etitle   = {Effect of Agency to Teleoperated Communication Robot by Semi-autonomous Nod},
  file     = {中道大介2016.pdf:pdf/中道大介2016.pdf:PDF},
}
Kaiko Kuwamura, Takashi Minato, Shuichi Nishio, Hiroshi Ishiguro, "Inconsistency of Personality Evaluation Caused by Appearance Gap in Robotic Telecommunication", Interaction Studies, vol. 16, no. 2, pp. 249-271, November, 2015.
Abstract: In this paper, we discuss the problem of the appearance of teleoperated robots that are used as telecommunication media. Teleoperated robots have a physical existence that increases the feeling of copresence, compared with recent communication media such as cellphones and video chat. However, their appearance is xed, for example stuffed bear, or a image displayed on a monitor. Since people can determine their partner's personality merely from their appearance, a teleoperated robot's appearance which is different from the operator might construct a personality that conflicts with the operator's original personality. We compared the appearances of three communication media (nonhuman-like appearance robot, human-like appearance robot, and video chat) and found that due to the appearance gap, the human-like appearance robot prevented confusion better than the nonhuman-like appearance robot or the video chat and also transmitted an appropriate atmosphere due to the operator.
BibTeX:
@Article{Kuwamura2013a,
  author          = {Kaiko Kuwamura and Takashi Minato and Shuichi Nishio and Hiroshi Ishiguro},
  title           = {Inconsistency of Personality Evaluation Caused by Appearance Gap in Robotic Telecommunication},
  journal         = {Interaction Studies},
  year            = {2015},
  volume          = {16},
  number          = {2},
  pages           = {249-271},
  month           = NOV,
  abstract        = {In this paper, we discuss the problem of the appearance of teleoperated robots that are used as telecommunication media. Teleoperated robots have a physical existence that increases the feeling of copresence, compared with recent communication media such as cellphones and video chat. However, their appearance is xed, for example stuffed bear, or a image displayed on a monitor. Since people can determine their partner's personality merely from their appearance, a teleoperated robot's appearance which is different from the operator might construct a personality that conflicts with the operator's original personality. We compared the appearances of three communication media (nonhuman-like appearance robot, human-like appearance robot, and video chat) and found that due to the appearance gap, the human-like appearance robot prevented confusion better than the nonhuman-like appearance robot or the video chat and also transmitted an appropriate atmosphere due to the operator.},
  file            = {Kuwamura2013a.pdf:pdf/Kuwamura2013a.pdf:PDF},
  keywords        = {teleoperated android; telecomunication; robot; appearance; personality},
}
Jakub Zlotowski, Hidenobu Sumioka, Shuichi Nishio, Dylan Glas, Christoph Bartneck, Hiroshi Ishiguro, "Persistence of the Uncanny Valley: the Influence of Repeated Interactions and a Robot's Attitude on Its Perception", Frontiers in Psychology, June, 2015.
Abstract: The uncanny valley theory proposed by Mori has been heavily investigated in the recent years by researchers from various fields. However, the videos and images used in these studies did not permit any human interaction with the uncanny objects. Therefore, in the field of human-robot interaction it is still unclear what and whether an uncanny looking robot will have an impact on an interaction. In this paper we describe an exploratory empirical study that involved repeated interactions with robots that differed in embodiment and their attitude towards a human. We found that both investigated components of the uncanniness (likeability and eeriness) can be affected by an interaction with a robot. Likeability of a robot was mainly affected by its attitude and this effect was especially prominent for a machine-like robot. On the other hand, mere repeated interactions was sufficient to reduce eeriness irrespective of a robot's embodiment. As a result we urge other researchers to investigate Mori's theory in studies that involve actual human-robot interaction in order to fully understand the changing nature of this phenomenon.
BibTeX:
@Article{Zlotowski,
  author   = {Jakub Zlotowski and Hidenobu Sumioka and Shuichi Nishio and Dylan Glas and Christoph Bartneck and Hiroshi Ishiguro},
  title    = {Persistence of the Uncanny Valley: the Influence of Repeated Interactions and a Robot's Attitude on Its Perception},
  journal  = {Frontiers in Psychology},
  year     = {2015},
  month    = JUN,
  abstract = {The uncanny valley theory proposed by Mori has been heavily investigated in the recent years by researchers from various fields. However, the videos and images used in these studies did not permit any human interaction with the uncanny objects. Therefore, in the field of human-robot interaction it is still unclear what and whether an uncanny looking robot will have an impact on an interaction. In this paper we describe an exploratory empirical study that involved repeated interactions with robots that differed in embodiment and their attitude towards a human. We found that both investigated components of the uncanniness (likeability and eeriness) can be affected by an interaction with a robot. Likeability of a robot was mainly affected by its attitude and this effect was especially prominent for a machine-like robot. On the other hand, mere repeated interactions was sufficient to reduce eeriness irrespective of a robot's embodiment. As a result we urge other researchers to investigate Mori's theory in studies that involve actual human-robot interaction in order to fully understand the changing nature of this phenomenon.},
  url      = {http://journal.frontiersin.org/article/10.3389/fpsyg.2015.00883/abstract},
  doi      = {10.3389/fpsyg.2015.00883},
  file     = {Jakub2014a.pdf:pdf/Jakub2014a.pdf:PDF},
}
Martin Cooney, Shuichi Nishio, Hiroshi Ishiguro, "Importance of Touch for Conveying Affection in a Multimodal Interaction with a Small Humanoid Robot", International Journal of Humanoid Robotics, vol. 12, issue 01, pp. 1550002 (22 pages), 2015.
Abstract: To be accepted as a part of our everyday lives, companion robots will require the capability to recognize people's behavior and respond appropriately. In the current work, we investigated which characteristics of behavior could be used by a small humanoid robot to recognize when a human is seeking to convey affection. A main challenge in doing so was that human social norms are complex, comprising behavior which exhibits high spatiotemporal variance, consists of multiple channels and can express different meanings. To deal with this difficulty, we adopted a combined approach in which we analyzed free interactions and also asked participants to rate short video-clips depicting human-robot interaction. As a result, we are able to present a wide range of findings related to the current topic, including on the fundamental role (prevalence, affectionate impact, and motivations) of actions, channels, and modalities; effects of posture and a robot's behavior; expected reactions; and contributions of modalities in complementary and conflicting configurations. This article extends the existing literature by identifying some useful multimodal affectionate cues which can be leveraged by a robot during interactions; we aim to use the acquired knowledge in a small humanoid robot to provide affection during play toward improving quality of life for lonely persons.
BibTeX:
@Article{Cooney2013b,
  author          = {Martin Cooney and Shuichi Nishio and Hiroshi Ishiguro},
  title           = {Importance of Touch for Conveying Affection in a Multimodal Interaction with a Small Humanoid Robot},
  journal         = {International Journal of Humanoid Robotics},
  year            = {2015},
  volume          = {12, issue 01},
  pages           = {1550002 (22 pages)},
  abstract        = {To be accepted as a part of our everyday lives, companion robots will require the capability to recognize people's behavior and respond appropriately. In the current work, we investigated which characteristics of behavior could be used by a small humanoid robot to recognize when a human is seeking to convey affection. A main challenge in doing so was that human social norms are complex, comprising behavior which exhibits high spatiotemporal variance, consists of multiple channels and can express different meanings. To deal with this difficulty, we adopted a combined approach in which we analyzed free interactions and also asked participants to rate short video-clips depicting human-robot interaction. As a result, we are able to present a wide range of findings related to the current topic, including on the fundamental role (prevalence, affectionate impact, and motivations) of actions, channels, and modalities; effects of posture and a robot's behavior; expected reactions; and contributions of modalities in complementary and conflicting configurations. This article extends the existing literature by identifying some useful multimodal affectionate cues which can be leveraged by a robot during interactions; we aim to use the acquired knowledge in a small humanoid robot to provide affection during play toward improving quality of life for lonely persons.},
  doi             = {10.1142/S0219843615500024},
  file            = {Cooney2014a.pdf:pdf/Cooney2014a.pdf:PDF},
  keywords        = {Affection; multi-modal; play; small humanoid robot, human-robot interaction},
}
Martin Cooney, Shuichi Nishio, Hiroshi Ishiguro, "Affectionate Interaction with a Small Humanoid Robot Capable of Recognizing Social Touch Behavior", ACM Transactions on Interactive Intelligent Systems, vol. 4, no. 4, pp. 32, December, 2014.
Abstract: Activity recognition, involving a capability to automatically recognize people's behavior and its underlying significance, will play a crucial role in facilitating the integration of interactive robotic artifacts into everyday human environments. In particular, social intelligence in recognizing affectionate behavior will offer value by allowing companion robots to bond meaningfully with persons involved. The current article addresses the issue of designing an affectionate haptic interaction between a person and a companion robot by a) furthering understanding of how people's attempts to communicate affection to a robot through touch can be recognized, and b) exploring how a small humanoid robot can behave in conjunction with such touches to elicit affection. We report on an experiment conducted to gain insight into how people perceive three fundamental interactive strategies in which a robot is either always highly affectionate, appropriately affectionate, or superficially unaffectionate (emphasizing positivity, contingency, and challenge respectively). Results provide insight into the structure of affectionate interaction between humans and humanoid robots—underlining the importance of an interaction design expressing sincerity, liking, stability and variation—and suggest the usefulness of novel modalities such as warmth and cold.
BibTeX:
@Article{Cooney2014c,
  author          = {Martin Cooney and Shuichi Nishio and Hiroshi Ishiguro},
  title           = {Affectionate Interaction with a Small Humanoid Robot Capable of Recognizing Social Touch Behavior},
  journal         = {{ACM} Transactions on Interactive Intelligent Systems},
  year            = {2014},
  volume          = {4},
  number          = {4},
  pages           = {32},
  month           = Dec,
  abstract        = {Activity recognition, involving a capability to automatically recognize people's behavior and its underlying significance, will play a crucial role in facilitating the integration of interactive robotic artifacts into everyday human environments. In particular, social intelligence in recognizing affectionate behavior will offer value by allowing companion robots to bond meaningfully with persons involved. The current article addresses the issue of designing an affectionate haptic interaction between a person and a companion robot by a) furthering understanding of how people's attempts to communicate affection to a robot through touch can be recognized, and b) exploring how a small humanoid robot can behave in conjunction with such touches to elicit affection. We report on an experiment conducted to gain insight into how people perceive three fundamental interactive strategies in which a robot is either always highly affectionate, appropriately affectionate, or superficially unaffectionate (emphasizing positivity, contingency, and challenge respectively). Results provide insight into the structure of affectionate interaction between humans and humanoid robots—underlining the importance of an interaction design expressing sincerity, liking, stability and variation—and suggest the usefulness of novel modalities such as warmth and cold.},
  url             = {http://dl.acm.org/citation.cfm?doid=2688469.2685395},
  doi             = {10.1145/2685395},
  file            = {Cooney2014b.pdf:pdf/Cooney2014b.pdf:PDF},
  keywords        = {human-robot interaction; activity recognition; small humanoid companion robot; affectionate touch behavior; intelligent systems},
}
Rosario Sorbello, Antonio Chella, Carmelo Cali, Marcello Giardina, Shuichi Nishio, Hiroshi Ishiguro, "Telenoid Android Robot as an Embodied Perceptual Social Regulation Medium Engaging Natural Human-Humanoid Interaction", Robotics and Autonomous Systems Journal, vol. 62, issue 9, pp. 1329-1341, September, 2014.
Abstract: The present paper aims to validate our research on Human-Humanoid Interaction (HHI) using the minimalist humanoid robot Telenoid. We conducted the human-robot interaction test with 142 young people who had no prior interaction experience with this robot. The main goal is the analysis of the two social dimensions ("Perception" and "Believability" ) useful for increasing the natural behaviour between users and Telenoid. We administered our custom questionnaire to human subjects in association with a well defined experimental setting ("ordinary and goal-guided task"). A thorough analysis of the questionnaires has been carried out and reliability and internal consistency in correlation between the multiple items has been calculated. Our experimental results show that the perceptual behavior and believability, as implicit social competences, could improve the meaningfulness and the natural-like sense of human-humanoid interaction in everyday life taskdriven activities. Telenoid is perceived as an autonomous cooperative agent for a shared environment by human beings.
BibTeX:
@Article{Sorbello2013a,
  author   = {Rosario Sorbello and Antonio Chella and Carmelo Cali and Marcello Giardina and Shuichi Nishio and Hiroshi Ishiguro},
  title    = {Telenoid Android Robot as an Embodied Perceptual Social Regulation Medium Engaging Natural Human-Humanoid Interaction},
  journal  = {Robotics and Autonomous Systems Journal},
  year     = {2014},
  volume   = {62, issue 9},
  pages    = {1329-1341},
  month    = SEP,
  abstract = {The present paper aims to validate our research on Human-Humanoid Interaction (HHI) using the minimalist humanoid robot Telenoid. We conducted the human-robot interaction test with 142 young people who had no prior interaction experience with this robot. The main goal is the analysis of the two social dimensions ("Perception" and "Believability" ) useful for increasing the natural behaviour between users and Telenoid. We administered our custom questionnaire to human subjects in association with a well defined experimental setting ("ordinary and goal-guided task"). A thorough analysis of the questionnaires has been carried out and reliability and internal consistency in correlation between the multiple items has been calculated. Our experimental results show that the perceptual behavior and believability, as implicit social competences, could improve the meaningfulness and the natural-like sense of human-humanoid interaction in everyday life taskdriven activities. Telenoid is perceived as an autonomous cooperative agent for a shared environment by human beings.},
  url      = {http://www.sciencedirect.com/science/article/pii/S092188901400061X},
  doi      = {10.1016/j.robot.2014.03.017},
  file     = {Sorbello2013a.pdf:pdf/Sorbello2013a.pdf:PDF},
  keywords = {Telenoid; Geminoid; Social Robot; Human-Humanoid Robot Interaction},
}
Maryam Alimardani, Shuichi Nishio, Hiroshi Ishiguro, "Effect of biased feedback on motor imagery learning in BCI-teleoperation system", Frontiers in Systems Neuroscience, vol. 8, no. 52, April, 2014.
Abstract: Feedback design is an important issue in motor imagery BCI systems. Regardless, to date it has not been reported how feedback presentation can optimize co-adaptation between a human brain and such systems. This paper assesses the effect of realistic visual feedback on users' BCI performance and motor imagery skills. We previously developed a tele-operation system for a pair of humanlike robotic hands and showed that BCI control of such hands along with first-person perspective visual feedback of movements can arouse a sense of embodiment in the operators. In the first stage of this study, we found that the intensity of this ownership illusion was associated with feedback presentation and subjects' performance during BCI motion control. In the second stage, we probed the effect of positive and negative feedback bias on subjects' BCI performance and motor imagery skills. Although the subject specific classifier, which was set up at the beginning of experiment, detected no significant change in the subjects' online performance, evaluation of brain activity patterns revealed that subjects' self-regulation of motor imagery features improved due to a positive bias of feedback and a possible occurrence of ownership illusion. Our findings suggest that in general training protocols for BCIs, manipulation of feedback can play an important role in the optimization of subjects' motor imagery skills.
BibTeX:
@Article{Alimardani2014a,
  author          = {Maryam Alimardani and Shuichi Nishio and Hiroshi Ishiguro},
  title           = {Effect of biased feedback on motor imagery learning in BCI-teleoperation system},
  journal         = {Frontiers in Systems Neuroscience},
  year            = {2014},
  volume          = {8},
  number          = {52},
  month           = Apr,
  abstract        = {Feedback design is an important issue in motor imagery BCI systems. Regardless, to date it has not been reported how feedback presentation can optimize co-adaptation between a human brain and such systems. This paper assesses the effect of realistic visual feedback on users' BCI performance and motor imagery skills. We previously developed a tele-operation system for a pair of humanlike robotic hands and showed that BCI control of such hands along with first-person perspective visual feedback of movements can arouse a sense of embodiment in the operators. In the first stage of this study, we found that the intensity of this ownership illusion was associated with feedback presentation and subjects' performance during BCI motion control. In the second stage, we probed the effect of positive and negative feedback bias on subjects' BCI performance and motor imagery skills. Although the subject specific classifier, which was set up at the beginning of experiment, detected no significant change in the subjects' online performance, evaluation of brain activity patterns revealed that subjects' self-regulation of motor imagery features improved due to a positive bias of feedback and a possible occurrence of ownership illusion. Our findings suggest that in general training protocols for BCIs, manipulation of feedback can play an important role in the optimization of subjects' motor imagery skills.},
  url             = {http://journal.frontiersin.org/Journal/10.3389/fnsys.2014.00052/full},
  doi             = {10.3389/fnsys.2014.00052},
  file            = {Alimardani2014a.pdf:pdf/Alimardani2014a.pdf:PDF},
  keywords        = {body ownership illusion; BCI‐teleoperation; motor imagery learning; feedback effect; training},
}
Kaiko Kuwamura, Kurima Sakai, Takashi Minato, Shuichi Nishio, Hiroshi Ishiguro, "Hugvie: communication device for encouraging good relationship through the act of hugging", Lovotics, vol. Vol. 1, Issue 1, pp. 10000104, February, 2014.
Abstract: In this paper, we introduce a communication device which encourages users to establish a good relationship with others. We designed the device so that it allows users to virtually hug the person in the remote site through the medium. In this paper, we report that when a participant talks to his communication partner during their first encounter while hugging the communication medium, he mistakenly feels as if they are establishing a good relationship and that he is being loved rather than just being liked. From this result, we discuss Active Co-Presence, a new method to enhance co-presence of people in remote through active behavior.
BibTeX:
@Article{Kuwamura2014a,
  author          = {Kaiko Kuwamura and Kurima Sakai and Takashi Minato and Shuichi Nishio and Hiroshi Ishiguro},
  title           = {Hugvie: communication device for encouraging good relationship through the act of hugging},
  journal         = {Lovotics},
  year            = {2014},
  volume          = {Vol. 1, Issue 1},
  pages           = {10000104},
  month           = Feb,
  abstract        = {In this paper, we introduce a communication device which encourages users to establish a good relationship with others. We designed the device so that it allows users to virtually hug the person in the remote site through the medium. In this paper, we report that when a participant talks to his communication partner during their first encounter while hugging the communication medium, he mistakenly feels as if they are establishing a good relationship and that he is being loved rather than just being liked. From this result, we discuss Active Co-Presence, a new method to enhance co-presence of people in remote through active behavior.},
  url             = {http://www.omicsonline.com/open-access/hugvie_communication_device_for_encouraging_good_relationship_through_the_act_of_hugging.pdf?aid=24445},
  doi             = {10.4172/2090-9888.10000104},
  file            = {Kuwamura2014a.pdf:pdf/Kuwamura2014a.pdf:PDF},
  keywords        = {hug; co-presence; telecommunication},
}
Astrid M. von der Pütten, Nicole C. Krämer, Christian Becker-Asano, Kohei Ogawa, Shuichi Nishio, Hiroshi Ishiguro, "The Uncanny in the Wild. Analysis of Unscripted Human-Android Interaction in the Field.", International Journal of Social Robotics, vol. 6, no. 1, pp. 67-83, January, 2014.
Abstract: Against the background of the uncanny valley hypothesis we investigated how people react towards an android robot in a natural environment dependent on the behavior displayed by the robot (still vs. moving) in a quasi-experimental observational field study. We present data on unscripted interactions between humans and the android robot “Geminoid HI-1" in an Austrian public café and subsequent interviews. Data were analyzed with regard to the participants' nonverbal behavior (e.g. attention paid to the robot, proximity). We found that participants' behavior towards the android robot as well as their interview answers were influenced by the behavior the robot displayed. In addition, we found huge inter-individual differences in the participants' behavior. Implications for the uncanny valley and research on social human–robot interactions are discussed.
BibTeX:
@Article{Putten2011b,
  author          = {Astrid M. von der P\"{u}tten and Nicole C. Kr\"{a}mer and Christian Becker-Asano and Kohei Ogawa and Shuichi Nishio and Hiroshi Ishiguro},
  title           = {The Uncanny in the Wild. Analysis of Unscripted Human-Android Interaction in the Field.},
  journal         = {International Journal of Social Robotics},
  year            = {2014},
  volume          = {6},
  number          = {1},
  pages           = {67-83},
  month           = Jan,
  abstract        = {Against the background of the uncanny valley hypothesis we investigated how people react towards an android robot in a natural environment dependent on the behavior displayed by the robot (still vs. moving) in a quasi-experimental observational field study. We present data on unscripted interactions between humans and the android robot “Geminoid HI-1" in an Austrian public café and subsequent interviews. Data were analyzed with regard to the participants' nonverbal behavior (e.g. attention paid to the robot, proximity). We found that participants' behavior towards the android robot as well as their interview answers were influenced by the behavior the robot displayed. In addition, we found huge inter-individual differences in the participants' behavior. Implications for the uncanny valley and research on social human–robot interactions are discussed.},
  url             = {http://link.springer.com/article/10.1007/s12369-013-0198-7},
  doi             = {10.1007/s12369-013-0198-7},
  file            = {Putten2011b.pdf:pdf/Putten2011b.pdf:PDF},
  keywords        = {human-robot interaction; field study; observation; multimodal evaluation of human interaction with robots; Uncanny Valley},
}
Ryuji Yamazaki, Shuichi Nishio, Hiroshi Ishiguro, Marco Nørskov, Nobu Ishiguro, Giuseppe Balistreri, "Acceptability of a Teleoperated Android by Senior Citizens in Danish Society: A Case Study on the Application of an Embodied Communication Medium to Home Care", International Journal of Social Robotics, vol. 6, no. 3, pp. 429-442, 2014.
Abstract: We explore the potential of teleoperated androids,which are embodied telecommunication media with humanlike appearances. By conducting field experiments, we investigated how Telenoid, a teleoperated android designed as a minimalistic human, affect people in the real world when it is employed to express telepresence and a sense of ‘being there'. Our exploratory study focused on the social aspects of the android robot, which might facilitate communication between the elderly and Telenoid's operator. This new way of creating social relationships can be used to solve a problem in society, the social isolation of senior citizens. It has been becoming a major issue even in Denmark that is known as one of countries with advanced welfare systems. After asking elderly people to use Te-lenoid at their homes, we found that the elderly with or without dementia showed positive attitudes toward Telenoid and imaginatively developed various dialogue strategies. Their positivity and strong attachment to its minimalistic human design were cross-culturally shared in Denmark and Japan. Contrary to the negative reactions by non-users in media reports, our result suggests that teleoperated androids can be accepted by the elderly as a kind of universal design medium for social inclusion.
BibTeX:
@Article{Yamazaki2013a,
  author          = {Ryuji Yamazaki and Shuichi Nishio and Hiroshi Ishiguro and Marco N\orskov and Nobu Ishiguro and Giuseppe Balistreri},
  title           = {Acceptability of a Teleoperated Android by Senior Citizens in Danish Society: A Case Study on the Application of an Embodied Communication Medium to Home Care},
  journal         = {International Journal of Social Robotics},
  year            = {2014},
  volume          = {6},
  number          = {3},
  pages           = {429-442},
  abstract        = {We explore the potential of teleoperated androids,which are embodied telecommunication media with humanlike appearances. By conducting field experiments, we investigated how Telenoid, a teleoperated android designed as a minimalistic human, affect people in the real world when it is employed to express telepresence and a sense of ‘being there'. Our exploratory study focused on the social aspects of the android robot, which might facilitate communication between the elderly and Telenoid's operator. This new way of creating social relationships can be used to solve a problem in society, the social isolation of senior citizens. It has been becoming a major issue even in Denmark that is known as one of countries with advanced welfare systems. After asking elderly people to use Te-lenoid at their homes, we found that the elderly with or without dementia showed positive attitudes toward Telenoid and imaginatively developed various dialogue strategies. Their positivity and strong attachment to its minimalistic human design were cross-culturally shared in Denmark and Japan. Contrary to the negative reactions by non-users in media reports, our result suggests that teleoperated androids can be accepted by the elderly as a kind of universal design medium for social inclusion.},
  doi             = {10.1007/s12369-014-0247-x},
  file            = {Yamazaki2013a.pdf:pdf/Yamazaki2013a.pdf:PDF},
  keywords        = {teleoperated android; minimal design; embodied communication; social isolation; elderly care; social acceptance},
}
Hidenobu Sumioka, Shuichi Nishio, Takashi Minato, Ryuji Yamazaki, Hiroshi Ishiguro, "Minimal human design approach for sonzai-kan media: investigation of a feeling of human presence", Cognitive Computation, vol. 6, Issue 4, pp. 760-774, 2014.
Abstract: Even though human-like robotic media give the feeling of being with others and positively affect our physical and mental health, scant research has addressed how much information about a person should be reproduced to enhance the feeling of a human presence. We call this feeling sonzai-kan, which is a Japanese phrase that means the feeling of a presence. We propose a minimal design approach for exploring the requirements to enhance this feeling and hypothesize that it is enhanced if information is presented from at least two different modalities. In this approach, the exploration is conducted by designing sonzai-kan media through exploratory research with the media, their evaluations, and the development of their systems. In this paper, we give an overview of our current work with Telenoid, a teleoperated android designed with our approach, to illustrate how we explore the requirements and how such media impact our quality of life. We discuss the potential advantages of our approach for forging positive social relationships and designing an autonomous agent with minimal cognitive architecture.
BibTeX:
@Article{Sumioka2013e,
  author          = {Hidenobu Sumioka and Shuichi Nishio and Takashi Minato and Ryuji Yamazaki and Hiroshi Ishiguro},
  title           = {Minimal human design approach for sonzai-kan media: investigation of a feeling of human presence},
  journal         = {Cognitive Computation},
  year            = {2014},
  volume          = {6, Issue 4},
  pages           = {760-774},
  abstract        = {Even though human-like robotic media give the feeling of being with others and positively affect our physical and mental health, scant research has addressed how much information about a person should be reproduced to enhance the feeling of a human presence. We call this feeling sonzai-kan, which is a Japanese phrase that means the feeling of a presence. We propose a minimal design approach for exploring the requirements to enhance this feeling and hypothesize that it is enhanced if information is presented from at least two different modalities. In this approach, the exploration is conducted by designing sonzai-kan media through exploratory research with the media, their evaluations, and the development of their systems. In this paper, we give an overview of our current work with Telenoid, a teleoperated android designed with our approach, to illustrate how we explore the requirements and how such media impact our quality of life. We discuss the potential advantages of our approach for forging positive social relationships and designing an autonomous agent with minimal cognitive architecture.},
  url             = {http://link.springer.com/article/10.1007%2Fs12559-014-9270-3},
  doi             = {10.1007/s12559-014-9270-3},
  file            = {Sumioka2014.pdf:pdf/Sumioka2014.pdf:PDF},
  keywords        = {Human–robot Interaction; Minimal design; Elderly care; Android science},
}
Kurima Sakai, Hidenobu Sumioka, Takashi Minato, Shuichi Nishio, Hiroshi Ishiguro, "Motion Design of Interactive Small Humanoid Robot with Visual Illusion", International Journal of Innovative Computing, Information and Control, vol. 9, no. 12, pp. 4725-4736, December, 2013.
Abstract: This paper presents a novel method to express motions of a small human-like robotic avatar that can be a portable communication medium: a user can talk with another person while feeling the other's presence at anytime, anywhere. The human-like robotic avatar is expected to express human-like movements; however, there are technical and cost problems in implementing actuators in the small body. The method is to induce illusory motion of the robot's extremities with blinking lights. This idea needs only Light Emitting Diodes (LEDs) and avoids the above problems. This paper presents the design of an LED blinking pattern to induce an illusory nodding motion of Elfoid, which is a hand-held tele-operated humanoid robot. A psychological experiment shows that the illusory nodding motion gives a better impression to people than a symbolic blinking pattern. This result suggests that even the illusory motion of a robotic avatar can improve tele-communications.
BibTeX:
@Article{Sakai2013,
  author          = {Kurima Sakai and Hidenobu Sumioka and Takashi Minato and Shuichi Nishio and Hiroshi Ishiguro},
  title           = {Motion Design of Interactive Small Humanoid Robot with Visual Illusion},
  journal         = {International Journal of Innovative Computing, Information and Control},
  year            = {2013},
  volume          = {9},
  number          = {12},
  pages           = {4725-4736},
  month           = Dec,
  abstract        = {This paper presents a novel method to express motions of a small human-like robotic avatar that can be a portable communication medium: a user can talk with another person while feeling the other's presence at anytime, anywhere. The human-like robotic avatar is expected to express human-like movements; however, there are technical and cost problems in implementing actuators in the small body. The method is to induce illusory motion of the robot's extremities with blinking lights. This idea needs only Light Emitting Diodes (LEDs) and avoids the above problems. This paper presents the design of an LED blinking pattern to induce an illusory nodding motion of Elfoid, which is a hand-held tele-operated humanoid robot. A psychological experiment shows that the illusory nodding motion gives a better impression to people than a symbolic blinking pattern. This result suggests that even the illusory motion of a robotic avatar can improve tele-communications.},
  url             = {http://www.ijicic.org/apchi12-275.pdf},
  file            = {Sakai2013.pdf:pdf/Sakai2013.pdf:PDF},
  keywords        = {Tele-communication; Nonverbal communication; Portable robot avatar; Visual illusion of motion},
}
Martin Cooney, Shuichi Nishio, Hiroshi Ishiguro, "Designing Robots for Well-being: Theoretical Background and Visual Scenes of Affectionate Play with a Small Humanoid Robot", Lovotics, November, 2013.
Abstract: Social well-being, referring to a subjectively perceived long-term state of happiness, life satisfaction, health, and other prosperity afforded by social interactions, is increasingly being employed to rate the success of human social systems. Although short-term changes in well-being can be difficult to measure directly, two important determinants can be assessed: perceived enjoyment and affection from relationships. The current article chronicles our work over several years toward achieving enjoyable and affectionate interactions with robots, with the aim of contributing to perception of social well-being in interacting persons. Emphasis has been placed on both describing in detail the theoretical basis underlying our work, and relating the story of each of several designs from idea to evaluation in a visual fashion. For the latter, we trace the course of designing four different robotic artifacts intended to further our understanding of how to provide enjoyment, elicit affection, and realize one specific scenario for affectionate play. As a result, by describing (a) how perceived enjoyment and affection contribute to social well-being, and (b) how a small humanoid robot can proactively engage in enjoyable and affectionate play—recognizing people's behavior and leveraging this knowledge—the current article informs the design of companion robots intended to facilitate a perception of social well-being in interacting persons during affectionate play.
BibTeX:
@Article{Cooney2013d,
  author          = {Martin Cooney and Shuichi Nishio and Hiroshi Ishiguro},
  title           = {Designing Robots for Well-being: Theoretical Background and Visual Scenes of Affectionate Play with a Small Humanoid Robot},
  journal         = {Lovotics},
  year            = {2013},
  month           = Nov,
  abstract        = {Social well-being, referring to a subjectively perceived long-term state of happiness, life satisfaction, health, and other prosperity afforded by social interactions, is increasingly being employed to rate the success of human social systems. Although short-term changes in well-being can be difficult to measure directly, two important determinants can be assessed: perceived enjoyment and affection from relationships. The current article chronicles our work over several years toward achieving enjoyable and affectionate interactions with robots, with the aim of contributing to perception of social well-being in interacting persons. Emphasis has been placed on both describing in detail the theoretical basis underlying our work, and relating the story of each of several designs from idea to evaluation in a visual fashion. For the latter, we trace the course of designing four different robotic artifacts intended to further our understanding of how to provide enjoyment, elicit affection, and realize one specific scenario for affectionate play. As a result, by describing (a) how perceived enjoyment and affection contribute to social well-being, and (b) how a small humanoid robot can proactively engage in enjoyable and affectionate play—recognizing people's behavior and leveraging this knowledge—the current article informs the design of companion robots intended to facilitate a perception of social well-being in interacting persons during affectionate play.},
  url             = {http://www.omicsonline.com/open-access/designing_robots_for_well_being_theoretical_background_and_visual.pdf?aid=24444},
  doi             = {10.4172/2090-9888.1000101},
  file            = {Cooney2013d.pdf:pdf/Cooney2013d.pdf:PDF},
  keywords        = {Human-robot interaction; well-being; enjoyment; affection; recognizing typical behavior; small humanoid robot},
}
Maryam Alimardani, Shuichi Nishio, Hiroshi Ishiguro, "Humanlike robot hands controlled by brain activity arouse illusion of ownership in operators", Scientific Reports, vol. 3, no. 2396, August, 2013.
Abstract: Operators of a pair of robotic hands report ownership for those hands when they hold image of a grasp motion and watch the robot perform it. We present a novel body ownership illusion that is induced by merely watching and controlling robot's motions through a brain machine interface. In past studies, body ownership illusions were induced by correlation of such sensory inputs as vision, touch and proprioception. However, in the presented illusion none of the mentioned sensations are integrated except vision. Our results show that during BMI-operation of robotic hands, the interaction between motor commands and visual feedback of the intended motions is adequate to incorporate the non-body limbs into one's own body. Our discussion focuses on the role of proprioceptive information in the mechanism of agency-driven illusions. We believe that our findings will contribute to improvement of tele-presence systems in which operators incorporate BMI-operated robots into their body representations.
BibTeX:
@Article{Alimardani2013,
  author          = {Maryam Alimardani and Shuichi Nishio and Hiroshi Ishiguro},
  title           = {Humanlike robot hands controlled by brain activity arouse illusion of ownership in operators},
  journal         = {Scientific Reports},
  year            = {2013},
  volume          = {3},
  number          = {2396},
  month           = Aug,
  abstract        = {Operators of a pair of robotic hands report ownership for those hands when they hold image of a grasp motion and watch the robot perform it. We present a novel body ownership illusion that is induced by merely watching and controlling robot's motions through a brain machine interface. In past studies, body ownership illusions were induced by correlation of such sensory inputs as vision, touch and proprioception. However, in the presented illusion none of the mentioned sensations are integrated except vision. Our results show that during BMI-operation of robotic hands, the interaction between motor commands and visual feedback of the intended motions is adequate to incorporate the non-body limbs into one's own body. Our discussion focuses on the role of proprioceptive information in the mechanism of agency-driven illusions. We believe that our findings will contribute to improvement of tele-presence systems in which operators incorporate BMI-operated robots into their body representations.},
  day             = {9},
  url             = {http://www.nature.com/srep/2013/130809/srep02396/full/srep02396.html},
  doi             = {10.1038/srep02396},
  file            = {alimardani2013a.pdf:pdf/alimardani2013a.pdf:PDF},
}
Shuichi Nishio, Koichi Taura, Hidenobu Sumioka, Hiroshi Ishiguro, "Teleoperated Android Robot as Emotion Regulation Media", International Journal of Social Robotics, vol. 5, no. 4, pp. 563-573, July, 2013.
Abstract: In this paper, we experimentally examined whether changes in the facial expressions of teleoperated androids could affect and regulate operators' emotion, based on the facial feedback theory of emotion and the phenomenon of body ownership transfer to the robot. Twenty-six Japanese participants had conversations with an experimenter based on a situation where participants feel anger and, during the conversation, the android's facial expression changed according to a pre-programmed scheme. The results showed that the facial feedback from the android did occur. Moreover, by comparing the two groups of participants, one with operating the robot and another without operating it, we found that this facial feedback from the android robot occur only when participants operated the robot and, when an operator could effectively operate the robot, his/her emotional states were much affected by facial expression change of the robot.
BibTeX:
@Article{Nishio2013a,
  author          = {Shuichi Nishio and Koichi Taura and Hidenobu Sumioka and Hiroshi Ishiguro},
  title           = {Teleoperated Android Robot as Emotion Regulation Media},
  journal         = {International Journal of Social Robotics},
  year            = {2013},
  volume          = {5},
  number          = {4},
  pages           = {563-573},
  month           = Jul,
  abstract        = {In this paper, we experimentally examined whether changes in the facial expressions of teleoperated androids could affect and regulate operators' emotion, based on the facial feedback theory of emotion and the phenomenon of body ownership transfer to the robot. Twenty-six Japanese participants had conversations with an experimenter based on a situation where participants feel anger and, during the conversation, the android's facial expression changed according to a pre-programmed scheme. The results showed that the facial feedback from the android did occur. Moreover, by comparing the two groups of participants, one with operating the robot and another without operating it, we found that this facial feedback from the android robot occur only when participants operated the robot and, when an operator could effectively operate the robot, his/her emotional states were much affected by facial expression change of the robot.},
  url             = {http://link.springer.com/article/10.1007%2Fs12369-013-0201-3},
  doi             = {10.1007/s12369-013-0201-3},
  file            = {Nishio2013a.pdf:pdf/Nishio2013a.pdf:PDF},
  keywords        = {Teleoperated android robot; Emotion regulation; Facial feedback hypothesis; Body ownership transfer},
}
Ryuji Yamazaki, Shuichi Nishio, Kohei Ogawa, Kohei Matsumura, Takashi Minato, Hiroshi Ishiguro, Tsutomu Fujinami, Masaru Nishikawa, "Promoting Socialization of Schoolchildren Using a Teleoperated Android: An Interaction Study", International Journal of Humanoid Robotics, vol. 10, no. 1, pp. 1350007(1-25), April, 2013.
Abstract: Our research focuses on the social aspects of teleoperated androids as new media for human relationships and explores how they can contribute and encourage people to associate with others. We introduced Telenoid, a teleoperated android with a minimalistic human design, to elementary school classrooms to see how children respond to it. We found that Telenoid encourages children to work cooperatively and facilitates communication with senior citizens with dementia. Children differentiated their roles spontaneously and cooperatively participated in group work. In another class, we applied Telenoid to remote communication between schoolchildren and assisted living residents. The children felt relaxed about continuing their conversations with the elderly and positively participated in them. The results suggest that limited functionality may facilitate cooperation among participants, and varied embodiments may promote the learning process of the association with others, even those who are unfamiliar. We propose a teleoperated android as an educational tool to promote socialization.
BibTeX:
@Article{Yamazaki2012e,
  author          = {Ryuji Yamazaki and Shuichi Nishio and Kohei Ogawa and Kohei Matsumura and Takashi Minato and Hiroshi Ishiguro and Tsutomu Fujinami and Masaru Nishikawa},
  title           = {Promoting Socialization of Schoolchildren Using a Teleoperated Android: An Interaction Study},
  journal         = {International Journal of Humanoid Robotics},
  year            = {2013},
  volume          = {10},
  number          = {1},
  pages           = {1350007(1-25)},
  month           = Apr,
  abstract        = {Our research focuses on the social aspects of teleoperated androids as new media for human relationships and explores how they can contribute and encourage people to associate with others. We introduced Telenoid, a teleoperated android with a minimalistic human design, to elementary school classrooms to see how children respond to it. We found that Telenoid encourages children to work cooperatively and facilitates communication with senior citizens with dementia. Children differentiated their roles spontaneously and cooperatively participated in group work. In another class, we applied Telenoid to remote communication between schoolchildren and assisted living residents. The children felt relaxed about continuing their conversations with the elderly and positively participated in them. The results suggest that limited functionality may facilitate cooperation among participants, and varied embodiments may promote the learning process of the association with others, even those who are unfamiliar. We propose a teleoperated android as an educational tool to promote socialization.},
  day             = {2},
  url             = {http://www.worldscientific.com/doi/abs/10.1142/S0219843613500072},
  doi             = {10.1142/S0219843613500072},
  file            = {Yamazaki2012e.pdf:pdf/Yamazaki2012e.pdf:PDF},
  keywords        = {Telecommunication; android robot; minimal design; cooperation; role differentiation; inter-generational relationship; embodied communication; teleoperation; socialization},
}
港隆史, 境くりま, 西尾修一, 石黒浩, "運動錯視を利用した携帯型遠隔操作ヒューマノイドの運動表現", ヒューマンインタフェース学会論文誌, vol. 15, no. 1, pp. 51-62, February, 2013.
Abstract: A small (cellphone size) human-like robotic avatar in tele-communications will be a novel portable communication medium in that a user can talk with another person while feeling the other's presence at anytime, anywhere. The human-like robotic avatar is expected to express human-like movements; however, there are technical and cost problems to implement actuators in the small body. This paper proposes an idea to illusorily move the avatar's extremities with blinking lights. This idea needs only LEDs (Light Emitting Diodes) and avoids the above problems. This paper designs a LED blinking pattern to invoke a nodding motion of a hand-held tele-operated humanoid robot. A psychological experiment shows that the designed blinking pattern gives better impression to subjects than an symbolic blinking pattern. This result suggests that even the illusory motion of robotic avatar can improve tele-communications and it is suitable for human-like robotic avatars with respect to a minimally human-like motion expression.
BibTeX:
@Article{港隆史2012,
  author          = {港隆史 and 境くりま and 西尾修一 and 石黒浩},
  title           = {運動錯視を利用した携帯型遠隔操作ヒューマノイドの運動表現},
  journal         = {ヒューマンインタフェース学会論文誌},
  year            = {2013},
  volume          = {15},
  number          = {1},
  pages           = {51--62},
  month           = Feb,
  abstract        = {A small (cellphone size) human-like robotic avatar in tele-communications will be a novel portable communication medium in that a user can talk with another person while feeling the other's presence at anytime, anywhere. The human-like robotic avatar is expected to express human-like movements; however, there are technical and cost problems to implement actuators in the small body. This paper proposes an idea to illusorily move the avatar's extremities with blinking lights. This idea needs only LEDs (Light Emitting Diodes) and avoids the above problems. This paper designs a LED blinking pattern to invoke a nodding motion of a hand-held tele-operated humanoid robot. A psychological experiment shows that the designed blinking pattern gives better impression to subjects than an symbolic blinking pattern. This result suggests that even the illusory motion of robotic avatar can improve tele-communications and it is suitable for human-like robotic avatars with respect to a minimally human-like motion expression.},
  etitle          = {Visual Illusory Motion Design of a Hand-held Tele-operated Humanoid Robot for Effective Communication},
  eabstract       = {A small (cellphone size) human-like robotic avatar in tele-communications will be a novel portable communication medium in that a user can talk with another person while feeling the other's presence at anytime, anywhere. The human-like robotic avatar is expected to express human-like movements; however, there are technical and cost problems to implement actuators in the small body. This paper proposes an idea to illusorily move the avatar's extremities with blinking lights. This idea needs only LEDs (Light Emitting Diodes) and avoids the above problems. This paper designs a LED blinking pattern to invoke a nodding motion of a hand-held tele-operated humanoid robot. A psychological experiment shows that the designed blinking pattern gives better impression to subjects than an symbolic blinking pattern. This result suggests that even the illusory motion of robotic avatar can improve tele-communications and it is suitable for human-like robotic avatars with respect to a minimally human-like motion expression.},
  file            = {港隆史2012.pdf:pdf/港隆史2012.pdf:PDF},
  keywords        = {Robotic communication media; Tele-operated robot; Human-like motion; Illusory motion; Minimal design},
}
Kohei Ogawa, Shuichi Nishio, Kensuke Koda, Giuseppe Balistreri, Tetsuya Watanabe, Hiroshi Ishiguro, "Exploring the Natural Reaction of Young and Aged Person with Telenoid in a Real World", Journal of Advanced Computational Intelligence and Intelligent Informatics, vol. 15, no. 5, pp. 592-597, July, 2011.
Abstract: This paper describes two field tests conducted with shopping mall visitors and with aged persons defined as in their 70s to 90s. For both of the field tests, we used an android we developed called Telenoid R1 or just Telenoid. In the following field tests we interviewed participants about their impressions of the Telenoid. The results of the shopping mall showed that almost half of the interviewees felt negative toward Telenoid until they hugged it, after which opinions became positive. Results of the other test showed that the majority of aged persons reported a positive opinion and, interestingly, all aged persons who interacted with Telenoid gave it a hug without any suggestion to do so. This suggests that older persons find Telenoid to be acceptable medium for the elderly. Younger persons may also find Telenoid acceptable, seeing that visitors developed positive feelings toward the robot after giving it a hug. These results should prove valuable in our future work with androids.
BibTeX:
@Article{Ogawa2011,
  author          = {Kohei Ogawa and Shuichi Nishio and Kensuke Koda and Giuseppe Balistreri and Tetsuya Watanabe and Hiroshi Ishiguro},
  title           = {Exploring the Natural Reaction of Young and Aged Person with Telenoid in a Real World},
  journal         = {Journal of Advanced Computational Intelligence and Intelligent Informatics},
  year            = {2011},
  volume          = {15},
  number          = {5},
  pages           = {592--597},
  month           = Jul,
  abstract        = {This paper describes two field tests conducted with shopping mall visitors and with aged persons defined as in their 70s to 90s. For both of the field tests, we used an android we developed called Telenoid R1 or just Telenoid. In the following field tests we interviewed participants about their impressions of the Telenoid. The results of the shopping mall showed that almost half of the interviewees felt negative toward Telenoid until they hugged it, after which opinions became positive. Results of the other test showed that the majority of aged persons reported a positive opinion and, interestingly, all aged persons who interacted with Telenoid gave it a hug without any suggestion to do so. This suggests that older persons find Telenoid to be acceptable medium for the elderly. Younger persons may also find Telenoid acceptable, seeing that visitors developed positive feelings toward the robot after giving it a hug. These results should prove valuable in our future work with androids.},
  url             = {http://www.fujipress.jp/finder/xslt.php?mode=present&inputfile=JACII001500050012.xml},
  file            = {Ogawa2011.pdf:Ogawa2011.pdf:PDF},
  keywords        = {Telenoid; Geminoid; human robot interaction},
}
渡辺哲矢, 西尾修一, 小川浩平, 石黒浩, "遠隔操作によるアンドロイドへの身体感覚の転移", 電子情報通信学会論文誌, The Institute of Electronics, Information and Communication Engineers, vol. J94-D, no. 1, pp. 86-93, January, 2011.
Abstract: 遠隔操作型アンドロイドロボットを操作する際,触覚フィードバックがないにもかかわらず,ロボットの身体に触られると自分に触られたように感じることがある.類似の現象として,身体への触覚刺激に同期して身体以外への物体に触覚刺激を与えている様子を観察させると,身体感覚の転移が生ずる「Rubber Hand Illusion」が知られているが,触覚刺激を伴わない身体感覚の転移についての研究事例は少なく,特に対象物を遠隔操作する際の転移に関する報告はこれまでない.本論文ではアンドロイドの遠隔操作時に身体感覚の転移が実際に生じているのかを検証した.その結果,アンドロイドと操作者の動きが同期した場合に,触覚刺激を与えなくても,身体感覚の転移が生ずることが分かった.
BibTeX:
@Article{渡辺哲矢2011,
  author    = {渡辺哲矢 and 西尾修一 and 小川浩平 and 石黒浩},
  title     = {遠隔操作によるアンドロイドへの身体感覚の転移},
  journal   = {電子情報通信学会論文誌},
  year      = {2011},
  volume    = {{J94-D}},
  number    = {1},
  pages     = {86--93},
  month     = Jan,
  issn      = {18804535},
  abstract  = {遠隔操作型アンドロイドロボットを操作する際,触覚フィードバックがないにもかかわらず,ロボットの身体に触られると自分に触られたように感じることがある.類似の現象として,身体への触覚刺激に同期して身体以外への物体に触覚刺激を与えている様子を観察させると,身体感覚の転移が生ずる「Rubber Hand Illusion」が知られているが,触覚刺激を伴わない身体感覚の転移についての研究事例は少なく,特に対象物を遠隔操作する際の転移に関する報告はこれまでない.本論文ではアンドロイドの遠隔操作時に身体感覚の転移が実際に生じているのかを検証した.その結果,アンドロイドと操作者の動きが同期した場合に,触覚刺激を与えなくても,身体感覚の転移が生ずることが分かった.},
  url       = {http://ci.nii.ac.jp/naid/110008006550/en/},
  etitle    = {Body Ownership Transfer to Android Robot Induced by Teleoperation},
  file      = {渡辺哲矢2011.pdf:渡辺哲矢2011.pdf:PDF},
  publisher = {The Institute of Electronics, Information and Communication Engineers},
}
Shuichi Nishio, Hiroshi Ishiguro, "Attitude Change Induced by Different Appearances of Interaction Agents", International Journal of Machine Consciousness, vol. 3, no. 1, pp. 115-126, 2011.
Abstract: Human-robot interaction studies up to now have been limited to simple tasks such as route guidance or playing simple games. With the advance in robotic technologies, we are now at the stage to explore requirements for highly complicated tasks such as having human-like conversations. When robots start to play advanced roles in our lives such as in health care, attributes such as trust, reliance and persuasiveness will also be important. In this paper, we examine how the appearance of robots affects people's attitudes toward them. Past studies have shown that the appearance of robots is one of the elements that influences people's behavior. However, it is still unknown what effect appearance has when having serious conversations that require high-level activity. Participants were asked to have a discussion with tele-operated robots of various appearances such as an android with high similarity to a human or a humanoid robot that has human-like body parts. Through the discussion, the tele-operator tried to persuade the participants. We examined how appearance affects robots' persuasiveness as well as people's behavior and impression of robots. A possible contribution to machine consciousness research is also discussed.
BibTeX:
@Article{Nishio2011,
  author          = {Shuichi Nishio and Hiroshi Ishiguro},
  title           = {Attitude Change Induced by Different Appearances of Interaction Agents},
  journal         = {International Journal of Machine Consciousness},
  year            = {2011},
  volume          = {3},
  number          = {1},
  pages           = {115--126},
  abstract        = {Human-robot interaction studies up to now have been limited to simple tasks such as route guidance or playing simple games. With the advance in robotic technologies, we are now at the stage to explore requirements for highly complicated tasks such as having human-like conversations. When robots start to play advanced roles in our lives such as in health care, attributes such as trust, reliance and persuasiveness will also be important. In this paper, we examine how the appearance of robots affects people's attitudes toward them. Past studies have shown that the appearance of robots is one of the elements that influences people's behavior. However, it is still unknown what effect appearance has when having serious conversations that require high-level activity. Participants were asked to have a discussion with tele-operated robots of various appearances such as an android with high similarity to a human or a humanoid robot that has human-like body parts. Through the discussion, the tele-operator tried to persuade the participants. We examined how appearance affects robots' persuasiveness as well as people's behavior and impression of robots. A possible contribution to machine consciousness research is also discussed.},
  url             = {http://www.worldscinet.com/ijmc/03/0301/S1793843011000637.html},
  doi             = {10.1142/S1793843011000637},
  file            = {Nishio2011.pdf:Nishio2011.pdf:PDF},
  keywords        = {Robot; appearance; interaction agents; human-robot interaction},
}
Takayuki Kanda, Shuichi Nishio, Hiroshi Ishiguro, Norihiro Hagita, "Interactive Humanoid Robots and Androids in Children's Lives", Children, Youth and Environments, vol. 19, no. 1, pp. 12-33, 2009.
Abstract: This paper provides insight into how recent progress in robotics could affect children's lives in the not-so-distant future. We describe two studies in which robots were presented to children in the context of their daily lives. The results of the first study, which was conducted in an elementary school with a mechanical-looking humanoid robot, showed that the robot affected children's behaviors, feelings, and even their friendships. The second study is a case study in which children performed daily conversational tasks with a geminoid, a teleoperated android robot that resembles a living individual. The results showed that children gradually adapted to conversations with the geminoid and developed an awareness of the personality or presence of the person controlling the geminoid. These studies provide clues to the process of children's adaptation to interactions with robots and particularly how they start treating robots as intelligent beings.
BibTeX:
@Article{Kanda2009,
  author          = {Takayuki Kanda and Shuichi Nishio and Hiroshi Ishiguro and Norihiro Hagita},
  title           = {Interactive Humanoid Robots and Androids in Children's Lives},
  journal         = {Children, Youth and Environments},
  year            = {2009},
  volume          = {19},
  number          = {1},
  pages           = {12--33},
  abstract        = {This paper provides insight into how recent progress in robotics could affect children's lives in the not-so-distant future. We describe two studies in which robots were presented to children in the context of their daily lives. The results of the first study, which was conducted in an elementary school with a mechanical-looking humanoid robot, showed that the robot affected children's behaviors, feelings, and even their friendships. The second study is a case study in which children performed daily conversational tasks with a geminoid, a teleoperated android robot that resembles a living individual. The results showed that children gradually adapted to conversations with the geminoid and developed an awareness of the personality or presence of the person controlling the geminoid. These studies provide clues to the process of children's adaptation to interactions with robots and particularly how they start treating robots as intelligent beings.},
  file            = {Kanda2009.pdf:Kanda2009.pdf:PDF;19_1_02_HumanoidRobots.pdf:http\://www.colorado.edu/journals/cye/19_1/19_1_02_HumanoidRobots.pdf:PDF},
}
Hiroshi Ishiguro, Shuichi Nishio, "Building artificial humans to understand humans", Journal of Artificial Organs, vol. 10, no. 3, pp. 133-142, September, 2007.
Abstract: If we could build an android as a very humanlike robot, how would we humans distinguish a real human from an android? The answer to this question is not so easy. In human-android interaction, we cannot see the internal mechanism of the android, and thus we may simply believe that it is a human. This means that a human can be defined from two perspectives: one by organic mechanism and the other by appearance. Further, the current rapid progress in artificial organs makes this distinction confusing. The approach discussed in this article is to create artificial humans with humanlike appearances. The developed artificial humans, an android and a geminoid, can be used to improve understanding of humans through psychological and cognitive tests conducted using the artificial humans. We call this new approach to understanding humans android science.
BibTeX:
@Article{Ishiguro2007,
  author      = {Hiroshi Ishiguro and Shuichi Nishio},
  title       = {Building artificial humans to understand humans},
  journal     = {Journal of Artificial Organs},
  year        = {2007},
  volume      = {10},
  number      = {3},
  pages       = {133--142},
  month       = Sep,
  abstract    = {If we could build an android as a very humanlike robot, how would we humans distinguish a real human from an android? The answer to this question is not so easy. In human-android interaction, we cannot see the internal mechanism of the android, and thus we may simply believe that it is a human. This means that a human can be defined from two perspectives: one by organic mechanism and the other by appearance. Further, the current rapid progress in artificial organs makes this distinction confusing. The approach discussed in this article is to create artificial humans with humanlike appearances. The developed artificial humans, an android and a geminoid, can be used to improve understanding of humans through psychological and cognitive tests conducted using the artificial humans. We call this new approach to understanding humans android science.},
  url         = {http://www.springerlink.com/content/pmv076w723140244/},
  doi         = {10.1007/s10047-007-0381-4},
  file        = {Ishiguro2007.pdf:Ishiguro2007.pdf:PDF},
  institution = {{ATR} Intelligent Robotics and Communication Laboratories, Department of Adaptive Machine Systems, Osaka University, Osaka, Japan.},
  keywords    = {Behavior; Behavioral Sciences, methods; Cognitive Science, methods; Facial Expression; Female; Humans, anatomy /&/ histology/psychology; Male; Movement; Perception; Robotics, instrumentation/methods},
  medline-pst = {ppublish},
  pmid        = {17846711},
}
Shuichi Nishio, Hiroshi Ishiguro, Norihiro Hagita, "Can a Teleoperated Android Represent Personal Presence? - A Case Study with Children", Psychologia, vol. 50, no. 4, pp. 330-342, 2007.
Abstract: Our purpose is to investigate the key elements for representing personal presence, which is the sense of being with a certain individual. A case study is reported in which children performed daily conversational tasks with a geminoid, a teleoperated android robot that resembles a living individual. Different responses to the geminoid and the original person are examined, especially concentrating on the case where the target child was the daughter of the geminoid source. Results showed that children gradually became adapted to conversation with the geminoid, but the operator's personal presence was not completely represented. Further research topics on the adaptation process to androids and on seeking for the key elements on personal presence are discussed.
BibTeX:
@Article{Nishio2007,
  author          = {Shuichi Nishio and Hiroshi Ishiguro and Norihiro Hagita},
  title           = {Can a Teleoperated Android Represent Personal Presence? - A Case Study with Children},
  journal         = {Psychologia},
  year            = {2007},
  volume          = {50},
  number          = {4},
  pages           = {330--342},
  abstract        = {Our purpose is to investigate the key elements for representing personal presence, which is the sense of being with a certain individual. A case study is reported in which children performed daily conversational tasks with a geminoid, a teleoperated android robot that resembles a living individual. Different responses to the geminoid and the original person are examined, especially concentrating on the case where the target child was the daughter of the geminoid source. Results showed that children gradually became adapted to conversation with the geminoid, but the operator's personal presence was not completely represented. Further research topics on the adaptation process to androids and on seeking for the key elements on personal presence are discussed.},
  url             = {http://www.jstage.jst.go.jp/article/psysoc/50/4/50_330/_article},
  doi             = {10.2117/psysoc.2007.330},
  file            = {Nishio2007.pdf:Nishio2007.pdf:PDF},
}
会議発表(査読あり)
Jan Magya, Masahiko Kobayashi, Shuichi Nishio, Peter Sincak, Hiroshi Ishiguro, "Autonomous Robotic Dialogue System with Reinforcement Learning for Elderlies with Dementia", In 2019 IEEE International Conference on Systems, Man, and Cybernetics(SMC), Bari, Italy, pp. 1-6, October, 2019.
Abstract: To learn the pattern of the response of them, we used reinforcement learning to adapt to each elderly individually. Moreover, the robot which does not depend on speech recognition estimates the elderly’s state from their nonverbal information. We experimented with three elderly people with dementia in a care home.
BibTeX:
@Inproceedings{Magya2019,
  author    = {Jan Magya and Masahiko Kobayashi and Shuichi Nishio and Peter Sincak and Hiroshi Ishiguro},
  title     = {Autonomous Robotic Dialogue System with Reinforcement Learning for Elderlies with Dementia},
  booktitle = {2019 IEEE International Conference on Systems, Man, and Cybernetics(SMC)},
  year      = {2019},
  pages     = {1-6},
  address   = {Bari, Italy},
  month     = oct,
  day       = {6-9},
  url       = {http://smc2019.org/index.html},
  abstract  = {To learn the pattern of the response of them, we used reinforcement learning to adapt to each elderly individually. Moreover, the robot which does not depend on speech recognition estimates the elderly’s state from their nonverbal information. We experimented with three elderly people with dementia in a care home.},
}
Abdelkader Nasreddine Belkacem, Shuichi Nishio, Takafumi Suzuki, Hiroshi Ishiguro, Masayuki Hirata, "Neuromagnetic Geminoid Control by BCI based on Four Bilateral Hand Movements", In 2018 IEEE International Conference on Systems, Man, and Cybernetics (SMC2018), Seagaia Convention Center, Miyazaki, pp. 524-527, October, 2018.
Abstract: The present study describes neuromagnetic Geminoid control system by using single-trial decoding of bilateral hand movements as a new approach to enhance a user’s ability to interact with a complex environment through a multidimensional brain-computer interface (BCI).
BibTeX:
@Inproceedings{Belkacem2018b,
  author    = {Abdelkader Nasreddine Belkacem and Shuichi Nishio and Takafumi Suzuki and Hiroshi Ishiguro and Masayuki Hirata},
  title     = {Neuromagnetic Geminoid Control by BCI based on Four Bilateral Hand Movements},
  booktitle = {2018 IEEE International Conference on Systems, Man, and Cybernetics (SMC2018)},
  year      = {2018},
  pages     = {524-527},
  address   = {Seagaia Convention Center, Miyazaki},
  month     = Oct,
  day       = {7-10},
  doi       = {10.1109/SMC.2018.00183},
  url       = {http://www.smc2018.org/},
  abstract  = {The present study describes neuromagnetic Geminoid control system by using single-trial decoding of bilateral hand movements as a new approach to enhance a user’s ability to interact with a complex environment through a multidimensional brain-computer interface (BCI).},
}
Christian Penaloza, David Hernandez-Carmona, Shuichi Nishio, "Towards Intelligent Brain-Controlled Body Augmentation Robotic Limbs", In The 2018 IEEE International Conference on Systems, Man, and Cybernetics (SMC2018), Seagaia Convention Center, Miyazaki, October, 2018.
Abstract: Supernumerary Robotic Limbs (SRL) are body augmentation robotic devices that will extend the physical capabilities of humans in an unprecedented way. Researchers have explored the possibility to control SRLs in diverse ways - from manual operation through a joystick to myoelectric signals from muscle impulses - but the ultimate goal is to be able to control them with the brain. Brain-machine interface systems (BMI) have allowed the control of prosthetics and robotic devices using brainwaves alone, but the low number of brain-based commands that can be decoded does not allow an SRL to achieve a high number of actions. For this reason, in this paper, we present an intelligent brain-controlled SRL that has context-aware capabilities in order to complement BMI-based commands and increase the number of actions that it can perform with the same BMI-based command. The proposed system consists of a human-like robotic limb that can be activated (i.e. grasp action) with a non-invasive EEG-based BMI when the human operator imagines the action. Since there are different ways that the SRL can perform the action (i.e. different grasping configurations) depending on the context (i.e. type of the object), we provided vision capabilities to the SRL so it can recognize the context and optimize its behavior in order to match the user intention. The proposed hybrid BMI-SRL system opens up the possibilities to explore more complex and realistic human augmentation applications.
BibTeX:
@Inproceedings{Penaloza2018b,
  author    = {Christian Penaloza and David Hernandez-Carmona and Shuichi Nishio},
  title     = {Towards Intelligent Brain-Controlled Body Augmentation Robotic Limbs},
  booktitle = {The 2018 IEEE International Conference on Systems, Man, and Cybernetics (SMC2018)},
  year      = {2018},
  address   = {Seagaia Convention Center, Miyazaki},
  month     = Oct,
  day       = {7-10},
  doi       = {10.1109/SMC.2018.00180},
  url       = {http://www.smc2018.org/},
  abstract  = {Supernumerary Robotic Limbs (SRL) are body augmentation robotic devices that will extend the physical capabilities of humans in an unprecedented way. Researchers have explored the possibility to control SRLs in diverse ways - from manual operation through a joystick to myoelectric signals from muscle impulses - but the ultimate goal is to be able to control them with the brain. Brain-machine interface systems (BMI) have allowed the control of prosthetics and robotic devices using brainwaves alone, but the low number of brain-based commands that can be decoded does not allow an SRL to achieve a high number of actions. For this reason, in this paper, we present an intelligent brain-controlled SRL that has context-aware capabilities in order to complement BMI-based commands and increase the number of actions that it can perform with the same BMI-based command. The proposed system consists of a human-like robotic limb that can be activated (i.e. grasp action) with a non-invasive EEG-based BMI when the human operator imagines the action. Since there are different ways that the SRL can perform the action (i.e. different grasping configurations) depending on the context (i.e. type of the object), we provided vision capabilities to the SRL so it can recognize the context and optimize its behavior in order to match the user intention. The proposed hybrid BMI-SRL system opens up the possibilities to explore more complex and realistic human augmentation applications.},
}
Jakub Zlotowski, Hidenobu Sumioka, Christoph Bartneck, Shuichi Nishio, Hiroshi Ishiguro, "Understanding Anthropomorphism: Anthropomorphism is not a Reverse Process of Dehumanization", In The Ninth International Conference on Social Robotics (ICSR 2017), Tsukuba, Japan, pp. 618-627, November, 2017.
Abstract: Anthropomorphism plays an important role in affecting human interaction with a robot. However, our understanding of this process is still limited. We argue that it is not possible to understand anthropomorphism without understanding what is humanness. In the previous research, we proposed to look at the work on dehumanization in order to understand what factors can affect a robot's anthropomorphism. Moreover, considering that there are two distinct dimensions of humanness, a two-dimensional model of anthropomorphism was proposed. We conducted a study in which we manipulated the perceived intentionality of a robot and its appearance, and measured how they affected the anthropomorphization of a robot on two dimensions of humanness and its perceived moral agency. The results do not support a two-dimensional model of anthropomorphism and indicate that the distinction between positive and negative traits may be more relevant in HRI studies in Japan.
BibTeX:
@Inproceedings{Zlotowski2017a,
  author    = {Jakub Zlotowski and Hidenobu Sumioka and Christoph Bartneck and Shuichi Nishio and Hiroshi Ishiguro},
  title     = {Understanding Anthropomorphism: Anthropomorphism is not a Reverse Process of Dehumanization},
  booktitle = {The Ninth International Conference on Social Robotics (ICSR 2017)},
  year      = {2017},
  series    = {LNAI 10652},
  pages     = {618-627},
  address   = {Tsukuba, Japan},
  month     = Nov,
  day       = {22-24},
  doi       = {10.1007/978-3-319-70022-9_61},
  url       = {http://www.icsr2017.org/index.html},
  abstract  = {Anthropomorphism plays an important role in affecting human interaction with a robot. However, our understanding of this process is still limited. We argue that it is not possible to understand anthropomorphism without understanding what is humanness. In the previous research, we proposed to look at the work on dehumanization in order to understand what factors can affect a robot's anthropomorphism. Moreover, considering that there are two distinct dimensions of humanness, a two-dimensional model of anthropomorphism was proposed. We conducted a study in which we manipulated the perceived intentionality of a robot and its appearance, and measured how they affected the anthropomorphization of a robot on two dimensions of humanness and its perceived moral agency. The results do not support a two-dimensional model of anthropomorphism and indicate that the distinction between positive and negative traits may be more relevant in HRI studies in Japan.},
  file      = {Zlotowski2017a.pdf:pdf/Zlotowski2017a.pdf:PDF},
}
Masa Jazbec, Shuichi Nishio, Hiroshi Ishiguro, Hideaki Kuzuoka, Masataka Okubo, Christian Penaloza, "Body-swapping experiment with an android robot Investigation of the relationship between agency and a sense of ownership toward a different body", In 2017 IEEE International Conference on Systems, Man, and Cybernetics (SMC2017), Banff, Canada, pp. 1471-1476, October, 2017.
Abstract: This study extends existing Rubber Hand Illusion (RHI) experiments to employ life-size full-body humanlike android robot to investigate body ownership illusion and the sense of agency.
BibTeX:
@Inproceedings{Jazbec2017a,
  author    = {Masa Jazbec and Shuichi Nishio and Hiroshi Ishiguro and Hideaki Kuzuoka and Masataka Okubo and Christian Penaloza},
  title     = {Body-swapping experiment with an android robot Investigation of the relationship between agency and a sense of ownership toward a different body},
  booktitle = {2017 IEEE International Conference on Systems, Man, and Cybernetics (SMC2017)},
  year      = {2017},
  pages     = {1471-1476},
  address   = {Banff, Canada},
  month     = Oct,
  day       = {5-8},
  url       = {http://www.smc2017.org/},
  abstract  = {This study extends existing Rubber Hand Illusion (RHI) experiments to employ life-size full-body humanlike android robot to investigate body ownership illusion and the sense of agency.},
  file      = {Jazbec2017a.pdf:pdf/Jazbec2017a.pdf:PDF},
}
Rosario Sorbello, Salvatore Tramonte, Carmelo Cali, Marcello Giardina, Shuichi Nishio, Hiroshi Ishiguro, Antonio Chella, "An Android Architecture for Bio-inspired Honest Signalling in Human-Humanoid Interaction", In Biologically Inspired Cognitive Architectures 2017 (BICA 2017), Moscow, Russia, August, 2017.
Abstract: This paper outlines an augmented robotic architecture to study the conditions of successful Human-Humanoid Interaction (HHI). The architecture is designed as a testable model generator for interaction centred on the ability to emit, display and detect honest signals. First we overview the biological theory in which the concept of honest signals has been put forward in order to assess its explanatory power. We reconstruct the application of the concept of honest signalling in accounting for interaction in strategic contexts and in laying bare the foundation for an automated social metrics. We describe the modules of the architecture, which is intended to implement the concept of honest signalling in connection with a refinement provided by delivering the sense of co-presence in a shared environment. Finally, an analysis of Honest Signals, in term of body postures, exhibited by participants during the preliminary experiment with the Geminoid Hi-1 is provided.
BibTeX:
@Inproceedings{Sorbello2017,
  author    = {Rosario Sorbello and Salvatore Tramonte and Carmelo Cali and Marcello Giardina and Shuichi Nishio and Hiroshi Ishiguro and Antonio Chella},
  title     = {An Android Architecture for Bio-inspired Honest Signalling in Human-Humanoid Interaction},
  booktitle = {Biologically Inspired Cognitive Architectures 2017 (BICA 2017)},
  year      = {2017},
  address   = {Moscow, Russia},
  month     = Aug,
  day       = {1-6},
  url       = {http://bica2017.bicasociety.org/},
  abstract  = {This paper outlines an augmented robotic architecture to study the conditions of successful Human-Humanoid Interaction (HHI). The architecture is designed as a testable model generator for interaction centred on the ability to emit, display and detect honest signals. First we overview the biological theory in which the concept of honest signals has been put forward in order to assess its explanatory power. We reconstruct the application of the concept of honest signalling in accounting for interaction in strategic contexts and in laying bare the foundation for an automated social metrics. We describe the modules of the architecture, which is intended to implement the concept of honest signalling in connection with a refinement provided by delivering the sense of co-presence in a shared environment. Finally, an analysis of Honest Signals, in term of body postures, exhibited by participants during the preliminary experiment with the Geminoid Hi-1 is provided.},
  file      = {Sorbello2017.pdf:pdf/Sorbello2017.pdf:PDF},
}
Rosario Sorbello, Salvatore Tramonte, Marcello Giardina, Carmelo Cali, Shuichi Nishio, Hiroshi Ishiguro, Antonio Chella, "Augmented Embodied Emotions by Geminoid Robot induced by Human Bio-feedback Brain Features in a Musical Experience", In Biologically Inspired Cognitive Architectures 2017 (BICA 2017), Moscow, Russia, August, 2017.
Abstract: This paper presents the conceptual framework for a study of musical experience and the associated architecture centred on Human-Humanoid Interaction (HHI). We discuss the state of the art of the theoretical and the experimental research into the cognitive capacity of music. We overview the results that points to the correspondence between the perceptual structures, the cognitive organization of sounds in music, the motor and a ective behaviour. On such grounds we bring in the concepts of musical tensions and functional connections as the constructs that account for such correspondence in music experience. Finally we describe the architecture as a models generator system whose modules can be employed to test this correspondence from which the perceptual, cognitive, a ective and motor constituents of musical capacity may emerge.
BibTeX:
@Inproceedings{Sorbello2017a,
  author    = {Rosario Sorbello and Salvatore Tramonte and Marcello Giardina and Carmelo Cali and Shuichi Nishio and Hiroshi Ishiguro and Antonio Chella},
  title     = {Augmented Embodied Emotions by Geminoid Robot induced by Human Bio-feedback Brain Features in a Musical Experience},
  booktitle = {Biologically Inspired Cognitive Architectures 2017 (BICA 2017)},
  year      = {2017},
  address   = {Moscow, Russia},
  month     = Aug,
  day       = {1-6},
  url       = {http://bica2017.bicasociety.org/},
  abstract  = {This paper presents the conceptual framework for a study of musical experience and
the associated architecture centred on Human-Humanoid Interaction (HHI). We discuss
the state of the art of the theoretical and the experimental research into the cognitive
capacity of music. We overview the results that points to the correspondence between the
perceptual structures, the cognitive organization of sounds in music, the motor and aective
behaviour. On such grounds we bring in the concepts of musical tensions and functional
connections as the constructs that account for such correspondence in music experience.
Finally we describe the architecture as a models generator system whose modules can be
employed to test this correspondence from which the perceptual, cognitive, aective and
motor constituents of musical capacity may emerge.},
  file      = {Sorbello2017a.pdf:pdf/Sorbello2017a.pdf:PDF},
}
Masa Jazbec, Shuichi Nishio, Hiroshi Ishiguro, Masataka Okubo, Christian Penaloza, "Body-swapping Experiment with an Android - Investigation of The Relationship Between Agency and a Sense of Ownership Toward a Different Body", In The 2017 Conference on Human-Robot Interaction (HRI2017), Vienna, Austria, pp. 143-144, March, 2017.
Abstract: The experiment described in this paper is performed within a system that provides a human with the possibility and capability to be physically immersed in the body of an android robot, Geminoid HI-2.
BibTeX:
@Inproceedings{Jazbec2017,
  author    = {Masa Jazbec and Shuichi Nishio and Hiroshi Ishiguro and Masataka Okubo and Christian Penaloza},
  title     = {Body-swapping Experiment with an Android - Investigation of The Relationship Between Agency and a Sense of Ownership Toward a Different Body},
  booktitle = {The 2017 Conference on Human-Robot Interaction (HRI2017)},
  year      = {2017},
  pages     = {143-144},
  address   = {Vienna, Austria},
  month     = Mar,
  url       = {http://humanrobotinteraction.org/2017/},
  abstract  = {The experiment described in this paper is performed within a system that provides a human with the possibility and capability to be physically immersed in the body of an android robot, Geminoid HI-2.},
}
Maryam Alimardani, Shuichi Nishio, Hiroshi Ishiguro, "BCI-teleoperated androids; A study of embodiment and its effect on motor imagery learning", In Workshop "Quo Vadis Robotics & Intelligent Systems" in IEEE 19 th International Conference on Intelligent Engineering Systems 2015, Bratislava, Slovakia, September, 2015.
Abstract: This paper presents a brain computer interface(BCI) system developed for the tele-operation of a very humanlike android. Employing this system, we review two studies that give insights into the cognitive mechanism of agency and body ownership during BCI control, as well as feedback designs for optimization of user's BCI skills. In the first experiment operators experienced an illusion of embodiment (in terms of body ownership and agency) for the robot's body only by imagining a movement (motor imagery) and watching the robot perform it. Also using the same setup, we could further discover that during BCIoperation of the android, biasing the timing and accuracy of the performance feedback could improve operators'modulation of brain activities during the motor imagery task. Our experiments showed that the motor imagery skills acquired through this technique were not limited to the android robot, and had long-lasting effects for other BCI usage as well. Therefore, by focusing on the human side of BCIs and demonstrating a relationship between the body ownership sensation and motor imagery learning, our BCIteleoperation system offers a new and efficient platform for general BCI application.
BibTeX:
@Inproceedings{Alimardani2015,
  author    = {Maryam Alimardani and Shuichi Nishio and Hiroshi Ishiguro},
  title     = {BCI-teleoperated androids; A study of embodiment and its effect on motor imagery learning},
  booktitle = {Workshop "Quo Vadis Robotics \& Intelligent Systems" in IEEE 19 th International Conference on Intelligent Engineering Systems 2015},
  year      = {2015},
  address   = {Bratislava, Slovakia},
  month     = Sep,
  abstract  = {This paper presents a brain computer interface(BCI) system developed for the tele-operation of a very humanlike android. Employing this system, we review two studies that give insights into the cognitive mechanism of agency and body ownership during BCI control, as well as feedback designs for optimization of user's BCI skills. In the first experiment operators experienced an illusion of embodiment (in terms of body ownership and agency) for the robot's body only by imagining a movement (motor imagery) and watching the robot perform it. Also using the same setup, we could further discover that during BCIoperation of the android, biasing the timing and accuracy of the performance feedback could improve operators'modulation of brain activities during the motor imagery task. Our experiments showed that the motor imagery skills acquired through this technique were not limited to the android robot, and had long-lasting effects for other BCI usage as well. Therefore, by focusing on the human side of BCIs and demonstrating a relationship between the body ownership sensation and motor imagery learning, our BCIteleoperation system offers a new and efficient platform for general BCI application.},
  file      = {Alimardani2015.pdf:pdf/Alimardani2015.pdf:PDF},
}
Maryam Alimardani, Shuichi Nishio, Hiroshi Ishiguro, "The effect of feedback presentation on motor imagery performance during BCI-teleoperation of a humanlike robot", In IEEE International Conference on Biomedical Robotics and Biomechatronics, Sao Paulo, Brazil, pp. 403-408, August, 2014.
Abstract: Users of a brain-computer interface (BCI) learn to co-adapt with the system through the feedback they receive. Particularly in case of motor imagery BCIs, feedback design can play an important role in the course of motor imagery training. In this paper we investigated the effect of biased visual feedback on performance and motor imagery skills of users during BCI control of a pair of humanlike robotic hands. Although the subject specific classifier, which was set up at the beginning of experiment, detected no significant change in the subjects' online performance, evaluation of brain activity patterns revealed that subjects' self-regulation of motor imagery features improved due to a positive bias of feedback. We discuss how this effect could be possibly due to the humanlike design of feedback and occurrence of body ownership illusion. Our findings suggest that in general training protocols for BCIs, realistic feedback design and subject's self-evaluation of performance can play an important role in the optimization of motor imagery skills.
BibTeX:
@Inproceedings{Alimardani2014,
  author          = {Maryam Alimardani and Shuichi Nishio and Hiroshi Ishiguro},
  title           = {The effect of feedback presentation on motor imagery performance during BCI-teleoperation of a humanlike robot},
  booktitle       = {IEEE International Conference on Biomedical Robotics and Biomechatronics},
  year            = {2014},
  pages           = {403-408},
  address         = {Sao Paulo, Brazil},
  month           = Aug,
  day             = {12-15},
  doi             = {10.1109/BIOROB.2014.6913810},
  abstract        = {Users of a brain-computer interface (BCI) learn to co-adapt with the system through the feedback they receive. Particularly in case of motor imagery BCIs, feedback design can play an important role in the course of motor imagery training. In this paper we investigated the effect of biased visual feedback on performance and motor imagery skills of users during BCI control of a pair of humanlike robotic hands. Although the subject specific classifier, which was set up at the beginning of experiment, detected no significant change in the subjects' online performance, evaluation of brain activity patterns revealed that subjects' self-regulation of motor imagery features improved due to a positive bias of feedback. We discuss how this effect could be possibly due to the humanlike design of feedback and occurrence of body ownership illusion. Our findings suggest that in general training protocols for BCIs, realistic feedback design and subject's self-evaluation of performance can play an important role in the optimization of motor imagery skills.},
  file            = {Alimardani2014b.pdf:pdf/Alimardani2014b.pdf:PDF},
}
Daisuke Nakamichi, Shuichi Nishio, Hiroshi Ishiguro, "Training of telecommunication through teleoperated android "Telenoid" and its effect", In The 23rd IEEE International Symposium on Robot and Human Interactive Communication, Edinburgh, Scotland, UK, pp. 1083-1088, August, 2014.
Abstract: Telenoid, a teleoperated android is a medium through which its teleoperators can transmit both verbal and nonverbal information to interlocutors. Telenoid promotes conversation with its interlocutors, especially elderly people. But since teleoperators admit that they have difficulty feeling that they are actually teleoperating their robots, they can't use them effectively to transmit nonverbal information; such nonverbal information is one of Telenoid's biggest merits. In this paper, we propose a training program for teleoperators so that they can understand Telenoid's teleoperation and how to transmit nonverbal information through it. We investigated its effect on teleoperation and communication and identified three results. First, our training improved Telenoid's head motions for clearer transmission of nonverbal information. Second, our training found different effects between genders. Females communicated with their interlocutors more smoothly than males. Males communicated with their interlocutors more smoothly by simply more talking practice. Third, correlations exist among freely controlling the robot, regarding the robot as themselves, and tele-presence in the interlocutors room as well as correlations between the interactions and themselves. But there are not correlations between feelings about Telenoids teleoperation and the head movements.
BibTeX:
@Inproceedings{Nakamichi2014,
  author          = {Daisuke Nakamichi and Shuichi Nishio and Hiroshi Ishiguro},
  title           = {Training of telecommunication through teleoperated android "Telenoid" and its effect},
  booktitle       = {The 23rd IEEE International Symposium on Robot and Human Interactive Communication},
  year            = {2014},
  pages           = {1083-1088},
  address         = {Edinburgh, Scotland, UK},
  month           = Aug,
  day             = {25-29},
  url             = {http://rehabilitationrobotics.net/ro-man14/},
  abstract        = {Telenoid, a teleoperated android is a medium through which its teleoperators can transmit both verbal and nonverbal information to interlocutors. Telenoid promotes conversation with its interlocutors, especially elderly people. But since teleoperators admit that they have difficulty feeling that they are actually teleoperating their robots, they can't use them effectively to transmit nonverbal information; such nonverbal information is one of Telenoid's biggest merits. In this paper, we propose a training program for teleoperators so that they can understand Telenoid's teleoperation and how to transmit nonverbal information through it. We investigated its effect on teleoperation and communication and identified three results. First, our training improved Telenoid's head motions for clearer transmission of nonverbal information. Second, our training found different effects between genders. Females communicated with their interlocutors more smoothly than males. Males communicated with their interlocutors more smoothly by simply more talking practice. Third, correlations exist among freely controlling the robot, regarding the robot as themselves, and tele-presence in the interlocutors room as well as correlations between the interactions and themselves. But there are not correlations between feelings about Telenoids teleoperation and the head movements.},
  file            = {Nakamichi2014.pdf:pdf/Nakamichi2014.pdf:PDF},
}
Rosario Sorbello, Antonio Chella, Marcello Giardina, Shuichi Nishio, Hiroshi Ishiguro, "An Architecture for Telenoid Robot as Empathic Conversational Android Companion for Elderly People", In the 13th International Conference on Intelligent Autonomous Systems, Padova, Italy, July, 2014.
Abstract: In Human-Humanoid Interaction (HHI), empathy is a crucial key in order to overcome the current limitations of social robots. In facts, a principal de ning characteristic of human social behaviour is empathy. The present paper presents a robotic architecture for an android robot as a basis for natural empathic human-android interaction. We start from the hypothesis that the robots, in order to become personal companions need to know how to empathic interact with human beings. To validate our research, we have used the proposed system with the minimalistic humanoid robot Telenoid. We have conducted human-robot interactions test with elderly people with no prior interaction experience with robot. During the experiment the elderly persons engaged a stimulated conversation with the humanoid robot. Our goal is to overcome the state of loneliness of elderly people using this minimalistic humanoid robot capa- ble to exhibit a dialogue similar to what usually happens in the real life between human beings.The experimental results have shown a humanoid robotic system capable to exhibit a natural and empathic interaction and conversation with a human user.
BibTeX:
@Inproceedings{Sorbello2014,
  author    = {Rosario Sorbello and Antonio Chella and Marcello Giardina and Shuichi Nishio and Hiroshi Ishiguro},
  title     = {An Architecture for Telenoid Robot as Empathic Conversational Android Companion for Elderly People},
  booktitle = {the 13th International Conference on Intelligent Autonomous Systems},
  year      = {2014},
  address   = {Padova, Italy},
  month     = Jul,
  day       = {15-19},
  abstract  = {In Human-Humanoid Interaction (HHI), empathy is a crucial key in order to overcome the current limitations of social robots. In facts, a principal dening characteristic of human social behaviour is empathy. The present paper presents a robotic architecture for an android robot as a basis for natural empathic human-android interaction. We start from the hypothesis that the robots, in order to become personal companions need to know how to empathic interact with human beings. To validate our research, we have used the proposed system with the minimalistic humanoid robot Telenoid. We have conducted human-robot interactions test with elderly people with no prior interaction experience with robot. During the experiment the elderly persons engaged a stimulated conversation with the humanoid robot. Our goal is to overcome the state of loneliness of elderly people using this minimalistic humanoid robot capa- ble to exhibit a dialogue similar to what usually happens in the real life between human beings.The experimental results have shown a humanoid robotic system capable to exhibit a natural and empathic interaction and conversation with a human user.},
  file      = {Sorbello2014.pdf:pdf/Sorbello2014.pdf:PDF},
  keywords  = {Humanoid Robot; Humanoid Robot Interaction; Life Support Empathic Robot; Telenoid},
}
Kaiko Kuwamura, Shuichi Nishio, Hiroshi Ishiguro, "Designing Robots for Positive Communication with Senior Citizens", In The 13th Intelligent Autonomous Systems conference, Padova, Italy, July, 2014.
Abstract: Several previous researches indicated that the elderly, especially those with cognitive disorders, have positive impressions of Telenoid, a teleoperated android covered with soft vinyl. Senior citizens with cognitive disorders have low cognitive ability and duller senses due to their age. To communicate, we believe that they have to imagine the information that is missing because they failed to completely receive it in their mind. We hypothesize that Telenoid triggers and enhances such an ability to imagine and positively complete the information, and so they become attracted to Telenoid. Based on this hypothesis, we discuss the factors that trigger imagination and complete positive impressions toward a robot for elderly care.
BibTeX:
@Inproceedings{Kuwamura2014c,
  author          = {Kaiko Kuwamura and Shuichi Nishio and Hiroshi Ishiguro},
  title           = {Designing Robots for Positive Communication with Senior Citizens},
  booktitle       = {The 13th Intelligent Autonomous Systems conference},
  year            = {2014},
  address         = {Padova, Italy},
  month           = Jul,
  day             = {15-19},
  url             = {http://www.ias-13.org/},
  abstract        = {Several previous researches indicated that the elderly, especially those with cognitive disorders, have positive impressions of Telenoid, a teleoperated android covered with soft vinyl. Senior citizens with cognitive disorders have low cognitive ability and duller senses due to their age. To communicate, we believe that they have to imagine the information that is missing because they failed to completely receive it in their mind. We hypothesize that Telenoid triggers and enhances such an ability to imagine and positively complete the information, and so they become attracted to Telenoid. Based on this hypothesis, we discuss the factors that trigger imagination and complete positive impressions toward a robot for elderly care.},
  file            = {Kuwamura2014c.pdf:pdf/Kuwamura2014c.pdf:PDF},
}
Kaiko Kuwamura, Ryuji Yamazaki, Shuichi Nishio, Hiroshi Ishiguro, "Elderly Care Using Teleoperated Android Telenoid", In The 9th World Conference of Gerontechnology, vol. 13, no. 2, Taipei, Taiwan, pp. 226, June, 2014.
BibTeX:
@Inproceedings{Kuwamura2014,
  author    = {Kaiko Kuwamura and Ryuji Yamazaki and Shuichi Nishio and Hiroshi Ishiguro},
  title     = {Elderly Care Using Teleoperated Android Telenoid},
  booktitle = {The 9th World Conference of Gerontechnology},
  year      = {2014},
  volume    = {13},
  number    = {2},
  pages     = {226},
  address   = {Taipei, Taiwan},
  month     = Jun,
  day       = {18-21},
  doi       = {10.4017/gt.2014.13.02.091.00},
  url       = {http://gerontechnology.info/index.php/journal/article/view/gt.2014.13.02.091.00},
  file      = {Kuwamura2014.pdf:pdf/Kuwamura2014.pdf:PDF},
  keywords  = {Elderly care robot; teleoperated android; cognitive disorder},
}
Ryuji Yamazaki, Kaiko Kuwamura, Shuichi Nishio, Takashi Minato, Hiroshi Ishiguro, "Activating Embodied Communication: A Case Study of People with Dementia Using a Teleoperated Android Robot", In The 9th World Conference of Gerontechnology, vol. 13, no. 2, Taipei, Taiwan, pp. 311, June, 2014.
BibTeX:
@Inproceedings{Yamazaki2014a,
  author    = {Ryuji Yamazaki and Kaiko Kuwamura and Shuichi Nishio and Takashi Minato and Hiroshi Ishiguro},
  title     = {Activating Embodied Communication: A Case Study of People with Dementia Using a Teleoperated Android Robot},
  booktitle = {The 9th World Conference of Gerontechnology},
  year      = {2014},
  volume    = {13},
  number    = {2},
  pages     = {311},
  address   = {Taipei, Taiwan},
  month     = Jun,
  day       = {18-21},
  doi       = {10.4017/gt.2014.13.02.166.00},
  url       = {http://gerontechnology.info/index.php/journal/article/view/gt.2014.13.02.166.00/0},
  file      = {Yamazaki2014a.pdf:pdf/Yamazaki2014a.pdf:PDF},
  keywords  = {Elderly care robot; social isolation; embodied communication; community design},
}
Kaiko Kuwamura, Shuichi Nishio, "Modality reduction for enhancing human likeliness", In Selected papers of the 50th annual convention of the Artificial Intelligence and the Simulation of Behaviour, London, UK, pp. 83-89, April, 2014.
Abstract: We proposed a method to enhance one's affection by reducing number of transferred modalities. When we dream of an artificial partner for “love", its appearance is the first thing of con- cern; a very humanlike, beautiful robot. However, we did not design a medium with a beautiful appearance but a medium which ignores the appearance and let users imagine and complete the appearance. By reducing the number of transferred modalities, we can enhance one's affection toward a robot. Moreover, not just by transmitting, but by inducing active, unconscious behavior of users, we can increase this effect. In this paper, we will introduce supporting results from our experiments and discuss further applicability of our findings.
BibTeX:
@Inproceedings{Kuwamura2014b,
  author          = {Kaiko Kuwamura and Shuichi Nishio},
  title           = {Modality reduction for enhancing human likeliness},
  booktitle       = {Selected papers of the 50th annual convention of the Artificial Intelligence and the Simulation of Behaviour},
  year            = {2014},
  pages           = {83-89},
  address         = {London, UK},
  month           = Apr,
  day             = {1-4},
  url             = {http://doc.gold.ac.uk/aisb50/AISB50-S16/AISB50-S16-Kuwamura-paper.pdf},
  abstract        = {We proposed a method to enhance one's affection by reducing number of transferred modalities. When we dream of an artificial partner for “love", its appearance is the first thing of con- cern; a very humanlike, beautiful robot. However, we did not design a medium with a beautiful appearance but a medium which ignores the appearance and let users imagine and complete the appearance. By reducing the number of transferred modalities, we can enhance one's affection toward a robot. Moreover, not just by transmitting, but by inducing active, unconscious behavior of users, we can increase this effect. In this paper, we will introduce supporting results from our experiments and discuss further applicability of our findings.},
  file            = {Kuwamura2014b.pdf:pdf/Kuwamura2014b.pdf:PDF},
}
Kaiko Kuwamura, Kurima Sakai, Takashi Minato, Shuichi Nishio, Hiroshi Ishiguro, "Hugvie: A medium that fosters love", In IEEE International Symposium on Robot and Human Interactive Communication, Gyeongju, Korea, pp. 70-75, August, 2013.
Abstract: We introduce a communication medium that en- courages users to fall in love with their counterparts. Hugvie, the huggable tele-presence medium, enables users to feel like hugging their counterparts while chatting. In this paper, we report that when a participant talks to his communication partner during their first encounter while hugging Hugvie, he mistakenly feels as if they are establishing a good relationship and that he is being loved rather than just being liked.
BibTeX:
@Inproceedings{Kuwamura2013,
  author          = {Kaiko Kuwamura and Kurima Sakai and Takashi Minato and Shuichi Nishio and Hiroshi Ishiguro},
  title           = {Hugvie: A medium that fosters love},
  booktitle       = {{IEEE} International Symposium on Robot and Human Interactive Communication},
  year            = {2013},
  pages           = {70-75},
  address         = {Gyeongju, Korea},
  month           = Aug,
  day             = {26-29},
  doi             = {10.1109/ROMAN.2013.6628533},
  abstract        = {We introduce a communication medium that en- courages users to fall in love with their counterparts. Hugvie, the huggable tele-presence medium, enables users to feel like hugging their counterparts while chatting. In this paper, we report that when a participant talks to his communication partner during their first encounter while hugging Hugvie, he mistakenly feels as if they are establishing a good relationship and that he is being loved rather than just being liked.},
  file            = {Kuwamura2013.pdf:pdf/Kuwamura2013.pdf:PDF},
}
Junya Nakanishi, Kaiko Kuwamura, Takashi Minato, Shuichi Nishio, Hiroshi Ishiguro, "Evoking Affection for a Communication Partner by a Robotic Communication Medium", In the First International Conference on Human-Agent Interaction, Hokkaido University, Sapporo, Japan, pp. III-1-4, August, 2013.
Abstract: This paper reveals a new effect of robotic communication media that can function as avatars of communication partners. Users interaction with a medium may alter feelings their toward partners. The paper hypothesized that talking while hugging a robotic medium increases romantic feelings or attraction toward a partner in robot-mediated tele-communication. Our experiment used Hugvie, a human-shaped medium, for talking in a hugging state. We found that people subconsciously increased their romantic attraction toward opposite sex partners by hugging Hugvie. This resultant effect is novel because we revealed the effect of user hugging on the user's own feelings instead of being hugged by a partner.
BibTeX:
@Inproceedings{Nakanishi2013,
  author          = {Junya Nakanishi and Kaiko Kuwamura and Takashi Minato and Shuichi Nishio and Hiroshi Ishiguro},
  title           = {Evoking Affection for a Communication Partner by a Robotic Communication Medium},
  booktitle       = {the First International Conference on Human-Agent Interaction},
  year            = {2013},
  pages           = {III-1-4},
  address         = {Hokkaido University, Sapporo, Japan},
  month           = Aug,
  day             = {7-9},
  url             = {http://hai-conference.net/ihai2013/proceedings/html/paper/paper-III-1-4.html},
  abstract        = {This paper reveals a new effect of robotic communication media that can function as avatars of communication partners. Users interaction with a medium may alter feelings their toward partners. The paper hypothesized that talking while hugging a robotic medium increases romantic feelings or attraction toward a partner in robot-mediated tele-communication. Our experiment used Hugvie, a human-shaped medium, for talking in a hugging state. We found that people subconsciously increased their romantic attraction toward opposite sex partners by hugging Hugvie. This resultant effect is novel because we revealed the effect of user hugging on the user's own feelings instead of being hugged by a partner.},
  file            = {Nakanishi2013.pdf:pdf/Nakanishi2013.pdf:PDF},
}
Hidenobu Sumioka, Kensuke Koda, Shuichi Nishio, Takashi Minato, Hiroshi Ishiguro, "Revisiting ancient design of human form for communication avatar: Design considerations from chronological development of Dogu", In IEEE International Symposium on Robot and Human Interactive Communication, Gyeongju, Korea, pp. 726-731, August, 2013.
Abstract: Robot avatar systems give the feeling we share a space with people who are actually at a distant location. Since our cognitive system specializes in recognizing a human, avatars of the distant people can make us strongly feel that we share space with them, provided that their appearance has been designed to sufficiently resemble humans. In this paper, we investigate the minimal requirements of robot avatars for distant people to feel their presence, Toward this aim, we give an overview of the chronological development of Dogu, which are human figurines made in ancient Japan. This survey of the Dogu shows that the torso, not the face, was considered the primary element for representing a human. It also suggests that some body parts can be represented in a simple form. Following the development of Dogu, we also use a conversation task to examine what kind of body representation is necessary to feel a distant person's presence. The experimental results show that the forms for the torso and head are required to enhance this feeling, while other body parts have less impact. We discuss the connection between our findings and an avatar's facial expression and motion.
BibTeX:
@Inproceedings{Sumioka2013b,
  author          = {Hidenobu Sumioka and Kensuke Koda and Shuichi Nishio and Takashi Minato and Hiroshi Ishiguro},
  title           = {Revisiting ancient design of human form for communication avatar: Design considerations from chronological development of Dogu},
  booktitle       = {{IEEE} International Symposium on Robot and Human Interactive Communication},
  year            = {2013},
  pages           = {726-731},
  address         = {Gyeongju, Korea},
  month           = Aug,
  day             = {26-29},
  doi             = {10.1109/ROMAN.2013.6628399},
  abstract        = {Robot avatar systems give the feeling we share a space with people who are actually at a distant location. Since our cognitive system specializes in recognizing a human, avatars of the distant people can make us strongly feel that we share space with them, provided that their appearance has been designed to sufficiently resemble humans. In this paper, we investigate the minimal requirements of robot avatars for distant people to feel their presence, Toward this aim, we give an overview of the chronological development of Dogu, which are human figurines made in ancient Japan. This survey of the Dogu shows that the torso, not the face, was considered the primary element for representing a human. It also suggests that some body parts can be represented in a simple form. Following the development of Dogu, we also use a conversation task to examine what kind of body representation is necessary to feel a distant person's presence. The experimental results show that the forms for the torso and head are required to enhance this feeling, while other body parts have less impact. We discuss the connection between our findings and an avatar's facial expression and motion.},
  file            = {Sumioka2013b.pdf:pdf/Sumioka2013b.pdf:PDF},
}
Shuichi Nishio, Koichi Taura, Hidenobu Sumioka, Hiroshi Ishiguro, "Effect of Social Interaction on Body Ownership Transfer to Teleoperated Android", In IEEE International Symposium on Robot and Human Interactive Communication, Gyeonguju, Korea, pp. 565-570, August, 2013.
Abstract: Body Ownership Transfer (BOT) is an illusion that we feel external objects as parts of our own body that occurs when teleoperating android robots. In past studies, we have been investigating under what conditions this illusion occurs. However, past studies were only conducted with simple operation tasks such as by only moving the robot's hand. Does this illusion occur under much complex tasks such as having a conversation? What kind of conversation setting is required to invoke this illusion? In this paper, we examined how factors in social interaction affects occurrence of BOT. Participants had conversation using the teleoperated robot under different situations and teleoperation settings. The results revealed that BOT does occur by the act of having a conversation, and that conversation partner's presence and appropriate responses are necessary for enhancement of BOT.
BibTeX:
@Inproceedings{Nishio2013,
  author          = {Shuichi Nishio and Koichi Taura and Hidenobu Sumioka and Hiroshi Ishiguro},
  title           = {Effect of Social Interaction on Body Ownership Transfer to Teleoperated Android},
  booktitle       = {{IEEE} International Symposium on Robot and Human Interactive Communication},
  year            = {2013},
  pages           = {565-570},
  address         = {Gyeonguju, Korea},
  month           = Aug,
  day             = {26-29},
  doi             = {10.1109/ROMAN.2013.6628539},
  abstract        = {Body Ownership Transfer (BOT) is an illusion that we feel external objects as parts of our own body that occurs when teleoperating android robots. In past studies, we have been investigating under what conditions this illusion occurs. However, past studies were only conducted with simple operation tasks such as by only moving the robot's hand. Does this illusion occur under much complex tasks such as having a conversation? What kind of conversation setting is required to invoke this illusion? In this paper, we examined how factors in social interaction affects occurrence of BOT. Participants had conversation using the teleoperated robot under different situations and teleoperation settings. The results revealed that BOT does occur by the act of having a conversation, and that conversation partner's presence and appropriate responses are necessary for enhancement of BOT.},
  file            = {Nishio2013.pdf:pdf/Nishio2013.pdf:PDF},
}
Christian Becker-Asano, Severin Gustorff, Kai Oliver Arras, Kohei Ogawa, Shuichi Nishio, Hiroshi Ishiguro, Bernhard Nebe, "Robot Embodiment, Operator Modality, and Social Interaction in Tele-Existence: A Project Outline", In 8th ACM/IEEE International Conference on Human-Robot Interaction, National Museum of Emerging Science and innovation (Miraikan), Tokyo, pp. 79-80, March, 2013.
Abstract: This paper outlines our ongoing project, which aims to investigate the effects of robot embodiment and operator modality on an operator's task efficiency and concomitant level of copresence in remote social interaction. After a brief introductionto related work has been given, five research questions are presented. We discuss how these relate to our choice of the two robotic embodiments "DARYL" and "Geminoid F" and the two operator modalities “console interface" and “head-mounted display". Finally, we postulate that the usefulness of one operator modality over the other will depend on the type of situation an operator has to deal with. This hypothesis is currently being investigated empirically using DARYL at Freiburg University
BibTeX:
@Inproceedings{Becker-Asano2013,
  author          = {Christian Becker-Asano and Severin Gustorff and Kai Oliver Arras and Kohei Ogawa and Shuichi Nishio and Hiroshi Ishiguro and Bernhard Nebe},
  title           = {Robot Embodiment, Operator Modality, and Social Interaction in Tele-Existence: A Project Outline},
  booktitle       = {8th ACM/IEEE International Conference on Human-Robot Interaction},
  year            = {2013},
  pages           = {79-80},
  address         = {National Museum of Emerging Science and innovation (Miraikan), Tokyo},
  month           = Mar,
  day             = {3-6},
  doi             = {10.1109/HRI.2013.6483510},
  url             = {http://ieeexplore.ieee.org/xpl/articleDetails.jsp?arnumber=6483510},
  abstract        = {This paper outlines our ongoing project, which aims to investigate the effects of robot embodiment and operator modality on an operator's task efficiency and concomitant level of copresence in remote social interaction. After a brief introductionto related work has been given, five research questions are presented. We discuss how these relate to our choice of the two robotic embodiments "DARYL" and "Geminoid F" and the two operator modalities “console interface" and “head-mounted display". Finally, we postulate that the usefulness of one operator modality over the other will depend on the type of situation an operator has to deal with. This hypothesis is currently being investigated empirically using DARYL at Freiburg University},
  file            = {Becker-Asano2013.pdf:pdf/Becker-Asano2013.pdf:PDF},
  keywords        = {Tele-existence; Copresence; Tele-robotic; Social robotics},
}
Rosario Sorbello, Hiroshi Ishiguro, Antonio Chella, Shuichi Nishio, Giovan Battista Presti, Marcello Giardina, "Telenoid mediated ACT Protocol to Increase Acceptance of Disease among Siblings of Autistic Children", In HRI2013 Workshop on Design of Humanlikeness in HRI : from uncanny valley to minimal design, Tokyo, Japan, pp. 26, March, 2013.
Abstract: We introduce a novel research proposal project aimed to build a robotic setup in which the Telenoid[1] is used as therapist for the sibling of children with autism. Many existing research studies have shown good results relating to the important impact of Acceptance and Commitment Therapy (ACT)[2] applied to siblings of children with autism. The overall behaviors of the siblings may potentially benefit from treatment with a humanoid robot therapist instead of a real one. In particular in the present study, Telenoid humanoid robot[3] is used as therapist to achieve a specific therapeutic objective: the acceptance of diversity from the sibling of children with autism. In the proposed architecture, the Telenoid acts[4] in teleoperated mode[5] during the learning phase, while it becomes more and more autonomous during the working phase with patients. A goal of the research is to improve siblings tolerance and acceptance towards their brothers. The use of ACT[6] will reinforce the acceptance of diversity and it will create a psicological flexibilty along the dimension of diversity. In the present article, we briefly introduce Acceptance and Commitment Therapy (ACT) as a clinical model and its theoretical foundations (Relational Frame Theory). We then explain the six core processes of Hexaflex model of ACT adapted to Telenoid behaviors acting as humanoid robotic therapist. Finally, we present an experimental example about how Telenoid could apply the six processes[7] of hexaflex model of ACT to the patient during its human-humanoid interaction (HHI) in order to realize an applied clinical behavior analysis[8] that increase in the sibling their acceptance of brother' disease.
BibTeX:
@Inproceedings{Sorbello2013,
  author    = {Rosario Sorbello and Hiroshi Ishiguro and Antonio Chella and Shuichi Nishio and Giovan Battista Presti and Marcello Giardina},
  title     = {Telenoid mediated {ACT} Protocol to Increase Acceptance of Disease among Siblings of Autistic Children},
  booktitle = {{HRI}2013 Workshop on Design of Humanlikeness in {HRI} : from uncanny valley to minimal design},
  year      = {2013},
  pages     = {26},
  address   = {Tokyo, Japan},
  month     = Mar,
  day       = {3},
  abstract  = {We introduce a novel research proposal project aimed to build a robotic setup in which the Telenoid[1] is used as therapist for the sibling of children with autism. Many existing research studies have shown good results relating to the important impact of Acceptance and Commitment Therapy (ACT)[2] applied to siblings of children with autism. The overall behaviors of the siblings may potentially benefit from treatment with a humanoid robot therapist instead of a real one. In particular in the present study, Telenoid humanoid robot[3] is used as therapist to achieve a specific therapeutic objective: the acceptance of diversity from the sibling of children with autism. In the proposed architecture, the Telenoid acts[4] in teleoperated mode[5] during the learning phase, while it becomes more and more autonomous during the working phase with patients. A goal of the research is to improve siblings tolerance and acceptance towards their brothers. The use of ACT[6] will reinforce the acceptance of diversity and it will create a psicological flexibilty along the dimension of diversity. In the present article, we briefly introduce Acceptance and Commitment Therapy (ACT) as a clinical model and its theoretical foundations (Relational Frame Theory). We then explain the six core processes of Hexaflex model of ACT adapted to Telenoid behaviors acting as humanoid robotic therapist. Finally, we present an experimental example about how Telenoid could apply the six processes[7] of hexaflex model of ACT to the patient during its human-humanoid interaction (HHI) in order to realize an applied clinical behavior analysis[8] that increase in the sibling their acceptance of brother' disease.},
  file      = {Sorbello2013.pdf:pdf/Sorbello2013.pdf:PDF},
}
幸田健介, 住岡英信, 西尾修一, 石黒浩, "土偶の変遷から見るコミュニケーションメディアのミニマルデザイン", HAIシンポジウム, 京都工芸繊維大学, pp. 1C-4, December, 2012.
Abstract: Investigation of minimal elements of human-like appearance is important not only for designing communication media but also for considering how appearances affect interaction. This paper addresses design issues of communication media to convey person's presence to a distant location. Inspired from analogies between design strategies of such media and "Dogu", a clay doll built during the Jomon period, we investigate minimal elements of human-like appearance by tracing the evolution of Dogu. The survey of Dogu's evolution suggests that 1) human-like torso had a priority over other body representations including facial expression; 2) the arms and legs were represented in abstract forms; 3) eyes, mouth, and nose were essential; and 4) portability was a key feature to change design strategy. Minimal elements for communication media to convey person's presence are discussed based on the results of the survey.
BibTeX:
@Inproceedings{幸田健介2012,
  author          = {幸田健介 and 住岡英信 and 西尾修一 and 石黒浩},
  title           = {土偶の変遷から見るコミュニケーションメディアのミニマルデザイン},
  booktitle       = {{HAI}シンポジウム},
  year            = {2012},
  pages           = {1{C}-4},
  address         = {京都工芸繊維大学},
  month           = Dec,
  day             = {7-9},
  url             = {http://www.ii.is.kit.ac.jp/hai2012/proceedings/pdf/1C-4.pdf},
  etitle          = {Minimal Design of Communication Media Based on "Dogu" Evolution},
  abstract        = {Investigation of minimal elements of human-like appearance is important not only for designing communication media but also for considering how appearances affect interaction. This paper addresses design issues of communication media to convey person's presence to a distant location. Inspired from analogies between design strategies of such media and "Dogu", a clay doll built during the Jomon period, we investigate minimal elements of human-like appearance by tracing the evolution of Dogu. The survey of Dogu's evolution suggests that 1) human-like torso had a priority over other body representations including facial expression; 2) the arms and legs were represented in abstract forms; 3) eyes, mouth, and nose were essential; and 4) portability was a key feature to change design strategy. Minimal elements for communication media to convey person's presence are discussed based on the results of the survey.},
  file            = {幸田健介2012.pdf:pdf/幸田健介2012.pdf:PDF},
}
田浦康一, 住岡英信, 西尾修一, 石黒浩, "遠隔操作アンドロイドへの身体感覚転移における対話の影響", HAIシンポジウム, 京都工芸繊維大学, pp. 2C-3, December, 2012.
Abstract: Body ownership transfer is illusion that we feel an external object as a part of our own body, and is evoked by operating android robot. We considered body ownership transfer as a crucial factor for communication in distance places in order to feel telepresence.This paper examines the influence of social interaction on body ownership transfer and telepresence during operating android robot, and investigate relation between body ownership transfer and telepresence. Participants talked about given topics with/without their partners and with/without operating the android robot. Our results show that feelings of the operation of the robot and partner's presence are crucial to experience a strong sense of body ownership transfer, and there are positive correlation between body ownership transfer and telepresence. Furthermore, the response reactions from partners enhance body ownership transfer when they observed the android and partner were in the same place during operation.
BibTeX:
@Inproceedings{田浦康一2012,
  author          = {田浦康一 and 住岡英信 and 西尾修一 and 石黒浩},
  title           = {遠隔操作アンドロイドへの身体感覚転移における対話の影響},
  booktitle       = {{HAI}シンポジウム},
  year            = {2012},
  pages           = {2C-3},
  address         = {京都工芸繊維大学},
  month           = Dec,
  day             = {7-9},
  url             = {http://www.ii.is.kit.ac.jp/hai2012/proceedings/pdf/2C-3.pdf},
  etitle          = {Social interaction enhance body ownership transfer to android robot},
  abstract        = {Body ownership transfer is illusion that we feel an external object as a part of our own body, and is evoked by operating android robot. We considered body ownership transfer as a crucial factor for communication in distance places in order to feel telepresence.This paper examines the influence of social interaction on body ownership transfer and telepresence during operating android robot, and investigate relation between body ownership transfer and telepresence. Participants talked about given topics with/without their partners and with/without operating the android robot. Our results show that feelings of the operation of the robot and partner's presence are crucial to experience a strong sense of body ownership transfer, and there are positive correlation between body ownership transfer and telepresence. Furthermore, the response reactions from partners enhance body ownership transfer when they observed the android and partner were in the same place during operation.},
  eabstract       = {Body ownership transfer is illusion that we feel an external object as a part of our own body, and is evoked by operating android robot. We considered body ownership transfer as a crucial factor for communication in distance places in order to feel telepresence.This paper examines the influence of social interaction on body ownership transfer and telepresence during operating android robot, and investigate relation between body ownership transfer and telepresence. Participants talked about given topics with/without their partners and with/without operating the android robot. Our results show that feelings of the operation of the robot and partner's presence are crucial to experience a strong sense of body ownership transfer, and there are positive correlation between body ownership transfer and telepresence. Furthermore, the response reactions from partners enhance body ownership transfer when they observed the android and partner were in the same place during operation.},
  file            = {田浦康一2012.pdf:pdf/田浦康一2012.pdf:PDF},
}
桑村海光, 境くりま, 港隆史, 西尾修一, 石黒浩, "遠隔コミュニケーションにおける抱擁の効果", HAIシンポジウム, 京都工芸繊維大学, pp. 1B-3, December, 2012.
Abstract: The act of physical interaction, such as hugging, is one important factor in communication for establishing and maintaining good relationship. This is, at the same time, one of the factors that are often lost in telecommunication between distant locations. Recently, several studies attempted to provide feeling of being hugged by person in remote and showed their effectiveness. However, there have been no study which focused on the effect of hugging a telecommunication medium. In this study, we investigated the effect of hugging on telecommunication by using Hugvie. The experiment with Hugvie revealed that the one who talks to his first meeting while virtually hugging through the medium feels like being loved rather than being liked.
BibTeX:
@Inproceedings{桑村海光2012,
  author          = {桑村海光 and 境くりま and 港隆史 and 西尾修一 and 石黒浩},
  title           = {遠隔コミュニケーションにおける抱擁の効果},
  booktitle       = {{HAI}シンポジウム},
  year            = {2012},
  pages           = {1B-3},
  address         = {京都工芸繊維大学},
  month           = Dec,
  day             = {7-9},
  url             = {http://www.ii.is.kit.ac.jp/hai2012/proceedings/pdf/1B-3.pdf},
  etitle          = {The Effect of Hugging on Telecommunication},
  abstract        = {The act of physical interaction, such as hugging, is one important factor in communication for establishing and maintaining good relationship. This is, at the same time, one of the factors that are often lost in telecommunication between distant locations. Recently, several studies attempted to provide feeling of being hugged by person in remote and showed their effectiveness. However, there have been no study which focused on the effect of hugging a telecommunication medium. In this study, we investigated the effect of hugging on telecommunication by using Hugvie. The experiment with Hugvie revealed that the one who talks to his first meeting while virtually hugging through the medium feels like being loved rather than being liked.},
  file            = {桑村海光2012.pdf:pdf/桑村海光2012.pdf:PDF},
}
Shuichi Nishio, Koichi Taura, Hiroshi Ishiguro, "Regulating Emotion by Facial Feedback from Teleoperated Android Robot", In International Conference on Social Robotics, Chengdu, China, pp. 388-397, October, 2012.
Abstract: In this paper, we experimentally examined whether facial expression changes in teleoperated androids can affect and regulate operators' emotion, based on the facial feedback theory of emotion and the body ownership transfer phenomena to teleoperated android robot. We created a conversational situation where participants felt anger and, during the conversation, the android's facial expression were automatically changed. We examined whether such changes affected the operator emotions. As a result, we found that when one can well operate the robot, the operator's emotional states are affected by the android's facial expression changes.
BibTeX:
@Inproceedings{Nishio2012b,
  author    = {Shuichi Nishio and Koichi Taura and Hiroshi Ishiguro},
  title     = {Regulating Emotion by Facial Feedback from Teleoperated Android Robot},
  booktitle = {International Conference on Social Robotics},
  year      = {2012},
  pages     = {388-397},
  address   = {Chengdu, China},
  month     = Oct,
  day       = {29-31},
  doi       = {10.1007/978-3-642-34103-8_39},
  url       = {http://link.springer.com/chapter/10.1007/978-3-642-34103-8_39},
  abstract  = {In this paper, we experimentally examined whether facial expression changes in teleoperated androids can affect and regulate operators' emotion, based on the facial feedback theory of emotion and the body ownership transfer phenomena to teleoperated android robot. We created a conversational situation where participants felt anger and, during the conversation, the android's facial expression were automatically changed. We examined whether such changes affected the operator emotions. As a result, we found that when one can well operate the robot, the operator's emotional states are affected by the android's facial expression changes.},
  file      = {Nishio2012b.pdf:pdf/Nishio2012b.pdf:PDF},
}
Shuichi Nishio, Tetsuya Watanabe, Kohei Ogawa, Hiroshi Ishiguro, "Body Ownership Transfer to Teleoperated Android Robot", In International Conference on Social Robotics, Chengdu, China, pp. 398-407, October, 2012.
Abstract: Teleoperators of android robots occasionally feel as if the robotic bodies are extensions of their own. When others touch the tele-operated android, even without tactile feedback, some operators feel as if they themselves have been touched. In the past, a similar phenomenon named “Rubber Hand Illusion" have been studied for its reflection of a three-way interaction among vision, touch and proprioception. In this study, we examined whether a similar interaction occurs when replacing a tactile sensation with android robot teleoperation; that is, whether the interaction among vision, motion and proprioception occurs. The result showed that when the operator and the android motions are synchronized, operators feel as if their sense of body ownership is transferred to the android robot.
BibTeX:
@Inproceedings{Nishio2012a,
  author    = {Shuichi Nishio and Tetsuya Watanabe and Kohei Ogawa and Hiroshi Ishiguro},
  title     = {Body Ownership Transfer to Teleoperated Android Robot},
  booktitle = {International Conference on Social Robotics},
  year      = {2012},
  pages     = {398-407},
  address   = {Chengdu, China},
  month     = Oct,
  day       = {29-31},
  doi       = {10.1007/978-3-642-34103-8_40},
  url       = {http://link.springer.com/chapter/10.1007/978-3-642-34103-8_40},
  abstract  = {Teleoperators of android robots occasionally feel as if the robotic bodies are extensions of their own. When others touch the tele-operated android, even without tactile feedback, some operators feel as if they themselves have been touched. In the past, a similar phenomenon named “Rubber Hand Illusion" have been studied for its reflection of a three-way interaction among vision, touch and proprioception. In this study, we examined whether a similar interaction occurs when replacing a tactile sensation with android robot teleoperation; that is, whether the interaction among vision, motion and proprioception occurs. The result showed that when the operator and the android motions are synchronized, operators feel as if their sense of body ownership is transferred to the android robot.},
  file      = {Nishio2012a.pdf:pdf/Nishio2012a.pdf:PDF},
}
Ryuji Yamazaki, Shuichi Nishio, Hiroshi Ishiguro, Marco Nørskov, Nobu Ishiguro, Giuseppe Balistreri, "Social Acceptance of a Teleoperated Android: Field Study on Elderly's Engagement with an Embodied Communication Medium in Denmark", In International Conference on Social Robotics, Chengdu, China, pp. 428-437, October, 2012.
Abstract: We explored the potential of teleoperated android robots, which are embodied telecommunication media with humanlike appearances, and how they affect people in the real world when they are employed to express a telepresence and a sense of ‘being there'. In Denmark, our exploratory study focused on the social aspects of Telenoid, a teleoperated android, which might facilitate communication between senior citizens and Telenoid's operator. After applying it to the elderly in their homes, we found that the elderly assumed positive attitudes toward Telenoid, and their positivity and strong attachment to its huggable minimalistic human design were cross-culturally shared in Denmark and Japan. Contrary to the negative reactions by non-users in media reports, our result suggests that teleoperated androids can be accepted by the elderly as a kind of universal design medium for social inclusion.
BibTeX:
@Inproceedings{Yamazaki2012c,
  author          = {Ryuji Yamazaki and Shuichi Nishio and Hiroshi Ishiguro and Marco N\orskov and Nobu Ishiguro and Giuseppe Balistreri},
  title           = {Social Acceptance of a Teleoperated Android: Field Study on Elderly's Engagement with an Embodied Communication Medium in Denmark},
  booktitle       = {International Conference on Social Robotics},
  year            = {2012},
  pages           = {428-437},
  address         = {Chengdu, China},
  month           = Oct,
  day             = {29-31},
  doi             = {10.1007/978-3-642-34103-8_43},
  url             = {http://link.springer.com/chapter/10.1007/978-3-642-34103-8_43},
  abstract        = {We explored the potential of teleoperated android robots, which are embodied telecommunication media with humanlike appearances, and how they affect people in the real world when they are employed to express a telepresence and a sense of ‘being there'. In Denmark, our exploratory study focused on the social aspects of Telenoid, a teleoperated android, which might facilitate communication between senior citizens and Telenoid's operator. After applying it to the elderly in their homes, we found that the elderly assumed positive attitudes toward Telenoid, and their positivity and strong attachment to its huggable minimalistic human design were cross-culturally shared in Denmark and Japan. Contrary to the negative reactions by non-users in media reports, our result suggests that teleoperated androids can be accepted by the elderly as a kind of universal design medium for social inclusion.},
  file            = {Yamazaki2012c.pdf:pdf/Yamazaki2012c.pdf:PDF},
  keywords        = {android;teleoperation;minimal design;communication;embodiment;inclusion;acceptability;elderly care},
}
Ryuji Yamazaki, Shuichi Nishio, Hiroshi Ishiguro, Takashi Minato, Marco Nørskov, Nobu Ishiguro, Masaru Nishikawa, Tsutomu Fujinami, "Social Inclusion of Senior Citizens by a Teleoperated Android : Toward Inter-generational TeleCommunity Creation", In 2012 IEEE International Workshop on Assistance and Service Robotics in a Human Environment, International Conference on Intelligent Robots and Systems, Vilamoura, Algarve, Portugal, pp. 53-58, October, 2012.
Abstract: As populations continue to age, there is a growing need for assistive technologies that help senior citizens maintain their autonomy and enjoy their lives. We explore the potential of teleoperated androids, which are embodied telecommunication media with humanlike appearances. Our exploratory study focused on the social aspects of Telenoid, a teleoperated android designed as a minimalistic human, which might facilitate communication between senior citizens and its operators. We conducted cross-cultural field trials in Japan and Denmark by introducing Telenoid into care facilities and the private homes of seniors to observe how they responded to it. In Japan, we set up a teleoperation system in an elementary school and investigated how it shaped communication through the internet between the elderly in a care facility and the children who acted as teleoperators. In both countries, the elderly commonly assumed positive attitudes toward Telenoid and imaginatively developed various dialogue strategies. Telenoid lowered the barriers for the children as operators for communicating with demented seniors so that they became more relaxed to participate in and positively continue conversations using Telenoid. Our results suggest that its minimalistic human design is inclusive for seniors with or without dementia and facilitates inter-generational communication, which may be expanded to a social network of trans-national supportive relationships among all generations.
BibTeX:
@Inproceedings{Yamazaki2012d,
  author    = {Ryuji Yamazaki and Shuichi Nishio and Hiroshi Ishiguro and Takashi Minato and Marco N\orskov and Nobu Ishiguro and Masaru Nishikawa and Tsutomu Fujinami},
  title     = {Social Inclusion of Senior Citizens by a Teleoperated Android : Toward Inter-generational TeleCommunity Creation},
  booktitle = {2012 {IEEE} International Workshop on Assistance and Service Robotics in a Human Environment, International Conference on Intelligent Robots and Systems},
  year      = {2012},
  pages     = {53--58},
  address   = {Vilamoura, Algarve, Portugal},
  month     = Oct,
  day       = {7-12},
  abstract  = {As populations continue to age, there is a growing need for assistive technologies that help senior citizens maintain their autonomy and enjoy their lives. We explore the potential of teleoperated androids, which are embodied telecommunication media with humanlike appearances. Our exploratory study focused on the social aspects of Telenoid, a teleoperated android designed as a minimalistic human, which might facilitate communication between senior citizens and its operators. We conducted cross-cultural field trials in Japan and Denmark by introducing Telenoid into care facilities and the private homes of seniors to observe how they responded to it. In Japan, we set up a teleoperation system in an elementary school and investigated how it shaped communication through the internet between the elderly in a care facility and the children who acted as teleoperators. In both countries, the elderly commonly assumed positive attitudes toward Telenoid and imaginatively developed various dialogue strategies. Telenoid lowered the barriers for the children as operators for communicating with demented seniors so that they became more relaxed to participate in and positively continue conversations using Telenoid. Our results suggest that its minimalistic human design is inclusive for seniors with or without dementia and facilitates inter-generational communication, which may be expanded to a social network of trans-national supportive relationships among all generations.},
  file      = {Yamazaki2012d.pdf:Yamazaki2012d.pdf:PDF},
}
Martin Cooney, Shuichi Nishio, Hiroshi Ishiguro, "Recognizing Affection for a Touch-based Interaction with a Humanoid Robot", In IEEE/RSJ International Conference on Intelligent Robots and Systems, Vilamoura, Algarve, Portugal, pp. 1420-1427, October, 2012.
Abstract: In order to facilitate integration into domestic and public environments, companion robots can seek to communicate in a familiar, socially intelligent´ manner, recognizing typical behaviors which people direct toward them. One important type of behavior to recognize is the displaying and seeking of affection, which is fundamentally associated with the modality of touch. This paper identifies how people communicate affection through touching a humanoid robot appearance, and reports on the development of a recognition system exploring the modalities of touch and vision. Results of evaluation indicate the proposed system can recognize people's affectionate behavior in the designated context.
BibTeX:
@Inproceedings{Cooney2012a,
  author          = {Martin Cooney and Shuichi Nishio and Hiroshi Ishiguro},
  title           = {Recognizing Affection for a Touch-based Interaction with a Humanoid Robot},
  booktitle       = {{IEEE/RSJ} International Conference on Intelligent Robots and Systems},
  year            = {2012},
  pages           = {1420--1427},
  address         = {Vilamoura, Algarve, Portugal},
  month           = Oct,
  day             = {7-12},
  abstract        = {In order to facilitate integration into domestic and public environments, companion robots can seek to communicate in a familiar, socially intelligent´ manner, recognizing typical behaviors which people direct toward them. One important type of behavior to recognize is the displaying and seeking of affection, which is fundamentally associated with the modality of touch. This paper identifies how people communicate affection through touching a humanoid robot appearance, and reports on the development of a recognition system exploring the modalities of touch and vision. Results of evaluation indicate the proposed system can recognize people's affectionate behavior in the designated context.},
  file            = {Cooney2012a.pdf:Cooney2012a.pdf:PDF},
}
Shuichi Nishio, Kohei Ogawa, Yasuhiro Kanakogi, Shoji Itakura, Hiroshi Ishiguro, "Do robot appearance and speech affect people's attitude? Evaluation through the Ultimatum Game", In IEEE International Symposium on Robot and Human Interactive Communication, Paris, France, pp. 809-814, September, 2012.
Abstract: In this study, we examine the factors with which robots are recognized as social beings. Participants joined ses- sions of the Ultimatum Game, a procedure commonly used for examining attitudes toward others in the fields of economics and social psychology. Several agents differing in their appearances are tested with speech stimuli that are expected to induce a mentalizing effect toward the agents. As a result, we found that while appearance itself did not show significant difference in the attitudes, the mentalizing stimuli affected the attitudes in different ways depending on robots' appearances. This results showed that such elements as simple conversation with the agents and their appearance are important factors so that robots are treated more humanlike and as social beings.
BibTeX:
@Inproceedings{Nishio2012,
  author          = {Shuichi Nishio and Kohei Ogawa and Yasuhiro Kanakogi and Shoji Itakura and Hiroshi Ishiguro},
  title           = {Do robot appearance and speech affect people's attitude? Evaluation through the {U}ltimatum {G}ame},
  booktitle       = {{IEEE} International Symposium on Robot and Human Interactive Communication},
  year            = {2012},
  pages           = {809--814},
  address         = {Paris, France},
  month           = Sep,
  day             = {9-13},
  doi             = {10.1109/ROMAN.2012.6343851},
  abstract        = {In this study, we examine the factors with which robots are recognized as social beings. Participants joined ses- sions of the Ultimatum Game, a procedure commonly used for examining attitudes toward others in the fields of economics and social psychology. Several agents differing in their appearances are tested with speech stimuli that are expected to induce a mentalizing effect toward the agents. As a result, we found that while appearance itself did not show significant difference in the attitudes, the mentalizing stimuli affected the attitudes in different ways depending on robots' appearances. This results showed that such elements as simple conversation with the agents and their appearance are important factors so that robots are treated more humanlike and as social beings.},
  file            = {Nishio2012.pdf:Nishio2012.pdf:PDF},
}
Kaiko Kuwamura, Takashi Minato, Shuichi Nishio, Hiroshi Ishiguro, "Personality Distortion in Communication through Teleoperated Robots", In IEEE International Symposium on Robot and Human Interactive Communication, Paris, France, pp. 49-54, September, 2012.
Abstract: Recent research has focused on such physical communication media as teleoperated robots, which provide a feeling of being with people in remote places. Recent invented media resemble cute animals or imaginary creatures that quickly attract attention. However, such appearances could distort tele-communications because they are different from human beings. This paper studies the effect on the speaker's personality that is transmitted through physical media by regarding appearances as a function that transmits the speaker's information. Although communication media's capability to transmit information reportedly influences conversations in many aspects, the effect of appearances remains unclear. To reveal the effect of appearance, we compared three appearances of communication media: stuffed-bear teleoperated robot, human-like teleoperated robot, and video chat. Our results show that communication media whose appearance greatly differs from that of the speaker distorts the personality perceived by interlocutors. This paper suggests that the design of the appearance of physical communication media needs to be carefully selected.
BibTeX:
@Inproceedings{Kuwamura2012,
  author    = {Kaiko Kuwamura and Takashi Minato and Shuichi Nishio and Hiroshi Ishiguro},
  title     = {Personality Distortion in Communication through Teleoperated Robots},
  booktitle = {{IEEE} International Symposium on Robot and Human Interactive Communication},
  year      = {2012},
  pages     = {49--54},
  address   = {Paris, France},
  month     = Sep,
  day       = {9-13},
  abstract  = {Recent research has focused on such physical communication media as teleoperated robots, which provide a feeling of being with people in remote places. Recent invented media resemble cute animals or imaginary creatures that quickly attract attention. However, such appearances could distort tele-communications because they are different from human beings. This paper studies the effect on the speaker's personality that is transmitted through physical media by regarding appearances as a function that transmits the speaker's information. Although communication media's capability to transmit information reportedly influences conversations in many aspects, the effect of appearances remains unclear. To reveal the effect of appearance, we compared three appearances of communication media: stuffed-bear teleoperated robot, human-like teleoperated robot, and video chat. Our results show that communication media whose appearance greatly differs from that of the speaker distorts the personality perceived by interlocutors. This paper suggests that the design of the appearance of physical communication media needs to be carefully selected.},
  file      = {Kuwamura2012.pdf:pdf/Kuwamura2012.pdf:PDF},
}
Martin Cooney, Francesco Zanlungo, Shuichi Nishio, Hiroshi Ishiguro, "Designing a Flying Humanoid Robot (FHR): Effects of Flight on Interactive Communication", In IEEE International Symposium on Robot and Human Interactive Communication, Paris, France, pp. 364-371, September, 2012.
Abstract: This research constitutes an initial investigation into key issues which arise in designing a flying humanoid robot (FHR), with a focus on human-robot interaction (HRI). The humanoid form offers an interface for natural communication; flight offers excellent mobility. Combining both will yield companion robots capable of approaching, accompanying, and communicating naturally with humans in difficult environments. Problematic is how such a robot should best fly around humans, and what effect the robot's flight will have on a person in terms of paralinguistic (non-verbal) cues. To answer these questions, we propose an extension to existing proxemics theory (“z-proxemics") and predict how typical humanoid flight motions will be perceived. Data obtained from participants watching animated sequences are analyzed to check our predictions. The paper also reports on the building of a flying humanoid robot, which we will use in interactions.
BibTeX:
@Inproceedings{Cooney2012b,
  author          = {Martin Cooney and Francesco Zanlungo and Shuichi Nishio and Hiroshi Ishiguro},
  title           = {Designing a Flying Humanoid Robot ({FHR}): Effects of Flight on Interactive Communication},
  booktitle       = {{IEEE} International Symposium on Robot and Human Interactive Communication},
  year            = {2012},
  pages           = {364--371},
  address         = {Paris, France},
  month           = Sep,
  day             = {9-13},
  doi             = {10.1109/ROMAN.2012.6343780},
  abstract        = {This research constitutes an initial investigation into key issues which arise in designing a flying humanoid robot ({FHR}), with a focus on human-robot interaction ({HRI}). The humanoid form offers an interface for natural communication; flight offers excellent mobility. Combining both will yield companion robots capable of approaching, accompanying, and communicating naturally with humans in difficult environments. Problematic is how such a robot should best fly around humans, and what effect the robot's flight will have on a person in terms of paralinguistic (non-verbal) cues. To answer these questions, we propose an extension to existing proxemics theory (“z-proxemics") and predict how typical humanoid flight motions will be perceived. Data obtained from participants watching animated sequences are analyzed to check our predictions. The paper also reports on the building of a flying humanoid robot, which we will use in interactions.},
  file            = {Cooney2012b.pdf:Cooney2012b.pdf:PDF},
}
Takashi Minato, Hidenobu Sumioka, Shuichi Nishio, Hiroshi Ishiguro, "Studying the Influence of Handheld Robotic Media on Social Communications", In the RO-MAN 2012 workshop on social robotic telepresence, Paris, France, pp. 15-16, September, 2012.
Abstract: This paper describes research issues on social robotic telepresence using “Elfoid". It is a portable tele-operated humanoid that is designed to transfer individuals' presence to remote places at anytime, anywhere, to provide a new communication style in which individuals talk with persons in remote locations in such a way that they feel each other's presence. However, it is not known how people adapt to the new communication style and how social communications change by Elfoid. Investigating the influence of Elfoid on social communications are very interesting in the view of social robotic telepresence. This paper introduces Elfoid and shows the position of our studies in social robotic telepresence.
BibTeX:
@Inproceedings{Minato2012c,
  author    = {Takashi Minato and Hidenobu Sumioka and Shuichi Nishio and Hiroshi Ishiguro},
  title     = {Studying the Influence of Handheld Robotic Media on Social Communications},
  booktitle = {the {RO-MAN} 2012 workshop on social robotic telepresence},
  year      = {2012},
  pages     = {15--16},
  address   = {Paris, France},
  month     = Sep,
  day       = {9-13},
  abstract  = {This paper describes research issues on social robotic telepresence using “Elfoid". It is a portable tele-operated humanoid that is designed to transfer individuals' presence to remote places at anytime, anywhere, to provide a new communication style in which individuals talk with persons in remote locations in such a way that they feel each other's presence. However, it is not known how people adapt to the new communication style and how social communications change by Elfoid. Investigating the influence of Elfoid on social communications are very interesting in the view of social robotic telepresence. This paper introduces Elfoid and shows the position of our studies in social robotic telepresence.},
  file      = {Minato2012c.pdf:Minato2012c.pdf:PDF},
}
Hidenobu Sumioka, Shuichi Nishio, Erina Okamoto, Hiroshi Ishiguro, "Isolation of physical traits and conversational content for personality design", Poster presentation at IEEE International Symposium on Robot and Human Interactive Communication, Paris, France, pp. 596-601, September, 2012.
Abstract: In this paper, we propose the "Doppel teleoperation system,'' which isolates several physical traits from a speaker, to investigate how personal information is conveyed to others during conversation. An underlying problem on designing personality in social robots is that it remains unclear how humans judge the personalities of conversation partners. With the Doppel system, for each of the communication channels to be transferred, one can choose it in its original form or in the one generated by the system. For example, voice and body motions can be replaced by the Doppel system while preserving the speech content. This allows us to analyze the individual effects of the physical traits of the speaker and the content in the speaker's speech on the identification of personality. This selectivity of personal traits provides a useful approach to investigate which information conveys our personality through conversation. To show the potential of our system, we experimentally tested how much the conversation content conveys the personality of speakers to interlocutors without any of their physical traits. Preliminary results show that although interlocutors have difficulty identifying speakers only using conversational contents, they can recognize their acquaintances when their acquaintances are the speakers. We point out some potential physical traits to convey personality
BibTeX:
@Inproceedings{Sumioka2012d,
  author          = {Hidenobu Sumioka and Shuichi Nishio and Erina Okamoto and Hiroshi Ishiguro},
  title           = {Isolation of physical traits and conversational content for personality design},
  booktitle       = {{IEEE} International Symposium on Robot and Human Interactive Communication},
  year            = {2012},
  pages           = {596--601},
  address         = {Paris, France},
  month           = Sep,
  day             = {9-13},
  doi             = {10.1109/ROMAN.2012.6343816},
  abstract        = {In this paper, we propose the "Doppel teleoperation system,'' which isolates several physical traits from a speaker, to investigate how personal information is conveyed to others during conversation. An underlying problem on designing personality in social robots is that it remains unclear how humans judge the personalities of conversation partners. With the Doppel system, for each of the communication channels to be transferred, one can choose it in its original form or in the one generated by the system. For example, voice and body motions can be replaced by the Doppel system while preserving the speech content. This allows us to analyze the individual effects of the physical traits of the speaker and the content in the speaker's speech on the identification of personality. This selectivity of personal traits provides a useful approach to investigate which information conveys our personality through conversation. To show the potential of our system, we experimentally tested how much the conversation content conveys the personality of speakers to interlocutors without any of their physical traits. Preliminary results show that although interlocutors have difficulty identifying speakers only using conversational contents, they can recognize their acquaintances when their acquaintances are the speakers. We point out some potential physical traits to convey personality},
  file            = {Sumioka2012d.pdf:Sumioka2012d.pdf:PDF},
}
Ryuji Yamazaki, Shuichi Nishio, Kohei Ogawa, Hiroshi Ishiguro, "Teleoperated Android as an Embodied Communication Medium: A Case Study with Demented Elderlies in a Care Facility", In IEEE International Symposium on Robot and Human Interactive Communication, Paris, France, pp. 1066-1071, September, 2012.
Abstract: Teleoperated androids, which are robots with humanlike appearances, are being produced as new media of human relationships. We explored the potential of humanoid robots and how they affect people in the real world when they are employed to express a telecommunication presence and a sense of ‘being there'. We introduced Telenoid, a teleoperated android, to a residential care facility to see how the elderly with dementia respond to it. Our exploratory study focused on the social aspects that might facilitate communication between the elderly and Telenoid's operator. Telenoid elicited positive images and interactive reactions from the elderly with mild dementia, even from those with severe cognitive impairment. They showed strong attachment to its child-like huggable design and became willing to converse with it. Our result suggests that an affectionate bond may be formed between the elderly and the android to provide the operator with easy communication to elicit responses from senior citizens.
BibTeX:
@Inproceedings{Yamazaki2012b,
  author    = {Ryuji Yamazaki and Shuichi Nishio and Kohei Ogawa and Hiroshi Ishiguro},
  title     = {Teleoperated Android as an Embodied Communication Medium: A Case Study with Demented Elderlies in a Care Facility},
  booktitle = {{IEEE} International Symposium on Robot and Human Interactive Communication},
  year      = {2012},
  pages     = {1066--1071},
  address   = {Paris, France},
  month     = Sep,
  day       = {9-13},
  abstract  = {Teleoperated androids, which are robots with humanlike appearances, are being produced as new media of human relationships. We explored the potential of humanoid robots and how they affect people in the real world when they are employed to express a telecommunication presence and a sense of ‘being there'. We introduced Telenoid, a teleoperated android, to a residential care facility to see how the elderly with dementia respond to it. Our exploratory study focused on the social aspects that might facilitate communication between the elderly and Telenoid's operator. Telenoid elicited positive images and interactive reactions from the elderly with mild dementia, even from those with severe cognitive impairment. They showed strong attachment to its child-like huggable design and became willing to converse with it. Our result suggests that an affectionate bond may be formed between the elderly and the android to provide the operator with easy communication to elicit responses from senior citizens.},
  file      = {Yamazaki2012b.pdf:Yamazaki2012b.pdf:PDF},
}
Hidenobu Sumioka, Shuichi Nishio, Hiroshi Ishiguro, "Teleoperated android for mediated communication : body ownership, personality distortion, and minimal human design", In the RO-MAN 2012 workshop on social robotic telepresence, Paris, France, pp. 32-39, September, 2012.
Abstract: In this paper we discuss the impact of humanlike appearance on telecommunication, giving an overview of studies with teleoperated androids. We show that, due to humanlike appearance, teleoperated androids do not only affect interlocutors communicating with them but also teleoperators controlling them in another location. They enhance teleoperator's feeling of telepresence by inducing a sense of ownership over their body parts. It is also pointed out that a mismatch between an android and a teleoperator in appearance distorts the teleoperator's personality to be conveyed to an interlocutor. To overcome this problem, the concept of minimal human likeness design is introduced. We demonstrate that a new teleoperated android developed with the concept reduces the distortion in telecommunication. Finally, some research issues are discussed on a sense of ownership over telerobot's body, minimal human likeness design, and interface design.
BibTeX:
@Inproceedings{Sumioka2012c,
  author          = {Hidenobu Sumioka and Shuichi Nishio and Hiroshi Ishiguro},
  title           = {Teleoperated android for mediated communication : body ownership, personality distortion, and minimal human design},
  booktitle       = {the {RO-MAN} 2012 workshop on social robotic telepresence},
  year            = {2012},
  pages           = {32--39},
  address         = {Paris, France},
  month           = Sep,
  day             = {9-13},
  abstract        = {In this paper we discuss the impact of humanlike appearance on telecommunication, giving an overview of studies with teleoperated androids. We show that, due to humanlike appearance, teleoperated androids do not only affect interlocutors communicating with them but also teleoperators controlling them in another location. They enhance teleoperator's feeling of telepresence by inducing a sense of ownership over their body parts. It is also pointed out that a mismatch between an android and a teleoperator in appearance distorts the teleoperator's personality to be conveyed to an interlocutor. To overcome this problem, the concept of minimal human likeness design is introduced. We demonstrate that a new teleoperated android developed with the concept reduces the distortion in telecommunication. Finally, some research issues are discussed on a sense of ownership over telerobot's body, minimal human likeness design, and interface design.},
  file            = {Sumioka2012c.pdf:Sumioka2012c.pdf:PDF},
}
Ilona Straub, Shuichi Nishio, Hiroshi Ishiguro, "From an Object to a Subject -- Transitions of an Android Robot into a Social Being", In IEEE International Symposium on Robot and Human Interactive Communication, Paris, France, pp. 821-826, September, 2012.
Abstract: What are the characteristics that make something appear as a social entity? Is sociality limited to human beings? The following article will deal with the borders of sociality and the characterizations of animating a physical object (here: android robot) to a living being. The transition is attributed during interactive encounters. We will introduce implications of an ethnomethodological analysis which shows characteristics of transitions in social attribution towards an android robot, which is treated and perceived gradually shifting from an object to a social entity. These characteristics should a) fill the gap in current anthropological and sociological research, dealing with the limits and characteristics of social entities, and b) contribute to the discussion of specifics in human-android interaction compared to human-human interaction.
BibTeX:
@Inproceedings{Straub2012,
  author          = {Ilona Straub and Shuichi Nishio and Hiroshi Ishiguro},
  title           = {From an Object to a Subject -- Transitions of an Android Robot into a Social Being},
  booktitle       = {{IEEE} International Symposium on Robot and Human Interactive Communication},
  year            = {2012},
  pages           = {821--826},
  address         = {Paris, France},
  month           = Sep,
  day             = {9-13},
  doi             = {10.1109/ROMAN.2012.6343853},
  abstract        = {What are the characteristics that make something appear as a social entity? Is sociality limited to human beings? The following article will deal with the borders of sociality and the characterizations of animating a physical object (here: android robot) to a living being. The transition is attributed during interactive encounters. We will introduce implications of an ethnomethodological analysis which shows characteristics of transitions in social attribution towards an android robot, which is treated and perceived gradually shifting from an object to a social entity. These characteristics should a) fill the gap in current anthropological and sociological research, dealing with the limits and characteristics of social entities, and b) contribute to the discussion of specifics in human-android interaction compared to human-human interaction.},
  file            = {Straub2012.pdf:Strabu2012.pdf:PDF},
}
Kohei Ogawa, Koichi Taura, Shuichi Nishio, Hiroshi Ishiguro, "Effect of perspective change in body ownership transfer to teleoperated android robot", In IEEE International Symposium on Robot and Human Interactive Communication, Paris, France, pp. 1072-1077, September, 2012.
Abstract: We previously investigated body ownership transfer to a teleoperated android body caused by motion synchronization between the robot and its operator. Although visual feedback is the only information provided from the robot, due to body ownership transfer, some operators feel as if they were touched when the robot's body was touched. This illusion can help operators transfer their presence to the robotic body during teleoperation. By enhancing this phenomenon, we can improve our communication interface and the quality of the interaction between operator and interlocutor. In this paper, we examined how the change in the operator's perspective affects the body ownership transfer during teleoperation. Based on past studies on the rubber hand illusion, we hypothesized that the perspective change will suppress the body owner transfer. Our results, however, showed that in any perspective condition, the participants felt the body ownership transfer. This shows that its generation process differs to teleoperated androids and the rubber hand illusion.
BibTeX:
@Inproceedings{Ogawa2012c,
  author          = {Kohei Ogawa and Koichi Taura and Shuichi Nishio and Hiroshi Ishiguro},
  title           = {Effect of perspective change in body ownership transfer to teleoperated android robot},
  booktitle       = {{IEEE} International Symposium on Robot and Human Interactive Communication},
  year            = {2012},
  pages           = {1072--1077},
  address         = {Paris, France},
  month           = Sep,
  day             = {9-13},
  doi             = {10.1109/ROMAN.2012.6343891},
  abstract        = {We previously investigated body ownership transfer to a teleoperated android body caused by motion synchronization between the robot and its operator. Although visual feedback is the only information provided from the robot, due to body ownership transfer, some operators feel as if they were touched when the robot's body was touched. This illusion can help operators transfer their presence to the robotic body during teleoperation. By enhancing this phenomenon, we can improve our communication interface and the quality of the interaction between operator and interlocutor. In this paper, we examined how the change in the operator's perspective affects the body ownership transfer during teleoperation. Based on past studies on the rubber hand illusion, we hypothesized that the perspective change will suppress the body owner transfer. Our results, however, showed that in any perspective condition, the participants felt the body ownership transfer. This shows that its generation process differs to teleoperated androids and the rubber hand illusion.},
  file            = {Ogawa2012c.pdf:Ogawa2012c.pdf:PDF},
}
Antonio Chella, Haris Dindo, Rosario Sorbello, Shuichi Nishio, Hiroshi Ishiguro, "Sing with the Telenoid", In CogSci 2012 Workshop on Teleoperated Android as a Tool for Cognitive Studies, Communication and Art, Sapporo Convention Center, pp. 16-20, August, 2012.
BibTeX:
@Inproceedings{Chella2012,
  author    = {Antonio Chella and Haris Dindo and Rosario Sorbello and Shuichi Nishio and Hiroshi Ishiguro},
  title     = {Sing with the Telenoid},
  booktitle = {{C}og{S}ci 2012 Workshop on Teleoperated Android as a Tool for Cognitive Studies, Communication and Art},
  year      = {2012},
  pages     = {16--20},
  address   = {Sapporo Convention Center},
  month     = Aug,
  day       = {1-4},
  file      = {Chella2012.pdf:Chella2012.pdf:PDF},
  keywords  = {Computer Music; Embodiment; Emotions; Imitation learning; Creativity; Human-robot Interaction},
}
Takashi Minato, Shuichi Nishio, Kohei Ogawa, Hiroshi Ishiguro, "Development of Cellphone-type Tele-operated Android", Poster presentation at The 10th Asia Pacific Conference on Computer Human Interaction, Matsue, Japan, pp. 665-666, August, 2012.
Abstract: This paper presents a newly developed portable human-like robotic avatar “Elfoid" which can be a novel communication medium in that a user can talk with another person in a remote location in such a way that they feel each other's presence. It is designed to convey individuals' presence using voice, human-like appearance, and touch. Thanks to its cellphone capability, it can be used at anytime, anywhere. The paper describes the design concept of Elfoid and argues research issues on this communication medium.
BibTeX:
@Inproceedings{Minato2012b,
  author    = {Takashi Minato and Shuichi Nishio and Kohei Ogawa and Hiroshi Ishiguro},
  title     = {Development of Cellphone-type Tele-operated Android},
  booktitle = {The 10th Asia Pacific Conference on Computer Human Interaction},
  year      = {2012},
  pages     = {665-666},
  address   = {Matsue, Japan},
  month     = Aug,
  day       = {28-31},
  abstract  = {This paper presents a newly developed portable human-like robotic avatar “Elfoid" which can be a novel communication medium in that a user can talk with another person in a remote location in such a way that they feel each other's presence. It is designed to convey individuals' presence using voice, human-like appearance, and touch. Thanks to its cellphone capability, it can be used at anytime, anywhere. The paper describes the design concept of Elfoid and argues research issues on this communication medium.},
  file      = {Minato2012b.pdf:Minato2012b.pdf:PDF},
  keywords  = {Communication media; minimal design; human's presence},
}
Shuichi Nishio, "Transmitting human presence with teleoperated androids: from proprioceptive transfer to elderly care", In CogSci2012 Workshop on Teleopearted Android as a Tool for Cognitive Studies, Communication and Art, Sapporo, Japan, August, 2012.
Abstract: Teleoperated androids, robots owning humanlike appearance equipped with semi-autonomous teleoperation facility, was first introduce in 2007 with the public release of Geminoid HI-1. Both its appearance that resembles the source person and its teleoperation functionality serves in making Geminoid as a research tool for seeking the nature of human presence and personality traits, tracing their origins and implementing into robots. Since the development of the first teleoperated android, we have been using them in a variety of domains, from studies on basic human natures to practical applications such as elderly care. In this talk, I will introduce some of our findings and ongoing projects.
BibTeX:
@Inproceedings{Nishio2012d,
  author    = {Shuichi Nishio},
  title     = {Transmitting human presence with teleoperated androids: from proprioceptive transfer to elderly care},
  booktitle = {CogSci2012 Workshop on Teleopearted Android as a Tool for Cognitive Studies, Communication and Art},
  year      = {2012},
  address   = {Sapporo, Japan},
  month     = Aug,
  abstract  = {Teleoperated androids, robots owning humanlike appearance equipped with semi-autonomous teleoperation facility, was first introduce in 2007 with the public release of Geminoid HI-1. Both its appearance that resembles the source person and its teleoperation functionality serves in making Geminoid as a research tool for seeking the nature of human presence and personality traits, tracing their origins and implementing into robots. Since the development of the first teleoperated android, we have been using them in a variety of domains, from studies on basic human natures to practical applications such as elderly care. In this talk, I will introduce some of our findings and ongoing projects.},
}
Hidenobu Sumioka, Shuichi Nishio, Erina Okamoto, Hiroshi Ishiguro, "Doppel Teleoperation System: Isolation of physical traits and intelligence for personality study", In Annual meeting of the Cognitive Science Society (CogSci2012), Sapporo Convention Center, pp. 2375-2380, August, 2012.
Abstract: We introduce the “Doppel teleoperation system", which isolates several physical traits from a speaker, to investigate how personal information is conveyed to other people during conversation. With the Doppel system, one can choose for each of the communication channels to be transferred whether in its original form or in the one generated by the system. For example, the voice and body motion can be replaced by the Doppel system while the speech content is preserved. This will allow us to analyze individual effects of physical traits of the speaker and content in the speaker's speech on identification of personality. This selectivity of personal traits provides us with useful approach to investigate which information conveys our personality through conversation. To show a potential of this proposed system, we conduct an experiment to test how much the content of conversation conveys the personality of speakers to interlocutors, without any physical traits of the speakers. Preliminary results show that although interlocutors have difficulty identifying their speakers only by using conversational contents, they can recognize their acquaintances when their acquaintances are the speakers. We point out some potential physical traits to convey our personality.
BibTeX:
@Inproceedings{Sumioka2012,
  author          = {Hidenobu Sumioka and Shuichi Nishio and Erina Okamoto and Hiroshi Ishiguro},
  title           = {Doppel Teleoperation System: Isolation of physical traits and intelligence for personality study},
  booktitle       = {Annual meeting of the Cognitive Science Society ({C}og{S}ci2012)},
  year            = {2012},
  pages           = {2375-2380},
  address         = {Sapporo Convention Center},
  month           = Aug,
  day             = {1-4},
  url             = {http://mindmodeling.org/cogsci2012/papers/0413/paper0413.pdf},
  abstract        = {We introduce the “Doppel teleoperation system", which isolates several physical traits from a speaker, to investigate how personal information is conveyed to other people during conversation. With the Doppel system, one can choose for each of the communication channels to be transferred whether in its original form or in the one generated by the system. For example, the voice and body motion can be replaced by the Doppel system while the speech content is preserved. This will allow us to analyze individual effects of physical traits of the speaker and content in the speaker's speech on identification of personality. This selectivity of personal traits provides us with useful approach to investigate which information conveys our personality through conversation. To show a potential of this proposed system, we conduct an experiment to test how much the content of conversation conveys the personality of speakers to interlocutors, without any physical traits of the speakers. Preliminary results show that although interlocutors have difficulty identifying their speakers only by using conversational contents, they can recognize their acquaintances when their acquaintances are the speakers. We point out some potential physical traits to convey our personality.},
  file            = {Sumioka2012.pdf:Sumioka2012.pdf:PDF},
  keywords        = {social cognition; android science; human-robot interaction; personality psychology; personal presence},
}
Hidenobu Sumioka, Takashi Minato, Kurima Sakai, Shuichi Nishio, Hiroshi Ishiguro, "Motion Design of an Interactive Small Humanoid Robot with Visual Illusion", In The 10th Asia Pacific Conference on Computer Human Interaction, Matsue, Japan, pp. 93-100, August, 2012.
Abstract: We propose a method that enables users to convey nonver- bal information, especially their gestures, through portable robot avatar based on illusory motion. The illusory mo- tion of head nodding is realized with blinking lights for a human-like mobile phone called Elfoid. Two blinking pat- terns of LEDs are designed based on biological motion and illusory motion from shadows. The patterns are compared to select an appropriate pattern for the illusion of motion in terms of the naturalness of movements and quick percep- tion. The result shows that illusory motions show better per- formance than biological motion. We also test whether the illusory motion of head nodding provides a positive effect compared with just blinking lights. In experiments, subjects, who are engaged in role-playing game, are asked to com- plain to Elfoids about their unpleasant situation. The results show that the subject frustration is eased by Elfoid's illusory head nodding.
BibTeX:
@Inproceedings{Sumioka2012a,
  author    = {Hidenobu Sumioka and Takashi Minato and Kurima Sakai and Shuichi Nishio and Hiroshi Ishiguro},
  title     = {Motion Design of an Interactive Small Humanoid Robot with Visual Illusion},
  booktitle = {The 10th Asia Pacific Conference on Computer Human Interaction},
  year      = {2012},
  pages     = {93-100},
  address   = {Matsue, Japan},
  month     = Aug,
  day       = {28-31},
  url       = {http://dl.acm.org/authorize?6720741},
  abstract  = {We propose a method that enables users to convey nonver- bal information, especially their gestures, through portable robot avatar based on illusory motion. The illusory mo- tion of head nodding is realized with blinking lights for a human-like mobile phone called Elfoid. Two blinking pat- terns of LEDs are designed based on biological motion and illusory motion from shadows. The patterns are compared to select an appropriate pattern for the illusion of motion in terms of the naturalness of movements and quick percep- tion. The result shows that illusory motions show better per- formance than biological motion. We also test whether the illusory motion of head nodding provides a positive effect compared with just blinking lights. In experiments, subjects, who are engaged in role-playing game, are asked to com- plain to Elfoids about their unpleasant situation. The results show that the subject frustration is eased by Elfoid's illusory head nodding.},
  file      = {Sumioka2012a.pdf:Sumioka2012a.pdf:PDF},
  keywords  = {telecommunication; nonverbal communication; portable robot avatar; visual illusion of motion},
}
Hiroshi Ishiguro, Shuichi Nishio, Antonio Chella, Rosario Sorbello, Giuseppe Balistreri, Marcello Giardina, Carmelo Cali, "Perceptual Social Dimensions of Human-Humanoid Robot Interaction", In The 12th International Conference on Intelligent Autonomous Systems, Springer Berlin Heidelberg, vol. 194, Jeju International Convention Center, Korea, pp. 409-421, June, 2012.
Abstract: The present paper aims at a descriptive analysis of the main perceptual and social features of natural conditions of agent interaction, which can be specified by agent in human- humanoid robot interaction. A principled approach to human- robot interaction may be assumed to comply with the natural conditions of agents overt perceptual and social behaviour. To validate our research we used the minimalistic humanoid robot Telenoid. We have conducted human-robot interactions test with people with no prior interaction experience with robot. By administrating our questionnaire to subject after well defined experimental conditions, an analysis of significant variance corre- lation among dimensions in ordinary and goal guided contexts of interaction has been performed in order to prove that perception and believability are indicators of social interaction and increase the degree of interaction in human-humanoid interaction. The experimental results showed that Telenoid is seen from the users as an autonomous agent on its own rather than a teleoperated artificial agent and as a believable agent for its naturally acting in response to human agent actions.
BibTeX:
@Inproceedings{Ishiguro2012,
  author    = {Hiroshi Ishiguro and Shuichi Nishio and Antonio Chella and Rosario Sorbello and Giuseppe Balistreri and Marcello Giardina and Carmelo Cali},
  title     = {Perceptual Social Dimensions of Human-Humanoid Robot Interaction},
  booktitle = {The 12th International Conference on Intelligent Autonomous Systems},
  year      = {2012},
  volume    = {194},
  series    = {Advances in Intelligent Systems and Computing},
  pages     = {409-421},
  address   = {Jeju International Convention Center, Korea},
  month     = Jun,
  publisher = {Springer Berlin Heidelberg},
  day       = {26-29},
  doi       = {10.1007/978-3-642-33932-5_38},
  url       = {http://link.springer.com/chapter/10.1007/978-3-642-33932-5_38},
  abstract  = {The present paper aims at a descriptive analysis of the main perceptual and social features of natural conditions of agent interaction, which can be specified by agent in human- humanoid robot interaction. A principled approach to human- robot interaction may be assumed to comply with the natural conditions of agents overt perceptual and social behaviour. To validate our research we used the minimalistic humanoid robot Telenoid. We have conducted human-robot interactions test with people with no prior interaction experience with robot. By administrating our questionnaire to subject after well defined experimental conditions, an analysis of significant variance corre- lation among dimensions in ordinary and goal guided contexts of interaction has been performed in order to prove that perception and believability are indicators of social interaction and increase the degree of interaction in human-humanoid interaction. The experimental results showed that Telenoid is seen from the users as an autonomous agent on its own rather than a teleoperated artificial agent and as a believable agent for its naturally acting in response to human agent actions.},
  file      = {Ishiguro2012.pdf:Ishiguro2012.pdf:PDF},
  keywords  = {Telenoid, Geminoid, Human Robot Interaction, Social Robot, Humanoid Robot},
}
Ryuji Yamazaki, Shuichi Nishio, Kohei Ogawa, Hiroshi Ishiguro, Kohei Matsumura, Kensuke Koda, Tsutomu Fujinami, "How Does Telenoid Affect the Communication between Children in Classroom Setting ?", In Extended Abstracts of the Conference on Human Factors in Computing Systems, Austin, Texas, USA, pp. 351-366, May, 2012.
Abstract: Recent advances in robotics have produced kinds of robots that are not only autonomous but can also tele- operated and have humanlike appearances. However, it is not sufficiently investigated how the tele-operated humanoid robots can affect and be accepted by people in a real world. In the present study, we investigated how elementary school children accepted Telenoid R1, a tele-operated humanoid robot. We conducted a school-based action research project to explore their responses to the robot. Our research theme was the social aspects that might facilitate communication and the purpose was problem finding. There have been considerable studies for resolving the remote disadvantage; although face-to-face is always supposed to be the best way for our communication, we ask whether it is possible to determine the primacy of remote communication over face-to-face. As a result of the field experiment in a school, the structure of children's group work changed and their attitude turned more positive than usual. Their spontaneity was brought out and role differentiation occurred with them. Mainly due to the limitations by Telenoid, children changed their attitude and could cooperatively work. The result suggested that the remote communication that set a limit to our capability could be useful for us to know and be trained the effective way to work more cooperatively than usual face-to-face. It remained as future work to compare Telenoid with various media and to explore the appropriate conditions that promote our cooperation.
BibTeX:
@Inproceedings{Yamazaki2012,
  author          = {Ryuji Yamazaki and Shuichi Nishio and Kohei Ogawa and Hiroshi Ishiguro and Kohei Matsumura and Kensuke Koda and Tsutomu Fujinami},
  title           = {How Does Telenoid Affect the Communication between Children in Classroom Setting ?},
  booktitle       = {Extended Abstracts of the Conference on Human Factors in Computing Systems},
  year            = {2012},
  pages           = {351-366},
  address         = {Austin, Texas, {USA}},
  month           = May,
  day             = {5-10},
  doi             = {10.1145/2212776.2212814},
  url             = {http://dl.acm.org/authorize?6764060},
  abstract        = {Recent advances in robotics have produced kinds of robots that are not only autonomous but can also tele- operated and have humanlike appearances. However, it is not sufficiently investigated how the tele-operated humanoid robots can affect and be accepted by people in a real world. In the present study, we investigated how elementary school children accepted Telenoid R1, a tele-operated humanoid robot. We conducted a school-based action research project to explore their responses to the robot. Our research theme was the social aspects that might facilitate communication and the purpose was problem finding. There have been considerable studies for resolving the remote disadvantage; although face-to-face is always supposed to be the best way for our communication, we ask whether it is possible to determine the primacy of remote communication over face-to-face. As a result of the field experiment in a school, the structure of children's group work changed and their attitude turned more positive than usual. Their spontaneity was brought out and role differentiation occurred with them. Mainly due to the limitations by Telenoid, children changed their attitude and could cooperatively work. The result suggested that the remote communication that set a limit to our capability could be useful for us to know and be trained the effective way to work more cooperatively than usual face-to-face. It remained as future work to compare Telenoid with various media and to explore the appropriate conditions that promote our cooperation.},
  file            = {Yamazaki2012.pdf:Yamazaki2012.pdf:PDF},
  keywords        = {Tele-operation; android; minimal design; human interaction; role differentiation; cooperation},
}
Maryam Alimardani, Shuichi Nishio, Hiroshi Ishiguro, "BMI-teleoperation of androids can transfer the sense of body ownership", Poster presentation at Cognitive Neuroscience Society's Annual Meeting, Chicago, Illinois, USA, April, 2012.
Abstract: This work examines whether body ownership transfer can be induced by mind controlling android robots. Body ownership transfer is an illusion that happens for some people while tele-operating an android. They occasionally feel the robot's body has become a part of their own body and may feel a touch or a poke on robot's body or face even in the absence of tactile feedback. Previous studies have demonstrated that this feeling of ownership over an agent hand can be induced when robot's hand motions are in perfect synchronization with operator's motions. However, it was not known whether this occurs due to the agency of the motion or by proprioceptive feedback of the real limb. In this work however, subjects imagine their own right or left hand movement while watching android's corresponding hand moving according to the analysis of their brain activity. Through this research, we investigated whether elimination of proprioceptive feedback from operator's real limb can result in the illusion of ownership over external agent body. Evaluation was made by two measurement methods of questionnaire and skin conductance response and results from both methods proved a significant difference in intensity of bodily feeling transfer when the robot's hands moved according to participant's imagination.
BibTeX:
@Inproceedings{Alimardani2012,
  author    = {Maryam Alimardani and Shuichi Nishio and Hiroshi Ishiguro},
  title     = {{BMI}-teleoperation of androids can transfer the sense of body ownership},
  booktitle = {Cognitive Neuroscience Society's Annual Meeting},
  year      = {2012},
  address   = {Chicago, Illinois, {USA}},
  month     = Apr,
  day       = {1},
  abstract  = {This work examines whether body ownership transfer can be induced by mind controlling android robots. Body ownership transfer is an illusion that happens for some people while tele-operating an android. They occasionally feel the robot's body has become a part of their own body and may feel a touch or a poke on robot's body or face even in the absence of tactile feedback. Previous studies have demonstrated that this feeling of ownership over an agent hand can be induced when robot's hand motions are in perfect synchronization with operator's motions. However, it was not known whether this occurs due to the agency of the motion or by proprioceptive feedback of the real limb. In this work however, subjects imagine their own right or left hand movement while watching android's corresponding hand moving according to the analysis of their brain activity. Through this research, we investigated whether elimination of proprioceptive feedback from operator's real limb can result in the illusion of ownership over external agent body. Evaluation was made by two measurement methods of questionnaire and skin conductance response and results from both methods proved a significant difference in intensity of bodily feeling transfer when the robot's hands moved according to participant's imagination.},
  file      = {Alimardani2012.pdf:Alimardani2012.pdf:PDF},
}
田浦康一, 西尾修一, 小川浩平, 石黒浩, "遠隔操作型アンドロイドを用いた身体感覚の同調と視点による影響の検証", HAIシンポジウム, 京都工芸繊維大学, pp. I-2A-2, December, 2011.
Abstract: Previously we have investigated the body ownership transfer to a teleoperated android body caused by motion synchronization between robot and operator. Although visual feedback is the only information provided from robot, due to body ownership transfer some operators feel as if they were touched when the robot's body was touched. This illusion can help operators to transfer their presence to robotic body during teleoperation.By enhancing this phenomenon, we can improve our communication interface and the quality of interaction between operator and interlocutor. This can eventually contribute to a novel treatment method for autistic patients. In this paper, we examined how the change in operator's perspective affects the body ownership transfer during teleoperation. Based on past studies on rubber hand illusion, it is hypothesized that perspective change will surpress the body owner transfer. The results, however, showed that in any perspective condition, the participants felt body ownership transfer. .This shows that body ownership transfer to teleoperated androids and the rubber hand illusion differs in their generation process.
BibTeX:
@Inproceedings{田浦康一2011,
  author          = {田浦康一 and 西尾修一 and 小川浩平 and 石黒浩},
  title           = {遠隔操作型アンドロイドを用いた身体感覚の同調と視点による影響の検証},
  booktitle       = {{HAI}シンポジウム},
  year            = {2011},
  pages           = {I-2{A}-2},
  address         = {京都工芸繊維大学},
  month           = Dec,
  day             = {3-5},
  url             = {http://www.ii.is.kit.ac.jp/hai2011/proceedings/html/paper/paper-1-2a-2.html},
  etitle          = {Effect of perspective change in body ownership transfer to teleoperated android robot},
  abstract        = {Previously we have investigated the body ownership transfer to a teleoperated android body caused by motion synchronization between robot and operator. Although visual feedback is the only information provided from robot, due to body ownership transfer some operators feel as if they were touched when the robot's body was touched. This illusion can help operators to transfer their presence to robotic body during teleoperation.By enhancing this phenomenon, we can improve our communication interface and the quality of interaction between operator and interlocutor. This can eventually contribute to a novel treatment method for autistic patients. In this paper, we examined how the change in operator's perspective affects the body ownership transfer during teleoperation. Based on past studies on rubber hand illusion, it is hypothesized that perspective change will surpress the body owner transfer. The results, however, showed that in any perspective condition, the participants felt body ownership transfer. .This shows that body ownership transfer to teleoperated androids and the rubber hand illusion differs in their generation process.},
  file            = {田浦康一2011.pdf:田浦康一2011.pdf:PDF;I-2A-2.pdf:http\://www.ii.is.kit.ac.jp/hai2011/proceedings/pdf/I-2A-2.pdf:PDF},
}
Maryam Alimardani, Shuichi Nishio, Hiroshi Ishiguro, "Body ownership transfer to tele-operated android through mind controlling", In HAI-2011, Kyoto Institute of Technology, pp. I-2A-1, December, 2011.
Abstract: This work examines whether body ownership transfer can be induced by mind controlling android robots. Body ownership transfer is an illusion that happens for some people while tele-operating an android. They occasionally feel the robot's body has become a part of their own body and may feel a touch or a poke on robot's body or face even in the absence of tactile feedback. Previous studies have demonstrated that this feeling of ownership over an agent hand can be induced when robot's hand motions are in synchronization with operator's motions. However, it was not known whether this occurs due to the agency of the motion or by proprioceptive feedback of the real hand. In this work, subjects imagine their own right or left hand movement while watching android's corresponding hand moving according to the analysis of their brain activity. Through this research, we investigated whether elimination of proprioceptive feedback from operator's real limb can result in the illusion of ownership over external agent body. Evaluation was made by two measurement methods of questionnaire and skin conductance response and results from both methods proved a significant difference in intensity of bodily feeling transfer participant's imagination.
BibTeX:
@Inproceedings{Alimardani2011,
  author          = {Maryam Alimardani and Shuichi Nishio and Hiroshi Ishiguro},
  title           = {Body ownership transfer to tele-operated android through mind controlling},
  booktitle       = {{HAI}-2011},
  year            = {2011},
  pages           = {I-2{A}-1},
  address         = {Kyoto Institute of Technology},
  month           = Dec,
  day             = {3-5},
  url             = {http://www.ii.is.kit.ac.jp/hai2011/proceedings/html/paper/paper-1-2a-1.html},
  abstract        = {This work examines whether body ownership transfer can be induced by mind controlling android robots. Body ownership transfer is an illusion that happens for some people while tele-operating an android. They occasionally feel the robot's body has become a part of their own body and may feel a touch or a poke on robot's body or face even in the absence of tactile feedback. Previous studies have demonstrated that this feeling of ownership over an agent hand can be induced when robot's hand motions are in synchronization with operator's motions. However, it was not known whether this occurs due to the agency of the motion or by proprioceptive feedback of the real hand. In this work, subjects imagine their own right or left hand movement while watching android's corresponding hand moving according to the analysis of their brain activity. Through this research, we investigated whether elimination of proprioceptive feedback from operator's real limb can result in the illusion of ownership over external agent body. Evaluation was made by two measurement methods of questionnaire and skin conductance response and results from both methods proved a significant difference in intensity of bodily feeling transfer participant's imagination.},
  file            = {Alimardani2011.pdf:Alimardani2011.pdf:PDF;I-2A-1.pdf:http\://www.ii.is.kit.ac.jp/hai2011/proceedings/pdf/I-2A-1.pdf:PDF},
}
境くりま, 港隆史, 西尾修一, 石黒浩, "LED点滅による運動錯覚を用いた携帯型アンドロイドの運動錯覚の生成", HAIシンポジウム, 京都工芸繊維大学, pp. II-1B-1, December, 2011.
Abstract: We can not naturally communicate through communication media such as cell phone compared with face to face communication because they can not transmit human presence. We try to transmit human presence by a small humanoid communication medium ``Elfoid''. Elfoid is a new information medium that harmonizes human with information-environment beyond existing personal computers and cellphones, and is designed according to minimum requirements to express humanlike appearance and motion, which are revealed in our past studies. To transmit human presence, Elfoid needs to express motions. However it is too small to equip actuators for motions. Instead of actuators, we proposed a way to have users recognize motions of Elfoid by using motion illusion with LED blinking. In this paper, we focused on motion of nodding that is important for talking. In the results of experiments, we revealed that a blinking pattern to manipulate a shadow of the face naturally elicits an illusion of nodding motion.
BibTeX:
@Inproceedings{境くりま2011,
  author          = {境くりま and 港隆史 and 西尾修一 and 石黒浩},
  title           = {{LED}点滅による運動錯覚を用いた携帯型アンドロイドの運動錯覚の生成},
  booktitle       = {{HAI}シンポジウム},
  year            = {2011},
  pages           = {II-1B-1},
  address         = {京都工芸繊維大学},
  month           = Dec,
  day             = {3-5},
  url             = {http://www.ii.is.kit.ac.jp/hai2011/proceedings/html/paper/paper-2-1b-1.html},
  etitle          = {Creating Motion of Mobile Android by Motion Illusions with LED Blinking},
  abstract        = {We can not naturally communicate through communication media such as cell phone compared with face to face communication because they can not transmit human presence. We try to transmit human presence by a small humanoid communication medium ``Elfoid''. Elfoid is a new information medium that harmonizes human with information-environment beyond existing personal computers and cellphones, and is designed according to minimum requirements to express humanlike appearance and motion, which are revealed in our past studies. To transmit human presence, Elfoid needs to express motions. However it is too small to equip actuators for motions. Instead of actuators, we proposed a way to have users recognize motions of Elfoid by using motion illusion with LED blinking. In this paper, we focused on motion of nodding that is important for talking. In the results of experiments, we revealed that a blinking pattern to manipulate a shadow of the face naturally elicits an illusion of nodding motion.},
  file            = {境くりま2011.pdf:境くりま2011.pdf:PDF;II-1B-1.pdf:http\://www.ii.is.kit.ac.jp/hai2011/proceedings/pdf/II-1B-1.pdf:PDF},
}
Giuseppe Balistreri, Shuichi Nishio, Rosario Sorbello, Antonio Chella, Hiroshi Ishiguro, "A Natural Human Robot Meta-comunication through the Integration of Android's Sensors with Environment Embedded Sensors", In Biologically Inspired Cognitive Architectures 2011- Proceedings of the Second Annual Meeting of the BICA Society, IOS Press, vol. 233, Arlington, Virginia, USA, pp. 26-38, November, 2011.
Abstract: Building robots that closely resemble humans allow us to study phenom- ena in our daily human-to-human natural interactions that cannot be studied using mechanical-looking robots. This is supported by the fact that human-like devices can more easily elicit the same kind of responses that people use in their natural interactions. However, several studies supported that there is a strict and complex relationship between outer appearance and the behavior showed by the robot and, as Masahiro Mori observed, a human-like appearance is not enough for give a pos- itive impression. The robot should behave closely to humans, and should have a sense of perception that enables it to communicate with humans. Our past experi- ence with the android “Geminoid HI-1" demonstrated that the sensors equipping the robot are not enough to perform a human-like communication, mainly because of a limited sensing range. To overcome this problem, we endowed the environ- ment around the robot with perceptive capabilities by embedding sensors such as cameras into it. This paper reports a preliminary study about an improvement of the controlling system by integrating cameras in the surrounding environment, so that a human-like perception can be provided to the android. The integration of the de- velopment of androids and the investigations of human behaviors constitute a new research area fusing engineering and cognitive sciences.
BibTeX:
@Inproceedings{Balistreri2011a,
  author    = {Giuseppe Balistreri and Shuichi Nishio and Rosario Sorbello and Antonio Chella and Hiroshi Ishiguro},
  title     = {A Natural Human Robot Meta-comunication through the Integration of Android's Sensors with Environment Embedded Sensors},
  booktitle = {Biologically Inspired Cognitive Architectures 2011- Proceedings of the Second Annual Meeting of the {BICA} Society},
  year      = {2011},
  volume    = {233},
  pages     = {26-38},
  address   = {Arlington, Virginia, {USA}},
  month     = Nov,
  publisher = {{IOS} Press},
  day       = {5-6},
  abstract  = {Building robots that closely resemble humans allow us to study phenom- ena in our daily human-to-human natural interactions that cannot be studied using mechanical-looking robots. This is supported by the fact that human-like devices can more easily elicit the same kind of responses that people use in their natural interactions. However, several studies supported that there is a strict and complex relationship between outer appearance and the behavior showed by the robot and, as Masahiro Mori observed, a human-like appearance is not enough for give a pos- itive impression. The robot should behave closely to humans, and should have a sense of perception that enables it to communicate with humans. Our past experi- ence with the android “Geminoid HI-1" demonstrated that the sensors equipping the robot are not enough to perform a human-like communication, mainly because of a limited sensing range. To overcome this problem, we endowed the environ- ment around the robot with perceptive capabilities by embedding sensors such as cameras into it. This paper reports a preliminary study about an improvement of the controlling system by integrating cameras in the surrounding environment, so that a human-like perception can be provided to the android. The integration of the de- velopment of androids and the investigations of human behaviors constitute a new research area fusing engineering and cognitive sciences.},
  file      = {Balistreri2011a.pdf:Balistreri2011a.pdf:PDF},
  keywords  = {Android; gaze; sensor network},
}
Giuseppe Balistreri, Shuichi Nishio, Rosario Sorbello, Hiroshi Ishiguro, "Integrating Built-in Sensors of an Android with Sensors Embedded in the Environment for Studying a More Natural Human-Robot Interaction", In Lecture Notes in Computer Science (12th International Conference of the Italian Association for Artificial Intelligence), Springer, vol. 6934, Palermo, Italy, pp. 432-437, September, 2011.
Abstract: Several studies supported that there is a strict and complex relationship between outer appearance and the behavior showed by the robot and that a human-like appearance is not enough for give a positive impression. The robot should behave closely to humans, and should have a sense of perception that enables it to communicate with humans. Our past experience with the android ``Geminoid HI-1'' demonstrated that the sensors equipping the robot are not enough to perform a human-like communication, mainly because of a limited sensing range. To overcome this problem, we endowed the environment around the robot with per- ceptive capabilities by embedding sensors such as cameras into it. This paper reports a preliminary study about an improvement of the control- ling system by integrating cameras in the surrounding environment, so that a human-like perception can be provided to the android. The inte- gration of the development of androids and the investigations of human behaviors constitute a new research area fusing engineering and cognitive sciences.
BibTeX:
@Inproceedings{Balistreri2011,
  author    = {Giuseppe Balistreri and Shuichi Nishio and Rosario Sorbello and Hiroshi Ishiguro},
  title     = {Integrating Built-in Sensors of an Android with Sensors Embedded in the Environment for Studying a More Natural Human-Robot Interaction},
  booktitle = {Lecture Notes in Computer Science (12th International Conference of the Italian Association for Artificial Intelligence)},
  year      = {2011},
  volume    = {6934},
  pages     = {432--437},
  address   = {Palermo, Italy},
  month     = Sep,
  publisher = {Springer},
  doi       = {10.1007/978-3-642-23954-0_43},
  url       = {http://www.springerlink.com/content/c015680178436107/},
  abstract  = {Several studies supported that there is a strict and complex relationship between outer appearance and the behavior showed by the robot and that a human-like appearance is not enough for give a positive impression. The robot should behave closely to humans, and should have a sense of perception that enables it to communicate with humans. Our past experience with the android ``Geminoid HI-1'' demonstrated that the sensors equipping the robot are not enough to perform a human-like communication, mainly because of a limited sensing range. To overcome this problem, we endowed the environment around the robot with per- ceptive capabilities by embedding sensors such as cameras into it. This paper reports a preliminary study about an improvement of the control- ling system by integrating cameras in the surrounding environment, so that a human-like perception can be provided to the android. The inte- gration of the development of androids and the investigations of human behaviors constitute a new research area fusing engineering and cognitive sciences.},
  bibsource = {DBLP, http://dblp.uni-trier.de},
  file      = {Balistreri2011.pdf:Balistreri2011.pdf:PDF},
  keywords  = {Android; gaze; sensor network},
}
Kohei Ogawa, Shuichi Nishio, Kensuke Koda, Koichi Taura, Takashi Minato, Carlos T. Ishi, Hiroshi Ishiguro, "Telenoid: Tele-presence android for communication", In SIGGRAPH Emerging Technology, Vancouver, Canada, pp. 15, August, 2011.
Abstract: In this research, a new system of telecommunication called "Telenoid" is presented which focuses on the idea of transferring human's "presence". Telenoid was developed to appear and behave as a minimal design of human features. (Fig. 2(A)) A minimal human conveys the impression of human existence at first glance, but it doesn't suggest anything about personal features such as being male or female, old or young. Previously an android with more realistic features called Geminoid was proposed. However, because of its unique appearance, which is the copy of a model, it is too difficult to imagine other people's presence through Geminoid while they are operating it. On the other hand, Telenoid is designed as it holds an anonymous identity, which allows people to communicate with their acquaintances far away regardless of their gender and age. We expect that the Telenoid can be used as a medium that transfers human's presence by its minimal feature design.
BibTeX:
@Inproceedings{Ogawa2011a,
  author          = {Kohei Ogawa and Shuichi Nishio and Kensuke Koda and Koichi Taura and Takashi Minato and Carlos T. Ishi and Hiroshi Ishiguro},
  title           = {Telenoid: Tele-presence android for communication},
  booktitle       = {{SIGGRAPH} Emerging Technology},
  year            = {2011},
  pages           = {15},
  address         = {Vancouver, Canada},
  month           = Aug,
  day             = {7-11},
  doi             = {10.1145/2048259.2048274},
  url             = {http://dl.acm.org/authorize?6594082},
  abstract        = {In this research, a new system of telecommunication called "Telenoid" is presented which focuses on the idea of transferring human's "presence". Telenoid was developed to appear and behave as a minimal design of human features. (Fig. 2(A)) A minimal human conveys the impression of human existence at first glance, but it doesn't suggest anything about personal features such as being male or female, old or young. Previously an android with more realistic features called Geminoid was proposed. However, because of its unique appearance, which is the copy of a model, it is too difficult to imagine other people's presence through Geminoid while they are operating it. On the other hand, Telenoid is designed as it holds an anonymous identity, which allows people to communicate with their acquaintances far away regardless of their gender and age. We expect that the Telenoid can be used as a medium that transfers human's presence by its minimal feature design.},
  file            = {Ogawa2011a.pdf:Ogawa2011a.pdf:PDF},
}
Ilona Straub, Shuichi Nishio, Hiroshi Ishiguro, "Incorporated identity in interaction with a teleoperated android robot: A case study", In IEEE International Symposium on Robot and Human Interactive Communication, Viareggio, Italy, pp. 139-144, September, 2010.
Abstract: In near future artificial social agents embodied as virtual agents or as robots with humanoid appearance, will be placed in public settings and used as interaction tools. Considering the uncanny-valley-effect or images of robots as threat for humanity, a study about the acceptance and handling of such an interaction tool in the broad public is of great interest. The following study is based on qualitative methods of interaction analysis focusing on tendencies of peoples' ways to control or perceive a teleoperated android robot in an open public space. This field study shows the tendency of the users to ascribe an own identity to the teleoperated android robot Geminoid HI-1, which is independent from the identity of the controlling person. Both sides of the interaction unit were analyzed for 1) verbal cues about identity presentation on the side of the teleoperator, controlling the robot and for 2) verbal cues about identity perception of Geminoid HI-1 from the side of the interlocutor talking to the robot. The study unveils identity-creation, identity-switching, identity-mediation and identity-imitation of the teleoperators' own identity cues and the use of metaphorical language of the interlocutors showing forms to anthropomorphize and mentalize the android robot whilst interaction. Both sides of the interaction unit thus confer an `incorporated identity' towards the android robot Geminoid HI-1 and unveil tendencies to treat the android robot as social agent.
BibTeX:
@Inproceedings{Straub2010a,
  author          = {Ilona Straub and Shuichi Nishio and Hiroshi Ishiguro},
  title           = {Incorporated identity in interaction with a teleoperated android robot: A case study},
  booktitle       = {{IEEE} International Symposium on Robot and Human Interactive Communication},
  year            = {2010},
  pages           = {139--144},
  address         = {Viareggio, Italy},
  month           = Sep,
  doi             = {10.1109/ROMAN.2010.5598695},
  url             = {http://ieeexplore.ieee.org/xpl/freeabs_all.jsp?arnumber=5598695},
  abstract        = {In near future artificial social agents embodied as virtual agents or as robots with humanoid appearance, will be placed in public settings and used as interaction tools. Considering the uncanny-valley-effect or images of robots as threat for humanity, a study about the acceptance and handling of such an interaction tool in the broad public is of great interest. The following study is based on qualitative methods of interaction analysis focusing on tendencies of peoples' ways to control or perceive a teleoperated android robot in an open public space. This field study shows the tendency of the users to ascribe an own identity to the teleoperated android robot Geminoid HI-1, which is independent from the identity of the controlling person. Both sides of the interaction unit were analyzed for 1) verbal cues about identity presentation on the side of the teleoperator, controlling the robot and for 2) verbal cues about identity perception of Geminoid HI-1 from the side of the interlocutor talking to the robot. The study unveils identity-creation, identity-switching, identity-mediation and identity-imitation of the teleoperators' own identity cues and the use of metaphorical language of the interlocutors showing forms to anthropomorphize and mentalize the android robot whilst interaction. Both sides of the interaction unit thus confer an `incorporated identity' towards the android robot Geminoid HI-1 and unveil tendencies to treat the android robot as social agent.},
  file            = {Straub2010a.pdf:Straub2010a.pdf:PDF},
  issn            = {1944-9445},
  keywords        = {Geminoid HI-1;artificial social agent robot;identity-creation;identity-imitation;identity-mediation;identity-switching;interaction tool analysis;metaphorical language;qualitative methods;teleoperated android robot;virtual agents;human-robot interaction;humanoid robots;telerobotics;},
}
Christian Becker-Asano, Kohei Ogawa, Shuichi Nishio, Hiroshi Ishiguro, "Exploring the uncanny valley with Geminoid HI-1 in a real-world application", In IADIS International Conference on Interfaces and Human Computer Interaction, Freiburg, Germany, pp. 121-128, July, 2010.
Abstract: This paper presents a qualitative analysis of 24 interviews with visitors of the ARS Electronica festival in September 2009 in Linz, Austria, who interacted with the android robot Geminoid HI-1, while it was tele-operated by the first author. Only 37.5\% of the interviewed visitors reported an uncanny feeling with 29\% even enjoying the conversation. In five cases the interviewees' feelings even changed during the interaction with Geminoid HI-1. A number of possible improvements regarding Geminoid's bodily movements, facial expressivity, and ability to direct its gaze became apparent, which inform our future research with and development of android robots.
BibTeX:
@Inproceedings{Becker-Asano2010,
  author    = {Christian Becker-Asano and Kohei Ogawa and Shuichi Nishio and Hiroshi Ishiguro},
  title     = {Exploring the uncanny valley with Geminoid {HI}-1 in a real-world application},
  booktitle = {{IADIS} International Conference on Interfaces and Human Computer Interaction},
  year      = {2010},
  pages     = {121--128},
  address   = {Freiburg, Germany},
  month     = Jul,
  url       = {http://www.iadisportal.org/digital-library/exploring-the-uncanny-valley-with-geminoid-hi-1-in-a-real-world-application},
  abstract  = {This paper presents a qualitative analysis of 24 interviews with visitors of the ARS Electronica festival in September 2009 in Linz, Austria, who interacted with the android robot Geminoid {HI-1}, while it was tele-operated by the first author. Only 37.5\% of the interviewed visitors reported an uncanny feeling with 29\% even enjoying the conversation. In five cases the interviewees' feelings even changed during the interaction with Geminoid {HI-1}. A number of possible improvements regarding Geminoid's bodily movements, facial expressivity, and ability to direct its gaze became apparent, which inform our future research with and development of android robots.},
  file      = {Becker-Asano2010.pdf:Becker-Asano2010.pdf:PDF},
}
Ilona Straub, Shuichi Nishio, Hiroshi Ishiguro, "Incorporated Identity in Interaction with a Teleoperated Android Robot: A Case Study", In International Conference on Culture and Computing, Kyoto, Japan, pp. 63-75, February, 2010.
Abstract: In near future artificial social agents embodied as virtual agents or as robots with humanoid appearance, will be placed in public settings and used as interaction tools. Considering the uncanny-valley-effect or images of robots as threat for humanity, a study about the acceptance and handling of such an interaction tool in the broad public is of great interest. The following study is based on qualitative methods of interaction analysis focusing on tendencies of peoples' ways to control or perceive a teleoperated android robot in an open public space. This field study shows the tendency of the users to ascribe an own identity to the teleoperated android robot Geminoid HI-1, which is independent from the identity of the controlling person. Both sides of the interaction unit were analyzed for 1) verbal cues about identity presentation on the side of the teleoperator, controlling the robot and for 2) verbal cues about identity perception of Geminoid HI-1 from the side of the interlocutor talking to the robot. The study unveils identity-creation, identity-switching, identity-mediation and identity-imitation of the teleoperators' own identity cues and the use of metaphorical language of the interlocutors showing forms to anthropomorphize and mentalize the android robot whilst interaction. Both sides of the interaction unit thus confer an `incorporated identity' towards the android robot Geminoid HI-1 and unveil tendencies to treat the android robot as social agent.
BibTeX:
@Inproceedings{Straub2010,
  author    = {Ilona Straub and Shuichi Nishio and Hiroshi Ishiguro},
  title     = {Incorporated Identity in Interaction with a Teleoperated Android Robot: A Case Study},
  booktitle = {International Conference on Culture and Computing},
  year      = {2010},
  pages     = {63--75},
  address   = {Kyoto, Japan},
  month     = Feb,
  abstract  = {In near future artificial social agents embodied as virtual agents or as robots with humanoid appearance, will be placed in public settings and used as interaction tools. Considering the uncanny-valley-effect or images of robots as threat for humanity, a study about the acceptance and handling of such an interaction tool in the broad public is of great interest. The following study is based on qualitative methods of interaction analysis focusing on tendencies of peoples' ways to control or perceive a teleoperated android robot in an open public space. This field study shows the tendency of the users to ascribe an own identity to the teleoperated android robot Geminoid HI-1, which is independent from the identity of the controlling person. Both sides of the interaction unit were analyzed for 1) verbal cues about identity presentation on the side of the teleoperator, controlling the robot and for 2) verbal cues about identity perception of Geminoid HI-1 from the side of the interlocutor talking to the robot. The study unveils identity-creation, identity-switching, identity-mediation and identity-imitation of the teleoperators' own identity cues and the use of metaphorical language of the interlocutors showing forms to anthropomorphize and mentalize the android robot whilst interaction. Both sides of the interaction unit thus confer an `incorporated identity' towards the android robot Geminoid HI-1 and unveil tendencies to treat the android robot as social agent.},
  file      = {Straub2010.pdf:Straub2010.pdf:PDF},
}
Shuichi Nishio, Hiroshi Ishiguro, Miranda Anderson, Norihiro Hagita, "Expressing individuality through teleoperated android: a case study with children", In IASTED International Conference on Human Computer Interaction, ACTA Press, Innsbruck, Autria, pp. 297-302, March, 2008.
Abstract: When utilizing robots as communication interface medium, the appearance of the robots, and the atmosphere or sense of presence they express will be one of the key issues in their design. Just like each person holds his/her own individual impressions they give when having a conversation with others, it might be effective for robots to hold a suitable sense of individuality, in order to effectively communicate with humans. In this paper, we report our investigation on the key elements for representing personal presence, which we define as the sense of being with a certain individual, and eventually implement them into robots. A case study is reported in which children performed daily conversational tasks with a geminoid, a teleoperated android robot that resembles a living individual. Different responses to the geminoid and the original person are examined, especially concentrating on the case where the target child was the daughter of the geminoid source. Results showed that children gradually became adapted to conversation with the geminoid, but the operator's personal presence was not completely represented. Further research topics on the adaptation process to androids and on seeking for the key elements on personal presence are discussed.
BibTeX:
@Inproceedings{Nishio2008,
  author    = {Shuichi Nishio and Hiroshi Ishiguro and Miranda Anderson and Norihiro Hagita},
  title     = {Expressing individuality through teleoperated android: a case study with children},
  booktitle = {{IASTED} International Conference on Human Computer Interaction},
  year      = {2008},
  pages     = {297--302},
  address   = {Innsbruck, Autria},
  month     = Mar,
  publisher = {{ACTA} Press},
  url       = {http://dl.acm.org/citation.cfm?id=1722359.1722414},
  abstract  = {When utilizing robots as communication interface medium, the appearance of the robots, and the atmosphere or sense of presence they express will be one of the key issues in their design. Just like each person holds his/her own individual impressions they give when having a conversation with others, it might be effective for robots to hold a suitable sense of individuality, in order to effectively communicate with humans. In this paper, we report our investigation on the key elements for representing personal presence, which we define as the sense of being with a certain individual, and eventually implement them into robots. A case study is reported in which children performed daily conversational tasks with a geminoid, a teleoperated android robot that resembles a living individual. Different responses to the geminoid and the original person are examined, especially concentrating on the case where the target child was the daughter of the geminoid source. Results showed that children gradually became adapted to conversation with the geminoid, but the operator's personal presence was not completely represented. Further research topics on the adaptation process to androids and on seeking for the key elements on personal presence are discussed.},
  file      = {Nishio2008.pdf:Nishio2008.pdf:PDF},
  keywords  = {android; human individuality; human-robot interaction; personal presence},
}
Shuichi Nishio, Hiroshi Ishiguro, Miranda Anderson, Norihiro Hagita, "Representing Personal Presence with a Teleoperated Android: A Case Study with Family", In AAAI Spring Symposium on Emotion, Personality, and Social Behavior, Stanford University, Palo Alto, California, USA, March, 2008.
Abstract: Our purpose is to investigate the key elements for representing personal presence, which we define as the sense of being with a certain individual, and eventually implement them into robots. In this research, a case study is reported in which children performed daily conversational tasks with a geminoid, a teleoperated android robot that resembles a living individual. Different responses to the geminoid and the original person are examined, especially concentrating on the case where the target child was the daughter of the geminoid source. Results showed that children gradually became adapted to conversation with the geminoid, but the operator's personal presence was not completely represented. Further research topics on the adaptation process to androids and on seeking for the key elements on personal presence are discussed.
BibTeX:
@Inproceedings{Nishio2008a,
  author          = {Shuichi Nishio and Hiroshi Ishiguro and Miranda Anderson and Norihiro Hagita},
  title           = {Representing Personal Presence with a Teleoperated Android: A Case Study with Family},
  booktitle       = {{AAAI} Spring Symposium on Emotion, Personality, and Social Behavior},
  year            = {2008},
  address         = {Stanford University, Palo Alto, California, {USA}},
  month           = Mar,
  abstract        = {Our purpose is to investigate the key elements for representing personal presence, which we define as the sense of being with a certain individual, and eventually implement them into robots. In this research, a case study is reported in which children performed daily conversational tasks with a geminoid, a teleoperated android robot that resembles a living individual. Different responses to the geminoid and the original person are examined, especially concentrating on the case where the target child was the daughter of the geminoid source. Results showed that children gradually became adapted to conversation with the geminoid, but the operator's personal presence was not completely represented. Further research topics on the adaptation process to androids and on seeking for the key elements on personal presence are discussed.},
  file            = {Nishio2008a.pdf:Nishio2008a.pdf:PDF},
}
山森崇義, 坂本大介, 西尾修一, 石黒浩, 萩田紀博, "アンドロイドと「目が合う」条件の検証", HAIシンポジウム, 慶應義塾大学, pp. 1B-2, December, 2007.
Abstract: ロボットに人と目を合わせる機能を実装することで,人との円滑なコミュニケーションが期待できる.ここで,ロボットが人に「目が合う」感覚を与えるためにはどのような条件が必要なのか?本稿では,見かけが人間に酷似したロボット,アンドロイドを用いて目が合う条件を検証する実験を行った.本実験の結果から,目が合う条件はアンドロイドの視線偏位角に依存すること,眼球に微小な動作を加えることで目が合う視線偏位角の範囲が広がることが明らかとなった.
BibTeX:
@Inproceedings{山森崇義2007a,
  author    = {山森崇義 and 坂本大介 and 西尾修一 and 石黒浩 and 萩田紀博},
  title     = {アンドロイドと「目が合う」条件の検証},
  booktitle = {{HAI}シンポジウム},
  year      = {2007},
  pages     = {1B-2},
  address   = {慶應義塾大学},
  month     = Dec,
  url       = {http://www.ii.is.kit.ac.jp/hai2011/proceedings/HAI2007/html/paper/paper-1b-2.html},
  abstract  = {ロボットに人と目を合わせる機能を実装することで,人との円滑なコミュニケーションが期待できる.ここで,ロボットが人に「目が合う」感覚を与えるためにはどのような条件が必要なのか?本稿では,見かけが人間に酷似したロボット,アンドロイドを用いて目が合う条件を検証する実験を行った.本実験の結果から,目が合う条件はアンドロイドの視線偏位角に依存すること,眼球に微小な動作を加えることで目が合う視線偏位角の範囲が広がることが明らかとなった.},
  file      = {1b-2.pdf:http\://www.ii.is.kit.ac.jp/hai2011/proceedings/HAI2007/pdf/1b-2.pdf:PDF},
}
会議発表(査読なし)
Shuichi Nishio, "Portable android robots for aged citizens: overview and current results", In Dementia & Technology, Seoul, Korea, December, 2018.
Abstract: I introduce our research acvtivities on Telenoid and Bonoid.
BibTeX:
@Inproceedings{Nishio2018a,
  author    = {Shuichi Nishio},
  title     = {Portable android robots for aged citizens: overview and current results},
  booktitle = {Dementia \& Technology},
  year      = {2018},
  address   = {Seoul, Korea},
  month     = Dec,
  day       = {17},
  url       = {http://www.docdocdoc.co.kr/event/event20.html},
  abstract  = {I introduce our research acvtivities on Telenoid and Bonoid.},
}
桑村海光, 西尾修一, "非言語情報と相互状態推定に基づく自動対話生成モデル", 第78回 人工知能学会 言語・音声理解と対話処理研究会(第7回対話システムシンポジウム)(SIG-SLUD-B505), 早稲田大学, 東京, pp. 13-18, October, 2016.
Abstract: Recently there are researches on development of an automatic dialogue system. However, most of such systems are based on textual corpora. Face-to-face communication involves transfer of nonverbal information. This information enables us to perceive a more detailed mental and emotional state of the conversation partner, such as whether they are enjoying the dialogue or not. The interlocutor's and our internal state are used to form a dialogue strategy. For example, if the interlocutor somehow express doubt about what they are saying and we are willing to express our point of view over theirs, we can interrupt them and start to talk. This is not possible in a text-based instant messaging environment. We express our internal state, such as joy and excitement and estimate the interlocutor's mental and emotional state by nonverbal information and use it in forming the dialogue strategy. In this paper, we present an automatic dialogue system which focuses on this nonverbal information and the estimation of conversation partner's state of mind and emotions.
BibTeX:
@Inproceedings{桑村海光2016a,
  author    = {桑村海光 and 西尾修一},
  title     = {非言語情報と相互状態推定に基づく自動対話生成モデル},
  booktitle = {第78回 人工知能学会 言語・音声理解と対話処理研究会(第7回対話システムシンポジウム)(SIG-SLUD-B505)},
  year      = {2016},
  pages     = {13-18},
  address   = {早稲田大学, 東京},
  month     = Oct,
  url       = {http://www.lai.kyutech.ac.jp/sig-slud/},
  etitle    = {Automatic Dialogue Based on Nonverbal Information and Estimation of Mutual Emotional and Mental States},
  abstract  = {Recently there are researches on development of an automatic dialogue system. However, most of such systems are based on textual corpora. Face-to-face communication involves transfer of nonverbal information. This information enables us to perceive a more detailed mental and emotional state of the conversation partner, such as whether they are enjoying the dialogue or not. The interlocutor's and our internal state are used to form a dialogue strategy. For example, if the interlocutor somehow express doubt about what they are saying and we are willing to express our point of view over theirs, we can interrupt them and start to talk. This is not possible in a text-based instant messaging environment. We express our internal state, such as joy and excitement and estimate the interlocutor's mental and emotional state by nonverbal information and use it in forming the dialogue strategy. In this paper, we present an automatic dialogue system which focuses on this nonverbal information and the estimation of conversation partner's state of mind and emotions.},
  file      = {桑村海光2016a.pdf:pdf/桑村海光2016a.pdf:PDF},
}
大久保正隆, 西尾修一, 石黒浩, "腹部運動で操作可能な仮想肢への身体感覚の拡張", 2016年度人工知能学会全国大会(第30回)(JSAI2016), 北九州市(福岡), pp. 1G3-1, June, 2016.
Abstract: 両手に物を持っていて鍵をとりたいときなど、腕がもう一本あると役に立つ。私たちは人間の身体を拡張し、追加肢を追加できるかという問題に取り組み、本研究では腹部運動によって操作される仮想肢を追加し、自分の一部と感じるかを調べた。その結果、操作性が高い場合には自分の身体の一部と感じやすく、また自分にボールがぶつかったとより強く感じることが分かった。
BibTeX:
@Inproceedings{大久保正隆2016,
  author    = {大久保正隆 and 西尾修一 and 石黒浩},
  title     = {腹部運動で操作可能な仮想肢への身体感覚の拡張},
  booktitle = {2016年度人工知能学会全国大会(第30回)(JSAI2016)},
  year      = {2016},
  pages     = {1G3-1},
  address   = {北九州市(福岡)},
  month     = Jun,
  url       = {http://www.ai-gakkai.or.jp/jsai2016/},
  abstract  = {両手に物を持っていて鍵をとりたいときなど、腕がもう一本あると役に立つ。私たちは人間の身体を拡張し、追加肢を追加できるかという問題に取り組み、本研究では腹部運動によって操作される仮想肢を追加し、自分の一部と感じるかを調べた。その結果、操作性が高い場合には自分の身体の一部と感じやすく、また自分にボールがぶつかったとより強く感じることが分かった。},
  file      = {大久保正隆2016.pdf:pdf/大久保正隆2016.pdf:PDF},
}
桑村海光, 西尾修一, 佐藤眞一, "認知症高齢者を対象としたロボットによる対話支援", 2016年度人工知能学会全国大会(第30回)(JSAI2016), 北九州国際会議場, 福岡, pp. 2H3-NFC-03a-5, June, 2016.
Abstract: In this study, we compare robot-mediated and face-to-face communication with three residents with Alzheimer's disease (AD). The result shows that, two of the three residents with moderate AD showed a positive impression to a teleoperated robot called Telenoid, and the other resident with severe dementia used gestures and physical contacts to interact with the robot. From the result, we discuss the possibilities of using a robot as a tool for seniors to encourage communication.
BibTeX:
@Inproceedings{桑村海光2016,
  author    = {桑村海光 and 西尾修一 and 佐藤眞一},
  title     = {認知症高齢者を対象としたロボットによる対話支援},
  booktitle = {2016年度人工知能学会全国大会(第30回)(JSAI2016)},
  year      = {2016},
  pages     = {2H3-NFC-03a-5},
  address   = {北九州国際会議場, 福岡},
  month     = Jun,
  url       = {http://www.ai-gakkai.or.jp/jsai2016/},
  etitle    = {Communication Support Using Robot for Senior with Alzheimer's Disease},
  abstract  = {In this study, we compare robot-mediated and face-to-face communication with three residents with Alzheimer's disease (AD). The result shows that, two of the three residents with moderate AD showed a positive impression to a teleoperated robot called Telenoid, and the other resident with severe dementia used gestures and physical contacts to interact with the robot. From the result, we discuss the possibilities of using a robot as a tool for seniors to encourage communication.},
  file      = {桑村海光2016.pdf:pdf/桑村海光2016.pdf:PDF},
}
車谷広大, Christian Penaloza, 西尾修一, "アンドロイドBMI操作時のエラー関連陰性電位の検出", 2016年度人工知能学会全国大会(第30回)(JSAI2016), 北九州市(福岡), pp. 1I5-3, June, 2016.
Abstract: エラー関連陰性電位(ERN) は人が何かの失敗を検出した際に脳に生じる事象関連電位である。ロボットの発話や行動の誤りなどをERNにより検出できれば、修正や学習に利用できる。本研究ではアンドロイドの脳波による操作時のERN利用を目的として、機械学習によるオンライン検出を試みたのでその結果を報告する。
BibTeX:
@Inproceedings{車谷広大2016,
  author    = {車谷広大 and Christian Penaloza and 西尾修一},
  title     = {アンドロイドBMI操作時のエラー関連陰性電位の検出},
  booktitle = {2016年度人工知能学会全国大会(第30回)(JSAI2016)},
  year      = {2016},
  pages     = {1I5-3},
  address   = {北九州市(福岡)},
  month     = Jun,
  url       = {http://www.ai-gakkai.or.jp/jsai2016/},
  abstract  = {エラー関連陰性電位(ERN) は人が何かの失敗を検出した際に脳に生じる事象関連電位である。ロボットの発話や行動の誤りなどをERNにより検出できれば、修正や学習に利用できる。本研究ではアンドロイドの脳波による操作時のERN利用を目的として、機械学習によるオンライン検出を試みたのでその結果を報告する。},
  file      = {車谷広大2016.pdf:pdf/車谷広大2016.pdf:PDF},
}
大久保正隆, 西尾修一, 石黒浩, "遠隔操作ロボットへの身体感覚転移における実体の有無と見かけの影響", 第32回日本ロボット学会学術講演会, 九州産業大学(福岡), pp. RSJ2014AC1B2-02, September, 2014.
Abstract: 人と似た外観を有する遠隔操作型アンドロイド・ロボットを操作していると、 アンドロイドを自分の身体の一部のように感じることがある。アンドロイドの 動きと操作者の動きの同期性が高いとき、身体感覚の転移が生じる。本研究で は、この操作対象への身体感覚転移がアンドロイド以外のロボットや、実体をもたない操作対象へも生じるかを調べた。
BibTeX:
@Inproceedings{大久保正隆2014,
  author    = {大久保正隆 and 西尾修一 and 石黒浩},
  title     = {遠隔操作ロボットへの身体感覚転移における実体の有無と見かけの影響},
  booktitle = {第32回日本ロボット学会学術講演会},
  year      = {2014},
  pages     = {RSJ2014AC1B2-02},
  address   = {九州産業大学(福岡)},
  month     = Sep,
  abstract  = {人と似た外観を有する遠隔操作型アンドロイド・ロボットを操作していると、 アンドロイドを自分の身体の一部のように感じることがある。アンドロイドの 動きと操作者の動きの同期性が高いとき、身体感覚の転移が生じる。本研究で は、この操作対象への身体感覚転移がアンドロイド以外のロボットや、実体をもたない操作対象へも生じるかを調べた。},
  file      = {大久保正隆2014a.pdf:pdf/大久保正隆2014a.pdf:PDF},
  funding   = {萌芽},
  journal   = {第32回 日本ロボット学会学術講演会(RSJ2014)},
}
桑村海光, 山崎竜二, 西尾修一, 石黒浩, "テレノイドによる高齢者支援 ~ 特別養護老人ホームへの導入の経過報告 ~", 電子情報通信学会技術研究報告, 福祉情報工学研究会, no. WIT2013-47, 霧島観光ホテル, 鹿児島, pp. 23-28, October, 2013.
Abstract: 近年、介護を支援するロボットや機器の導入が注目されており、新しい技術を導入することで、高齢者の自立性を高め、介護福祉士の負担を軽減することが来たいされている。しかし、新しい機器を導入するためには、施設を運営するスタッフや現場で働く介護福祉士の理解が必要で、特に実際に用いる介護福祉士には使い方、気を付ける点を熟知する必要がある。また、入居している高齢者にも新しい機器に対して不安を感じないように慣れる必要がある。本論文では、遠隔操作型アンドロイド「テレノイド」を施設に導入した事例を通して、新しい機器の導入時の注意事項、そしてその際の改善案について述べる。
BibTeX:
@Inproceedings{桑村海光2013a,
  author    = {桑村海光 and 山崎竜二 and 西尾修一 and 石黒浩},
  title     = {テレノイドによる高齢者支援 ~ 特別養護老人ホームへの導入の経過報告 ~},
  booktitle = {電子情報通信学会技術研究報告},
  year      = {2013},
  number    = {WIT2013-47},
  pages     = {23-28},
  address   = {霧島観光ホテル, 鹿児島},
  month     = Oct,
  publisher = {福祉情報工学研究会},
  day       = {25-27},
  url       = {http://www.ieice.org/ken/paper/20131026wBGW/},
  etitle    = {Elderly Support using Telenoid : A case report introducing to the care facility},
  abstract  = {近年、介護を支援するロボットや機器の導入が注目されており、新しい技術を導入することで、高齢者の自立性を高め、介護福祉士の負担を軽減することが来たいされている。しかし、新しい機器を導入するためには、施設を運営するスタッフや現場で働く介護福祉士の理解が必要で、特に実際に用いる介護福祉士には使い方、気を付ける点を熟知する必要がある。また、入居している高齢者にも新しい機器に対して不安を感じないように慣れる必要がある。本論文では、遠隔操作型アンドロイド「テレノイド」を施設に導入した事例を通して、新しい機器の導入時の注意事項、そしてその際の改善案について述べる。},
  eabstract = {With the progress of the aging society, numbers of robots and other new devices for elderly care are intensively studied and developed. However, when introducing such new devices, we need to be careful, especially in the elderly facilities. Care staffs have to obtain deep understanding of their usages and effects. Besides, efforts have to be paid so that elderlies can gradually become familiar with the devices. In this paper, we describe the case study of introducing teleoperated android "Telenoid" to the elderly facilities and discuss issues that need attention on introducing new technology to the elderly facilities.},
  file      = {桑村海光2013a.pdf:pdf/桑村海光2013a.pdf:PDF},
  keywords  = {介護ロボット, 山崎竜二, 西尾修一, 石黒浩},
}
中道大介, 住岡英信, 西尾修一, 石黒浩, "操作訓練による遠隔操作型アンドロイドへの身体感覚転移の度合いの向上", 第18回日本バーチャルリアリティ学会大会, グランフロント大阪, 大阪, pp. 331-334, September, 2013.
Abstract: 遠隔操作型アンドロイド「テレノイド」は操作者の身体動作と同期し,操作者の存在感を遠隔地に伝達できるロボットである.操作者がその操作に慣れ,テレノイドを自らの分身と感じて操作できるようになれば,遠隔コミュニケーションはより豊かになると考えられる.そこで本稿では,操作訓練とその効果を,身体感覚転移の度合いを指標として検証した.身体感覚転移とは,操作時にロボットが自らの身体であると錯覚する現象である.この検証の結果,テレノイドの後頭部を見て首の動作の同期を確認する訓練によって身体感覚転移の度合いが向上することが分かった.
BibTeX:
@Inproceedings{中道大介2013a,
  author          = {中道大介 and 住岡英信 and 西尾修一 and 石黒浩},
  title           = {操作訓練による遠隔操作型アンドロイドへの身体感覚転移の度合いの向上},
  booktitle       = {第18回日本バーチャルリアリティ学会大会},
  year            = {2013},
  pages           = {331-334},
  address         = {グランフロント大阪, 大阪},
  month           = Sep,
  day             = {18-20},
  url             = {http://conference.vrsj.org/ac2013/program/144/},
  etitle          = {Enhancement of body ownership transfer to teleoperated android through training},
  abstract        = {遠隔操作型アンドロイド「テレノイド」は操作者の身体動作と同期し,操作者の存在感を遠隔地に伝達できるロボットである.操作者がその操作に慣れ,テレノイドを自らの分身と感じて操作できるようになれば,遠隔コミュニケーションはより豊かになると考えられる.そこで本稿では,操作訓練とその効果を,身体感覚転移の度合いを指標として検証した.身体感覚転移とは,操作時にロボットが自らの身体であると錯覚する現象である.この検証の結果,テレノイドの後頭部を見て首の動作の同期を確認する訓練によって身体感覚転移の度合いが向上することが分かった.},
  file            = {中道大介2013a.pdf:pdf/中道大介2013a.pdf:PDF},
  keywords        = {遠隔操作; 訓練; 身体認知; 遠隔存在感},
}
中道大介, 西尾修一, 石黒浩, "遠隔操作型アンドロイド「テレノイド」の遠隔操作とその訓練", 情報処理学会関西支部大会, 大阪大学中之島センター, 大阪, pp. G-01, September, 2013.
Abstract: 遠隔操作型アンドロイドの操作には慣れる時間を要する操作者も多く,効果的な訓練方法の確立が必要である. 本研究では,馴化訓練による操作感覚への影響を,アンドロイドへの身体感覚の転移を指標として検証した.
BibTeX:
@Inproceedings{中道大介2013,
  author          = {中道大介 and 西尾修一 and 石黒浩},
  title           = {遠隔操作型アンドロイド「テレノイド」の遠隔操作とその訓練},
  booktitle       = {情報処理学会関西支部大会},
  year            = {2013},
  pages           = {G-01},
  address         = {大阪大学中之島センター, 大阪},
  month           = Sep,
  day             = {25},
  url             = {https://ipsj.ixsq.nii.ac.jp/ej/?action=pages_view_main&active_action=repository_view_main_item_detail&item_id=96872&item_no=1&page_id=13&block_id=8},
  etitle          = {Teleoperation of Telenoid and it's training},
  abstract        = {遠隔操作型アンドロイドの操作には慣れる時間を要する操作者も多く,効果的な訓練方法の確立が必要である. 本研究では,馴化訓練による操作感覚への影響を,アンドロイドへの身体感覚の転移を指標として検証した.},
  file            = {中道大介2013.pdf:pdf/中道大介2013.pdf:PDF},
}
住岡英信, 幸田健介, 西尾修一, 港隆史, 石黒浩, "土偶の変遷に基づくコミュニケーションメディアのミニマルデザインの検討", 情報処理学会関西支部大会, 大阪大学中之島センター, 大阪, pp. C-08, September, 2013.
Abstract: コミュニケーションアバターの外観は遠隔地の話者を感じるために大きな役割を果たす.本研究では,アバターを対話者と感じるための最小要素を人型表現への取り組みである土偶の発展から考察し,心理評価実験により検討する.
BibTeX:
@Inproceedings{住岡英信2013,
  author          = {住岡英信 and 幸田健介 and 西尾修一 and 港隆史 and 石黒浩},
  title           = {土偶の変遷に基づくコミュニケーションメディアのミニマルデザインの検討},
  booktitle       = {情報処理学会関西支部大会},
  year            = {2013},
  pages           = {C-08},
  address         = {大阪大学中之島センター, 大阪},
  month           = Sep,
  day             = {25},
  url             = {https://ipsj.ixsq.nii.ac.jp/ej/?action=pages_view_main&active_action=repository_view_main_item_detail&item_id=96828&item_no=1&page_id=13&block_id=8},
  etitle          = {Design considerations from chronologial development of Dogu},
  abstract        = {コミュニケーションアバターの外観は遠隔地の話者を感じるために大きな役割を果たす.本研究では,アバターを対話者と感じるための最小要素を人型表現への取り組みである土偶の発展から考察し,心理評価実験により検討する.},
  file            = {住岡英信2013.pdf:pdf/住岡英信2013.pdf:PDF},
}
Ryuji Yamazaki, Shuichi Nishio, Kaiko Kuwamura, "Identity Construction of the Hybrid of Robot and Human", In 22nd IEEE International Symposium on Robot and Human Interactive Communication, Workshop on Enhancement/Training of Social Robotics Teleoperation and its Applications, Gyeongju, Korea, August, 2013.
BibTeX:
@Inproceedings{Yamazaki2013,
  author    = {Ryuji Yamazaki and Shuichi Nishio and Kaiko Kuwamura},
  title     = {Identity Construction of the Hybrid of Robot and Human},
  booktitle = {22nd IEEE International Symposium on Robot and Human Interactive Communication, Workshop on Enhancement/Training of Social Robotics Teleoperation and its Applications},
  year      = {2013},
  address   = {Gyeongju, Korea},
  month     = Aug,
  day       = {26-29},
}
Astrid M. von der Pütten, Christian Becker-Asano, Kohei Ogawa, Shuichi Nishio, Hiroshi Ishiguro, "Exploration and Analysis of People's Nonverbal Behavior Towards an Android", In the annual meeting of the International Communication Association, Phoenix, USA, May, 2012.
BibTeX:
@Inproceedings{Putten2012,
  author    = {Astrid M. von der P\"{u}tten and Christian Becker-Asano and Kohei Ogawa and Shuichi Nishio and Hiroshi Ishiguro},
  title     = {Exploration and Analysis of People's Nonverbal Behavior Towards an Android},
  booktitle = {the annual meeting of the International Communication Association},
  year      = {2012},
  address   = {Phoenix, USA},
  month     = May,
}
山本知幸, 平田雅之, 池田尊司, 西尾修一, 松下光次郎, Maryam Alimardani, 石黒浩, "認知脳ロボティクスにおけるBMI・情動研究", 日本ロボット学会学術講演会, 東京, pp. AC1A2-2, September, 2011.
Abstract: 本稿では、BMI(Brain Machine Interface)を用いた上記3領域の融合研究に関して紹介する。
BibTeX:
@Inproceedings{山本知幸2011,
  author    = {山本知幸 and 平田雅之 and 池田尊司 and 西尾修一 and 松下光次郎 and Maryam Alimardani and 石黒浩},
  title     = {認知脳ロボティクスにおける{BMI}・情動研究},
  booktitle = {日本ロボット学会学術講演会},
  year      = {2011},
  pages     = {{AC1A}2-2},
  address   = {東京},
  month     = Sep,
  abstract  = {本稿では、{BMI}(Brain Machine Interface)を用いた上記3領域の融合研究に関して紹介する。},
  file      = {山本知幸2011.pdf:山本知幸2011.pdf:PDF},
}
港隆史, 西尾修一, 小川浩平, 石黒浩, "携帯型遠隔操作アンドロイド「エルフォイド」の研究開発", 日本ロボット学会学術講演会, 東京, pp. RSJ2011AC3O2-4, September, 2011.
Abstract: 本研究では遠隔操作型アンドロイドを携帯電話サイズに小型化することにより,何時でも何処でも誰でも自身の存在を遠隔地に伝達することができる新たなコミュニケーションメディアの実現を目指し,最初のプロトタイプとして「エルフォイドP1」を開発した.エルフォイドは人間の見かけのミニマルデザインを採用することで,誰もがエルフォイドを通して存在感を伝えることができるようにデザインされている.通信手段として携帯電話機能を有しており,携帯電話と同様,時間と場所を選ばずコミュニケーションが可能である.また外装には,人間の皮膚のような柔らかい素材を用いており,その触感からも人間を連想させるようになっている.本報告では開発したエルフォイドのプロトタイプを紹介するとともに,携帯型遠隔操作アンドロイド実現に向けた研究課題について述べる.
BibTeX:
@Inproceedings{港隆史2011,
  author    = {港隆史 and 西尾修一 and 小川浩平 and 石黒浩},
  title     = {携帯型遠隔操作アンドロイド「エルフォイド」の研究開発},
  booktitle = {日本ロボット学会学術講演会},
  year      = {2011},
  pages     = {{RSJ2011AC}3O2-4},
  address   = {東京},
  month     = Sep,
  day       = {7-9},
  abstract  = {本研究では遠隔操作型アンドロイドを携帯電話サイズに小型化することにより,何時でも何処でも誰でも自身の存在を遠隔地に伝達することができる新たなコミュニケーションメディアの実現を目指し,最初のプロトタイプとして「エルフォイド{P}1」を開発した.エルフォイドは人間の見かけのミニマルデザインを採用することで,誰もがエルフォイドを通して存在感を伝えることができるようにデザインされている.通信手段として携帯電話機能を有しており,携帯電話と同様,時間と場所を選ばずコミュニケーションが可能である.また外装には,人間の皮膚のような柔らかい素材を用いており,その触感からも人間を連想させるようになっている.本報告では開発したエルフォイドのプロトタイプを紹介するとともに,携帯型遠隔操作アンドロイド実現に向けた研究課題について述べる.},
  file      = {港隆史2011.pdf:港隆史2011.pdf:PDF},
}
山崎竜二, 西尾修一, 小川浩平, 石黒浩, 幸田健介, 松村耕平, 藤波努, 寺井紀裕, "遠隔操作ロボットの福祉教育への適用", 人工知能学会全国大会, 岩手県(盛岡市), pp. 1A2-NFC1b-10, June, 2011.
Abstract: The old sense of community among Japanese has been weakening and the social isolation of elderly people is becoming a major issue in the acceleration of demographic aging. For facilitating the intergenerational communica- tion as a welfare education, we started our research project to immerse a teleoperated humanoid robot, Telenoid, in an elementary school and to see the reaction of children. Also, we conducted a telenoid testing for the elderly with dementia to see their reaction. We discuss how the robot can be accepted in the intergenerational communication for creating a children-centric community for dementia care that is based on our embodiment as human beings.
BibTeX:
@Inproceedings{山崎竜二2011,
  author          = {山崎竜二 and 西尾修一 and 小川浩平 and 石黒浩 and 幸田健介 and 松村耕平 and 藤波努 and 寺井紀裕},
  title           = {遠隔操作ロボットの福祉教育への適用},
  booktitle       = {人工知能学会全国大会},
  year            = {2011},
  pages           = {1A2-NFC1b-10},
  address         = {岩手県(盛岡市)},
  month           = Jun,
  day             = {1-3},
  url             = {https://kaigi.org/jsai/webprogram/2011/pdf/412.pdf},
  etitle          = {The Application of a Teleoperated Robot to the Welfare Education in an Elementary School},
  abstract        = {The old sense of community among Japanese has been weakening and the social isolation of elderly people is becoming a major issue in the acceleration of demographic aging. For facilitating the intergenerational communica- tion as a welfare education, we started our research project to immerse a teleoperated humanoid robot, Telenoid, in an elementary school and to see the reaction of children. Also, we conducted a telenoid testing for the elderly with dementia to see their reaction. We discuss how the robot can be accepted in the intergenerational communication for creating a children-centric community for dementia care that is based on our embodiment as human beings.},
  eabstract       = {The old sense of community among Japanese has been weakening and the social isolation of elderly people is becoming a major issue in the acceleration of demographic aging. For facilitating the intergenerational communica- tion as a welfare education, we started our research project to immerse a teleoperated humanoid robot, Telenoid, in an elementary school and to see the reaction of children. Also, we conducted a telenoid testing for the elderly with dementia to see their reaction. We discuss how the robot can be accepted in the intergenerational communication for creating a children-centric community for dementia care that is based on our embodiment as human beings.},
  file            = {山崎竜二2011a.pdf:山崎竜二2011a.pdf:PDF},
  organization    = {人工知能学会},
}
岡本恵里奈, 西尾修一, 石黒浩, "遠隔操作型アンドロイドによる存在感の伝達に必須な要素の検証", ヒューマンインタフェース学会研究会, vol. 12, no. 10, Nara, Japan, pp. 13-20, November, 2010.
Abstract: 対面して会話をする際,人は外見や声,動き,話の内容など,さまざまな要素を伝達しているが,これまで,それらの要素を個別に操作する(人の外見のみを変える,動作のみを別の人のものにする,といった実験をする)ことはできなかった。しかし,ジェミノイド(人間をモデルに開発されたロボット)という,いわば心身の分離を実現できる新しい遠隔コミュニケーションツールを用いることで,この検証がある程度可能になった。そこで,本稿では,ジェミノイドを拡張し,外見と声を操作者本人とは異なる人のそれに置き換え,本人らしさがどの程度伝達しうるのか,外見や声が対人認知にどのような影響を及ぼしているのかを,4人の被験者のジェミノイドを介したコミュニケーション実験によって検証した。その結果,対話相手の個性が認識できたのは37.0%で,「友人同士の場合の方が正解率が高い」という仮説に反して,友人が含まれる場合はさらに低くなること明らかになった。
BibTeX:
@Inproceedings{岡本恵里奈2010,
  author          = {岡本恵里奈 and 西尾修一 and 石黒浩},
  title           = {遠隔操作型アンドロイドによる存在感の伝達に必須な要素の検証},
  booktitle       = {ヒューマンインタフェース学会研究会},
  year            = {2010},
  volume          = {12},
  number          = {10},
  pages           = {13--20},
  address         = {Nara, Japan},
  month           = Nov,
  abstract        = {対面して会話をする際,人は外見や声,動き,話の内容など,さまざまな要素を伝達しているが,これまで,それらの要素を個別に操作する(人の外見のみを変える,動作のみを別の人のものにする,といった実験をする)ことはできなかった。しかし,ジェミノイド(人間をモデルに開発されたロボット)という,いわば心身の分離を実現できる新しい遠隔コミュニケーションツールを用いることで,この検証がある程度可能になった。そこで,本稿では,ジェミノイドを拡張し,外見と声を操作者本人とは異なる人のそれに置き換え,本人らしさがどの程度伝達しうるのか,外見や声が対人認知にどのような影響を及ぼしているのかを,4人の被験者のジェミノイドを介したコミュニケーション実験によって検証した。その結果,対話相手の個性が認識できたのは37.0%で,「友人同士の場合の方が正解率が高い」という仮説に反して,友人が含まれる場合はさらに低くなること明らかになった。},
  file            = {岡本恵里奈2010.pdf:岡本恵里奈2010.pdf:PDF},
}
山森崇義, 小川浩平, 西尾修一, 石黒浩, "ロボットの見かけや動きが目が合う条件に及ぼす影響", 電子情報通信学会技術研究報告, ヒューマンコミュニケーション基礎研究会, vol. HCS2008-60, 島根, pp. 13-8, March, 2009.
Abstract: 近年,見かけが人間に酷似したロボット,アンドロイドの研究がおこなわれている.一方で,視線,とりわけ相手と目を合わせるという動作(アイコンタクト)は,我々の社会生活にとって重要な役割を果たしている.近年の研究から,ロボットや対話メディアとのとのコミュニケーションにおいても視線の重要性が報告されており,目を合わせる機能の必要性が増えつつある.しかし,視線知覚そのものに関する実験的な研究はそれほど多くはないため,人と目が合うための条件や,条件に影響を与える要因が明らかではない.そこで,人と目を合わせる機能が最も必要とされるアンドロイドや他の対話メディアを用いて,人と目が合うための条件を検証する実験をおこなった.実験により,人と目が合うための条件に影響を与える要因を特定する.人と目が合うための条件に影響を与える要因として,目の形状や対象の見た目,視線の動き方が影響することが明らかになった.
BibTeX:
@Inproceedings{山森崇義2009,
  author          = {山森崇義 and 小川浩平 and 西尾修一 and 石黒浩},
  title           = {ロボットの見かけや動きが目が合う条件に及ぼす影響},
  booktitle       = {電子情報通信学会技術研究報告},
  year            = {2009},
  volume          = {HCS2008-60},
  pages           = {13--8},
  address         = {島根},
  month           = Mar,
  publisher       = {ヒューマンコミュニケーション基礎研究会},
  url             = {http://ci.nii.ac.jp/naid/110007325133},
  etitle          = {Effects to the condition for eye contact by differences of appearance and movement},
  abstract        = {近年,見かけが人間に酷似したロボット,アンドロイドの研究がおこなわれている.一方で,視線,とりわけ相手と目を合わせるという動作(アイコンタクト)は,我々の社会生活にとって重要な役割を果たしている.近年の研究から,ロボットや対話メディアとのとのコミュニケーションにおいても視線の重要性が報告されており,目を合わせる機能の必要性が増えつつある.しかし,視線知覚そのものに関する実験的な研究はそれほど多くはないため,人と目が合うための条件や,条件に影響を与える要因が明らかではない.そこで,人と目を合わせる機能が最も必要とされるアンドロイドや他の対話メディアを用いて,人と目が合うための条件を検証する実験をおこなった.実験により,人と目が合うための条件に影響を与える要因を特定する.人と目が合うための条件に影響を与える要因として,目の形状や対象の見た目,視線の動き方が影響することが明らかになった.},
  file            = {山森崇義2009.pdf:山森崇義2009.pdf:PDF},
  issn            = {09135685},
  journal         = {電子情報通信学会技術研究報告},
}
渡辺哲矢, 小川浩平, 西尾修一, 石黒浩, "遠隔操作型アンドロイドとの同調感により誘起される身体感覚の延長", 電子情報通信学会技術研究報告, ヒューマンコミュニケーション基礎研究会, vol. HCS2008-61, 島根, pp. 19-24, March, 2009.
Abstract: 遠隔操作型アンドロイドを操作する際,視覚フィードバックしかないのにも関わらず,ロボットの体に触られると自分の体に触られたように感じることがある.類似の現象として,視覚刺激に同期して触覚刺激を与えると身体感覚の延長が生ずる「Rubber Hand Illusion」が知られているが,視覚刺激のみでの研究事例は少ない.そこで我々はアンドロイドの遠隔操作時の同調性を制御した被験者実験を行い,実際に錯覚が生じているのか,またはどのような条件がそろえば,そのような錯覚が生じるか検証した.その結果同調感を高めると,視覚刺激のみでも身体感覚の延長が引き起こされることがわかった.
BibTeX:
@Inproceedings{渡辺哲矢2009,
  author    = {渡辺哲矢 and 小川浩平 and 西尾修一 and 石黒浩},
  title     = {遠隔操作型アンドロイドとの同調感により誘起される身体感覚の延長},
  booktitle = {電子情報通信学会技術研究報告},
  year      = {2009},
  volume    = {HCS2008-61},
  pages     = {19--24},
  address   = {島根},
  month     = Mar,
  publisher = {ヒューマンコミュニケーション基礎研究会},
  url       = {http://ci.nii.ac.jp/naid/110007325132},
  etitle    = {Body image extension induced by synchronization with teleoperated android robot},
  abstract  = {遠隔操作型アンドロイドを操作する際,視覚フィードバックしかないのにも関わらず,ロボットの体に触られると自分の体に触られたように感じることがある.類似の現象として,視覚刺激に同期して触覚刺激を与えると身体感覚の延長が生ずる「Rubber Hand Illusion」が知られているが,視覚刺激のみでの研究事例は少ない.そこで我々はアンドロイドの遠隔操作時の同調性を制御した被験者実験を行い,実際に錯覚が生じているのか,またはどのような条件がそろえば,そのような錯覚が生じるか検証した.その結果同調感を高めると,視覚刺激のみでも身体感覚の延長が引き起こされることがわかった.},
  eabstract = {It is known that teleoperators of android robots occasionally experience bodily image extension. Even though only visual feedback is provided, when others touch at the robotic body, the operator feels as if s/he had been touched. A similar phenomenon named "Rubber Hand Illusion" is known which is said to reflect a three-way interaction among vision, touch and proprioception. In this research, we examined whether similar interaction occurs when replacing tactile sensation with synchronization of operating an android robot. The result showed that as the degree of synchronization raise, the participants began feeling the robotic body as part of their own body.},
  file      = {渡辺哲矢2009.pdf:渡辺哲矢2009.pdf:PDF},
  journal   = {電子情報通信学会技術研究報告},
}
山森崇義, 小川浩平, 西尾修一, 石黒浩, "対象の持つ身体性の違いが被注視感に及ぼす影響", 情報処理学会関西支部大会, 京都, pp. 255-258, October, 2008.
Abstract: 対象の自然さと視線知覚の関係を検証した実験について報告した。具体的には,先行研究で得られた知見から「対象の自然さと被注視感には相関関係がある」と「対象の自然さと視線の判断のしやすさには相関関係がある」という2つの仮説を設定し,観察対象,視線角度,視線動作を要因としてその検証を行ったこと,実験の結果,横軸を視線角度,縦軸を目が合う割合および見られる割合とした場合,グラフが山型になることが分かり,このことから,自然さが上がると目が合う割合と見られる割合が上がると言え,仮説の1つが支持されたこと,一方で,自然さと判断のしやすさに関しては,傾向としては見られるものの有意な相関関係は伺えなかったこと-等を述べた。
BibTeX:
@Inproceedings{山森崇義2008,
  author          = {山森崇義 and 小川浩平 and 西尾修一 and 石黒浩},
  title           = {対象の持つ身体性の違いが被注視感に及ぼす影響},
  booktitle       = {情報処理学会関西支部大会},
  year            = {2008},
  pages           = {255--258},
  address         = {京都},
  month           = Oct,
  etitle          = {Effects to feeling of being looked by differences of objects' embodiment},
  abstract        = {対象の自然さと視線知覚の関係を検証した実験について報告した。具体的には,先行研究で得られた知見から「対象の自然さと被注視感には相関関係がある」と「対象の自然さと視線の判断のしやすさには相関関係がある」という2つの仮説を設定し,観察対象,視線角度,視線動作を要因としてその検証を行ったこと,実験の結果,横軸を視線角度,縦軸を目が合う割合および見られる割合とした場合,グラフが山型になることが分かり,このことから,自然さが上がると目が合う割合と見られる割合が上がると言え,仮説の1つが支持されたこと,一方で,自然さと判断のしやすさに関しては,傾向としては見られるものの有意な相関関係は伺えなかったこと-等を述べた。},
  file            = {山森崇義2008.pdf:山森崇義2008.pdf:PDF},
}
山森崇義, 坂本大介, 西尾修一, 石黒浩, "アンドロイドとのアイコンタクトの成立条件の検証", 情報処理学会関西支部大会, 大阪, pp. 71-74, October, 2007.
BibTeX:
@Inproceedings{山森崇義2007,
  author          = {山森崇義 and 坂本大介 and 西尾修一 and 石黒浩},
  title           = {アンドロイドとのアイコンタクトの成立条件の検証},
  booktitle       = {情報処理学会関西支部大会},
  year            = {2007},
  pages           = {71--74},
  address         = {大阪},
  month           = Oct,
  file            = {山森崇義2007.pdf:山森崇義2007.pdf:PDF},
}