【サーベイ】Pseudo-haptic feedback

Haptics サーベイ VR

触覚や力覚などの情報をユーザに伝える技術は、視聴覚の提示技術に比べるとまだ発展途上に有る。
デバイス装着の負荷などの障壁のせいで、ユーザの触覚受容器を刺激する類のいわゆる正攻法では気軽に触覚情報を伝えるのは難しい。

そこで、少し別のアプローチが2000年代から徐々に注目を集め始めてきた。
それは視覚刺激によって，硬さや重さなどの触覚的な情報をユーザに提示する試みだ。
これらは主にpseudo-haptics，pseudo-haptic feedback，pseudo-haptic perceptionなどの用語で扱われ，バーチャル空間における触覚提示手法として研究されてきた。
（日本語だと擬似触覚，擬似力覚，擬似触力覚などと呼ばれる）

それら視覚刺激による触覚を感じさせる手法についての論文をまとめる。

2021/05/06追記

2020年までのpseudo-hapticsの研究を体系的にまとめた我々のサーベイ論文 (https://doi.org/10.1109/TOH.2021.3077619)が、
IEEE Transactions on Hapticsにて出版されましたので、そちらをご参照ください。
以下は2015年時点の古い情報になります

デスクトップ環境におけるpseudo-haptic feedback

ユーザの手や手に相当するポインタなどの見えを適度に変化させることで，
実際には触刺激はないのにも関わらず，バーチャルな触刺激をユーザに想起させる.

たとえば，マウスで操作するカーソルを急に減速させて，
ユーザに「カーソルが減速したのは，手やマウスに力が掛かったから」と思わせる.

その際，手やポインタに所有感を生起させた状態を維持しておくのが重要と指摘されている.

  • バネ抵抗感提示
    • A. Lecuyer, J.-M. Burkhardt, S. Coquillart, and P. Coiffet, “‘Boundary of illusion’: an experiment of sensory integration with a pseudo-haptic system,” Proc. IEEE Virtual Real. 2001, 2001.
  • マウスとポインタによる摩擦抵抗感提示
    • A. Lecuyer, S. Coquillart, A. Kheddar, P. Richard, and P. Coiffet, “Pseudo-haptic feedback: can isometric input devices simulate force feedback?,” Proc. IEEE Virtual Real. 2000 (Cat. No.00CB37048), 2000.
  • 力覚提示
    • K. L. Palmerius and D. Johansson, “An Analysis of the Influence of a Pseudo-haptic Cue on the Haptic Perception of Weight,” 2000.
    • L. Dominjon, A. Lecuyer, J.-M. Burkhardt, P. Richard, and S. Richir, “Influence of control/display ratio on the perception of mass of manipulated objects in virtual environments,” IEEE Proceedings. VR 2005. Virtual Reality, 2005., 2005.
    • A. Pusch, O. Martin, and S. Coquillart, “HEMP - Hand-displacement-based Pseudo-haptics: A study of a force field application,” 3DUI - IEEE Symp. 3D User Interfaces 2008, pp. 59–66, 2008.
    • M. Tatezono, K. Sato, K. Minamizawa, H. Nii, N. Kawakami, and S. Tachi, “Effect of haptic feedback on pseudo-haptic feedback for arm display,” 2009 Iccas-Sice, 2009.
    • H. Kim and W. K. Chung, “Experimental Study of Pseudo-haptic Perception for Consistent Pseudo-haptic Rendering,” pp. 241–242, 2013.
    • F. Argelaguet, T. Sato, T. Duval, Y. Kitamura, and A. Lécuyer, “Collaborative Pseudo-Haptics: Two-User Stiffness Discrimination Based on Visual Feedback,” in Haptics: Neuroscience, Devices, Modeling, and Applications SE - 7, vol. 8619, M. Auvray and C. Duriez, Eds. Springer Berlin Heidelberg, 2014, pp. 49–54.
  • テクスチャの凹凸感提示
    • A. Lécuyer, J.-M. Burkhardt, and L. Etienne, “Feeling bumps and holes without a haptic interface: the perception of pseudo-haptic textures,” Proc. SIGCHI Conf. Hum. Factors Comput. Syst. - CHI ’04, vol. 6, pp. 239–246, 2004.
    • K. van Mensvoort, D. J. Hermes, and M. van Montfort, “Usability of optically simulated haptic feedback,” Int. J. Hum. Comput. Stud., vol. 66, pp. 438–451, 2008.
    • A. Lécuyer, J.-M. Burkhardt, and C.-H. Tan, “A study of the modification of the speed and size of the cursor for simulating pseudo-haptic bumps and holes,” ACM Trans. Appl. Percept., vol. 5, no. 3, pp. 1–21, 2008.
    • K. Watanabe and M. Yasumura, “VisualHaptics: generating haptic sensation using only visual cues,” in Proceedings of the 2008 International Conference on Advances in Computer Entertainment Technology, 2008, vol. 246, p. 405.
    • K. Van Mensvoort, P. Vos, D. J. Hermes, and R. Van Liere, “Perception of mechanically and optically simulated bumps and holes,” ACM Transactions on Applied Perception, vol. 7. pp. 1–24, 2010.
    • T. Hachisu, G. Cirio, M. Marchal, A. Lécuyer, and H. Kajimoto, “Pseudo-haptic feedback augmented with visual and tactile vibrations,” ISVRI 2011 - IEEE Int. Symp. Virtual Real. Innov. 2011, Proc., no. 1, pp. 327–328, 2011.
    • F. Argelaguet, D. A. Gómez Jáuregui, M. Marchal, and A. Lécuyer, “A novel approach for pseudo-haptic textures based on curvature information,” Lect. Notes Comput. Sci. (including Subser. Lect. Notes Artif. Intell. Lect. Notes Bioinformatics), vol. 7282 LNCS, no. PART 1, pp. 1–12, 2012.
    • D. A. G. Jáuregui, F. Argelaguet, and A. Lecuyer, “Design and evaluation of 3D cursors and motion parallax for the exploration of desktop virtual environments,” IEEE Symp. 3D User Interfaces 2012, 3DUI 2012 - Proc., pp. 69–76, 2012.
    • R. Kojima, K. Watanabe, M. Inami, and T. Igarashi, “VisualHaptics 2 . 0 : Improvement of the Feel and Applying to the Touch Screen,” pp. 257–260, 2013.
  • 形状提示
    • Y. Ban, T. Kajinami, T. Narumi, T. Tanikawa, and M. Hirose, “Modifying an identified curved surface shape using pseudo-haptic effect,” Haptics Symp. 2012, HAPTICS 2012 - Proc., pp. 211–216, 2012.
  • テクスチャの硬さ感提示
    • F. Argelaguet, D. A. G. Jáuregui, M. Marchal, and A. Lécuyer, “Elastic images: Perceiving local elasticity of images through a novel pseudo-haptic deformation effect,” ACM Trans. Appl. Percept., vol. 10, no. 3, p. 17, 2013.
  • magnetic attraction
    • P. Gaucher, F. Argelaguet, J. Royan, and A. Lecuyer, “A novel 3D carousel based on pseudo-haptic feedback and gestural interaction for virtual showcasing,” IEEE Symp. 3D User Interface 2013, 3DUI 2013 - Proc., pp. 55–58, 2013.
  • 回転体の回転速度
    • A. Lécuyer, M. Congedo, E. Gentaz, O. Joly, and S. Coquillart, “Influence of visual feedback on passive tactile perception of speed and spacing of rotating gratings,” Lect. Notes Comput. Sci. (including Subser. Lect. Notes Artif. Intell. Lect. Notes Bioinformatics), vol. 6192 LNCS, no. PART 2, pp. 73–78, 2010.
  • 背景の動きだけで提示
    • J. Watanabe, “Pseudo-haptic Sensation Elicited by Background Visual,” vol. 1, no. 2, pp. 199–202, 2013.
    • S. Takamuku and H. Gomi, “Background visual motion reduces pseudo-haptic sensation caused by delayed visual feedback during handwriting,” Percept. ECVP Abstr. Suppl., vol. 40, p. 136, 2011.

MR（AR)空間におけるpseudo-haptic feedback

MR空間では実際の自分の手などを一旦消した上で，ずらして表示する必要がある．

  • 重さ感提示
    • Y. Taima, Y. Ban, T. Narumi, T. Tanikawa, and M. Hirose, “Controlling fatigue while lifting objects using Pseudo-haptics in a mixed reality space,” in Haptics Symposium (HAPTICS), 2014 IEEE, 2014, pp. 175–180.
    • P. Issartel, “Perceiving Mass in Mixed Reality through Pseudo-Haptic Rendering of Newton ’ s Third Law.”
  • 硬さ感提示
    • P. Punpongsanon, D. Iwai, and K. Sato, “[Poster] A preliminary study on altering surface softness perception using augmented color and deformation,” in Mixed and Augmented Reality (ISMAR), 2014 IEEE International Symposium on, 2014, pp. 301–302.

タッチスクリーンにおけるpseudo-haptic feedback

タッチスクリーン上では，指と視覚提示物の位置ズレが違和感を生むと言われているため，pseudo-haptic feedbackを起こすには一手間必要．
たとえば，

  • 入力部とスクリーンを分離
    • T. Kimura and T. Nojima, “Pseudo-haptic feedback on softness induced by grasping motion,” Lect. Notes Comput. Sci. (including Subser. Lect. Notes Artif. Intell. Lect. Notes Bioinformatics), vol. 7283 LNCS, no. PART 2, pp. 202–205, 2012.
    • A. Kokubun, Y. Ban, T. Narumi, T. Tanikawa, and M. Hirose, “Visuo-haptic Interaction with Mobile Rear Touch Interface,” in ACM SIGGRAPH 2013 Posters, 2013, pp. 38:1–38:1.
    • A. Kokubun, Y. Ban, T. Narumi, T. Tanikawa, and M. Hirose, “Representing normal and shearing forces on the mobile device with visuo-haptic interaction and a rear touch interface,” in Haptics Symposium (HAPTICS), 2014 IEEE, 2014, pp. 415–420.
  • 奥行き方向への入力であれば位置ズレは起きないため，硬さ感はデスクトップ環境と同じく物体の変形度合いを変えれば提示できる
    • M. Li, H. Liu, J. Li, L. D. Seneviratne, and K. Althoefer, “Tissue stiffness simulation and abnormality localization using pseudo-haptic feedback,” Proc. - IEEE Int. Conf. Robot. Autom., pp. 5359–5364, 2012.
    • M. Li, M. B. Ridzuan, S. Sareh, L. D. Seneviratne, P. Dasgupta, and K. Althoefer, “Pseudo-haptics for rigid tool/soft surface interaction feedback in virtual environments,” Mechatronics, 2014.
    • D. Rocchesso, S. Delle Monache, and S. Papetti, “Multisensory texture exploration at the tip of the pen,” Int. J. Hum. Comput. Stud., pp. 1–10, 2015.
    • K. Wolf and S. Author, “Illusion of Surface Changes induced by Tactile and Visual Touch Feedback,” Proc. CHI’15, pp. 1355–1360, 2015.
    • M. Li, J. Konstantinova, E. L. Secco, A. Jiang, H. Liu, T. Nanayakkara, L. D. Seneviratne, P. Dasgupta, K. Althoefer, and H. a. Wurdemann, “Using visual cues to enhance haptic feedback for palpation on virtual model of soft tissue,” Med. Biol. Eng. Comput., 2015.
  • スクリーン内まで指を延長
    • M. Ridzuan, Y. Makino, and K. Takemura, “Direct Touch Haptic Display Using Immersive Illusion with Interactive Virtual Finger,” in Haptics: Perception, Devices, Mobility, and Communication SE - 39, vol. 7282, P. Isokoski and J. Springare, Eds. Springer Berlin Heidelberg, 2012, pp. 432–444.
  • 背景の動きを利用
    • M. Baglioni, “Flick-and-Brake : Finger Control over Inertial / Sustained Scroll Motion,” Proc. 2011 Annu. Conf. Hum. factors Comput. Syst., pp. 2281–2286, 2011.
    • K. Tuuri, “Wheel matters – Pseudo-haptic approach in designing enhanced touch screen wheel widget,” pp. 48–50.
    • J. Kim, A. X. Zhang, J. Kim, and R. C. Miller, “Content-Aware Kinetic Scrolling for Supporting Web Page Navigation,” 2014.
    • Y. Ujitoko, Y. Ban, T. Narumi, T Tanikawa, K Hirota, M Hirose , "Yubi-Toko: Finger Walking in Snowy Scene using Pseudo-haptic Technique on Touchpad," SIGGRAPH Asia 2015 Emerging Technologies, 2015.
    • Y. Ujitoko, K. Hirota, "Impact of Illusory Resistance on Finger Walking Behavior," IEEE VR, 2015.
  • 学習に利用
    • G. Shiota and A. Kashihara, “Cognitive effects of concept map generation with pseudo-haptic feedback,” 2013 12th Int. Conf. Inf. Technol. Based High. Educ. Training, ITHET 2013, 2013.
    • A. Kashihara and G. Shiota, “Knowledge Construction with Visual and Pseudo-Haptic Senses,” no. 1, pp. 104–116.

Pseudo-haptic feedbackの知覚調査

  • 筋電による定量評価
    • K. Nishimura, T. Tanikawa, and M. Hirose, “Study of an Evaluation Method for Pseudo-Haptics with Electromyogram ecuyer pseudo-haptic feedback Spaceball Mensvoort Spaceball Flash POWERCURSOR Spaceball Space- ball Spaceball Wii PHANToM Wii Wii Bluetooth Wii ( Wii Remote ) Wii Wii L ´ ecuyer Wii Wii ,” pp. 1–6.
    • T. Tanikawa and M. Hirose, “A study of multi-modal display system with visual feedback,” in Proceedings of the 2nd International Symposium on Universal Communication, ISUC 2008, 2008, pp. 285–292.
    • M. Fukushima, T. Takemoto, and M. Fujimura, “A Study on Pseudo-Haptics by Cursor Moving with Motion Blur,” in Complex, Intelligent, and Software Intensive Systems (CISIS), 2013 Seventh International Conference on, 2013, pp. 751–754.
    • K. Sakagami, Y. Seto, S. Ako, K. Tanino, H. Miura, N. Matsuda, M. Soga, H. Taki, S. Engineering, and S. Engineering, “擬似力覚知覚時の NIRS と EEG による脳活動分析 Measurement and Analysis of Brain Activity in perception of Pseudo using NIRS and EEG,” pp. 345–346.
  • 異方性
    • S. SATO and M. ISHII, “Anisotropy of Pseudo-Haptics,” 電子情報通信学会技術研究報告. IMQ, イメージ・メディア・クオリティ, vol. 111, no. 318, pp. 29–33, Nov. 2011.
  • 速度成分の分析
  • -

サーベイ論文

  • Lécuyer et al.によるまとめ
    • A. Lécuyer, “Simulating Haptic Feedback Using Vision: A Survey of Research and Applications of Pseudo-Haptic Feedback,” Presence: Teleoperators and Virtual Environments, vol. 18. pp. 39–53, 2009.
  • 理論重視
    • A. Pusch and A. Lécuyer, “Pseudo-haptics: from the theoretical foundations to practical system design guidelines,” in Proceedings of ICMI 2011, 2011, pp. 57–64.

GUIでの操作性向上に利用

触力覚という文脈ではなく，操作性のみに注目した研究群．
Pseudo-haptic feedbackの研究よりも早期に集中している．
無限にある.

  • Target acquisition
    • R. L. Mandryk, M. E. Rodgers, and K. M. Inkpen, “Sticky Widgets: Pseudo-haptic Widget Enhancements for Multi-monitor Displays,” in CHI ’05 Extended Abstracts on Human Factors in Computing Systems, 2005, pp. 1621–1624.
    • M. Rodgers, R. Mandryk, and K. Inkpen, “Smart Sticky Widgets: Pseudo-haptic Enhancements for Multi-Monitor Displays,” in Smart Graphics SE - 18, vol. 4073, A. Butz, B. Fisher, A. Krüger, and P. Olivier, Eds. Springer Berlin Heidelberg, 2006, pp. 194–205.
    • D. Ahlstr, M. Hitz, and G. Leitner, “An Evaluation of Sticky and Force Enhanced Targets in Multi Target Situations,” Nord. ’06 Proc. 4th Nord. Conf. Human-computer Interact. Chang. roles, pp. 58–67, 2006.
    • R. L. Mandryk and C. Gutwin, “Perceptibility and Utility of Sticky Targets,” in Proceedings of the 2008 Conference on Graphics Interface, 2008, pp. 65–72.

未分類

    • C. Neupert, S. Matich, C. Hatzfeld, M. Kupnik, and R. Werthsch, “Investigation of the Usability of Pseudo-Haptic Feedback in Teleoperation,” 2015.
    • S. Tano, Y. Kakei, T. Hashiyama, and M. Iwata, “QUANTITATIVE ANALYSYS OF PSEUDO-HAPTICS BASED ON THREE TYPES OF HAND FORM AND TWO PHASES OF PERCEPTION Graduate School of Information Systems , University of Electro-Communications.”