Summary

可视化视觉适应

Published: April 24, 2017
doi:

Summary

本文介绍用于模拟和视觉系统学习适应的新方法。

Abstract

许多技术已经发展到可视化图像是如何出现的个体有不同的视觉灵敏度: 例如 ,由于光学或年龄的差异,或颜色缺陷或疾病。这个协议描述了用于掺入感觉适应成模拟的技术。该协议被示为具有色觉的例子,但是一般适用于任何形式的视觉适应的。该协议使用基于关于视网膜和皮质机制编码的颜色以及如何将这些调整其灵敏度在当时的刺激的平均颜色和范围的颜色的标准和可信的假设人类颜色视觉的一个简单的模型。该机制的增益调整,使得下一个上下文他们的平均响应等同于不同的环境。仿真有助于揭示适应的理论极限,并产生“改编的图像”被最佳匹配到一个特定的ENVIRO市民明白或观察员。他们还探索适应不同的观察者或不同环境中的作用提供了一个通用指标。表征视觉感知和性能,这些图像为研究视觉或其他感觉系统长期适应的功能和后果的新颖工具。

Introduction

可能世界是什么样子给他人,或者以自己为我们改变?这些问题的答案是理解的性质和感知的机制和感官编码正常和临床情况的后果至关重要的。各种各样的技术和方法已被开发用于模拟图像可能会出现以不同的视觉敏感度的个体。例如,这些包括可以由不同类型的颜色缺陷的被辨别颜色的模拟1,2,3,4,空间和彩色差异可以由婴儿或较旧的观察员5,6,7,8来解决,9 ,图像如何出现在周边视野<s向上类= “外部参照”> 10,和光学误差或疾病11,12,13,14的后果。他们也被应用到可视化是可能的其他物种的15,16,17歧视。通常情况下,这种模拟的使用在不同人群中的灵敏度损耗测量滤波器的图像,从而减少或消除它们难以看到的结构。例如,色盲的常见形式反映两个感光体为中等或长波长敏感的一个的损失,并过滤以除去它们的信号图像通常出现缺乏“红绿”的色调1。同样,婴儿具有更差的敏度,从而为他们的降低的空间灵敏度处理的图像出现模糊 。F“> 5这些技术提供了什么样一个人可以看到另一种可能不会宝贵的插图然而,他们不这样做-而且往往不打算-描绘观察者的实际感性经验,而且在某些情况下可能误传数量和类型的信息提供给观察者。

本文介绍用于模拟在视觉体验其中结合了视觉编码的基本特性差异的新颖技术-适配18,19。所有的感觉和运动系统不断调整,以它们暴露于环境。在一个房间里有刺激性气味很快消失,而视觉适应的房间怎么亮或变暗。重要的是,出现了几乎任何刺激属性这些调整,包括“高层次”的看法,例如某人的脸20的特点类=“外部参照”> 21或它们的话音22,23,以及校准移动眼睛或达到的对象24,25时进行的马达的命令。事实上,改编很可能几乎所有的神经处理的重要属性。本文示出了如何将这些适应影响到图像的外观的仿真中,通过基本上“适应图像”来预测它会出现一个特定的适应观察者26,27,28,29的特定状态下。许多因素可以改变观察者的灵敏度,但往往适应可以补偿这些变化的重要方面,因此,灵敏度损失比没有假定系统适应被预测不那么显眼。相反,因为适应根据目前的刺激情境调节感光度,这些调整也纳入预测如何当环境变化很大的看法可能会有所不同很重要。

以下方案示出了通过调整图像的颜色内容的技术。色觉有颜色编码的初始阶段,神经都比较容易理解的优势,是适应30的图案。实际机制和调整是复杂的,多种多样,但适应的主要后果可以使用简单的和常规的两阶段模型( 图1a)被捕获。在第一阶段中,彩色信号最初由三种类型的视锥光那些对短期,中期或长波长(S,M和L视锥细胞)最大限度敏感的编码。在第二阶段中,从不同的视锥细胞的信号被后receptoral细胞内结合,以形成“颜色对手”茶从不同锥体接收拮抗输入nnels(因此传达“颜色”的信息),并且加在一起的锥体输入“非对手”通道(因此编码“明亮度”的信息)。适应发生在两个阶段中,并且调整到颜色的两个不同方面-的平均值(在锥体)和方差(在-receptoral后通道)30,31。模拟的目标是将这些调整从其改编的输出应用到模型的机制,然后呈现图像。

适应图像的过程包括六个主要部件。这些1)选择图像; 2)选择用于图像光谱的格式; 3),其限定在环境中的颜色变化; 4)限定的观测器的灵敏度的变化; 5使用该程序来创建适于图像); 6)利用图像来评价适应的后果。 Ť他认为以下各步骤加以详细说明。的基本模式和机构响应在图1中示出,而图2 – 5图像的实例与模型渲染。

Protocol

注:协议说明使用一个程序,它允许一个选择的图像,然后使用由不同的下拉菜单选择的选项适应它们。 1.选择图像适应点击图片和浏览图像的文件名的工作。观察上左窗格中的原始图像。 2.指定激励和观察单击“格式”菜单来选择如何表示的图像和观察者。 点击“标准观察者”选项标准或平均观察者适应特定的颜色分布模型…

Representative Results

图2 -图4示出自适应模拟在观察者或环境的变化。 图2比较了塞尚的静物与苹果的年轻和年长的观察者谁只在镜头色素28的密度不同的预测外观。通过年轻眼睛( 图2a)中看到的原始图像通过更密集地着色透镜出现多少更黄和调光器( 图2b)。 (在平均颜色和色度响应的相应位移在图1c</s…

Discussion

示出的协议演示如何适应于环境或观察者的变化的影响可以在图像被描绘。这写照需要将取决于模型所做的假设的形式 – 例如,颜色是如何编码,以及如何编码机制,应对和适应。因此,最重要的一步是决定模型上的色觉 – 比如哪些虚拟通道的特性,他们认为如何适应。另一个重要的步骤是设定合适的参数为两个环境,或两个观察员敏感的特性,您之间调整。

说明该模型非?…

Disclosures

The authors have nothing to disclose.

Acknowledgements

由卫生部(NIH)资助EY-10834的美国国家研究院资助。

Materials

Computer
Images to adapt
Programming language (e.g. Visual Basic or Matlab)
Program for processing the images
Observer spectral sensitivities (for applications involving observer-specific adaptation)
Device emmission spectra (for device-dependent applications)

References

  1. Vienot, F., Brettel, H., Ott, L., Ben M’Barek, A., Mollon, J. D. What do colour-blind people see?. Nature. 376, 127-128 (1995).
  2. Brettel, H., Vienot, F., Mollon, J. D. Computerized simulation of color appearance for dichromats. J Opt Soc Am A Opt Image Sci Vis. 14, 2647-2655 (1997).
  3. Flatla, D. R., Gutwin, C. So that’s what you see: building understanding with personalized simulations of colour vision deficiency. Proceedings of the 14th international ACM SIGACCESS conference on Computers and accessibility. , 167-174 (2012).
  4. Machado, G. M., Oliveira, M. M., Fernandes, L. A. A physiologically-based model for simulation of color vision deficiency. IEEE Trans. Vis. Comput. Graphics. 15, 1291-1298 (2009).
  5. Teller, D. Y. First glances: the vision of infants. the Friedenwald lecture. Invest. Ophthalmol. Vis. Sci. 38, 2183-2203 (1997).
  6. Ball, L. J., Pollack, R. H. Simulated aged performance on the embedded figures test. Exp. Aging Res. 15, 27-32 (1989).
  7. Sjostrom, K. P., Pollack, R. H. The effect of simulated receptor aging on two types of visual illusions. Psychon Sci. 23, 147-148 (1971).
  8. Lindsey, D. T., Brown, A. M. Color naming and the phototoxic effects of sunlight on the eye. Psychol Sci. 13, 506-512 (2002).
  9. Raj, A., Rosenholtz, R. What your design looks like to peripheral vision. Proceedings of the 7th Symposium on Applied Perception in Graphics and Visualization. , 88-92 (2010).
  10. Perry, J. S., Geisler, W. S. Gaze-contingent real-time simulation of arbitrary visual fields. International Society for Optics and Photonics: Electronic Imaging. , 57-69 (2002).
  11. Vinnikov, M., Allison, R. S., Swierad, D. Real-time simulation of visual defects with gaze-contingent display. Proceedings of the 2008 symposium on Eye tracking research. , 127-130 (2008).
  12. Hogervorst, M. A., van Damme, W. J. M. Visualizing visual impairments. Gerontechnol. 5, 208-221 (2006).
  13. Aguilar, C., Castet, E. Gaze-contingent simulation of retinopathy: some potential pitfalls and remedies. Vision res. 51, 997-1012 (2011).
  14. Rowe, M. P., Jacobs, G. H. Cone pigment polymorphism in New World monkeys: are all pigments created equal?. Visual neurosci. 21, 217-222 (2004).
  15. Rowe, M. P., Baube, C. L., Loew, E. R., Phillips, J. B. Optimal mechanisms for finding and selecting mates: how threespine stickleback (Gasterosteus aculeatus) should encode male throat colors. J. Comp. Physiol. A Neuroethol. Sens. Neural. Behav. Physiol. 190, 241-256 (2004).
  16. Melin, A. D., Kline, D. W., Hickey, C. M., Fedigan, L. M. Food search through the eyes of a monkey: a functional substitution approach for assessing the ecology of primate color vision. Vision Res. 86, 87-96 (2013).
  17. Webster, M. A. Adaptation and visual coding. J vision. 11 (5), 1-23 (2011).
  18. Webster, M. A. Visual adaptation. Annu Rev Vision Sci. 1, 547-567 (2015).
  19. Webster, M. A., Kaping, D., Mizokami, Y., Duhamel, P. Adaptation to natural facial categories. Nature. 428, 557-561 (2004).
  20. Webster, M. A., MacLeod, D. I. A. Visual adaptation and face perception. Philos. Trans. R. Soc. Lond., B, Biol. Sci. 366, 1702-1725 (2011).
  21. Schweinberger, S. R., et al. Auditory adaptation in voice perception. Curr Biol. 18, 684-688 (2008).
  22. Yovel, G., Belin, P. A unified coding strategy for processing faces and voices. Trends cognit sci. 17, 263-271 (2013).
  23. Shadmehr, R., Smith, M. A., Krakauer, J. W. Error correction, sensory prediction, and adaptation in motor control. Annu rev neurosci. 33, 89-108 (2010).
  24. Wolpert, D. M., Diedrichsen, J., Flanagan, J. R. Principles of sensorimotor learning. Nat rev Neurosci. 12, 739-751 (2011).
  25. McDermott, K., Juricevic, I., Bebis, G., Webster, M. A., Rogowitz, B. E., Pappas, T. N. Human Vision and Electronic Imaging. SPIE. 68060, (2008).
  26. Juricevic, I., Webster, M. A. Variations in normal color vision. V. Simulations of adaptation to natural color environments. Visual neurosci. 26, 133-145 (2009).
  27. Webster, M. A., Juricevic, I., McDermott, K. C. Simulations of adaptation and color appearance in observers with varying spectral sensitivity. Ophthalmic Physiol Opt. 30, 602-610 (2010).
  28. Webster, M. A. Probing the functions of contextual modulation by adapting images rather than observers. Vision res. , (2014).
  29. Webster, M. A. Human colour perception and its adaptation. Network: Computation in Neural Systems. 7, 587-634 (1996).
  30. Webster, M. A., Mollon, J. D. Colour constancy influenced by contrast adaptation. Nature. 373, 694-698 (1995).
  31. Brainard, D. H., Stockman, A., Bass, M. . OSA Handbook of Optics. , 10-11 (2010).
  32. Maloney, L. T. Evaluation of linear models of surface spectral reflectance with small numbers of parameters. J Opt Soc Am A Opt Image Sci Vis. 3, 1673-1683 (1986).
  33. Mizokami, Y., Webster, M. A. Are Gaussian spectra a viable perceptual assumption in color appearance?. J Opt Soc Am A Opt Image Sci Vis. 29, A10-A18 (2012).
  34. Chichilnisky, E. J., Wandell, B. A. Photoreceptor sensitivity changes explain color appearance shifts induced by large uniform backgrounds in dichoptic matching. Vision res. 35, 239-254 (1995).
  35. Boehm, A. E., MacLeod, D. I., Bosten, J. M. Compensation for red-green contrast loss in anomalous trichromats. J vision. 14, (2014).
  36. Regan, B. C., Mollon, J. D., Cavonius, C. R. . Colour Vision Deficiencies. Vol. XIII. , 261-270 (1997).
  37. Carandini, M., Heeger, D. J. Normalization as a canonical neural computation. Nature reviews. Neurosci. 13, 51-62 (2011).
  38. Rieke, F., Rudd, M. E. The challenges natural images pose for visual adaptation. Neuron. 64, 605-616 (2009).
  39. Hardy, J. L., Frederick, C. M., Kay, P., Werner, J. S. Color naming, lens aging, and grue: what the optics of the aging eye can teach us about color language. Psychol sci. 16, 321-327 (2005).
  40. Webster, M. A., Mollon, J. D. Adaptation and the color statistics of natural images. Vision res. 37, 3283-3298 (1997).
  41. Webster, M. A., Mizokami, Y., Webster, S. M. Seasonal variations in the color statistics of natural images. Network. 18, 213-233 (2007).
  42. Sagi, D. Perceptual learning in Vision Research. Vision res. , (2011).
  43. Lu, Z. L., Yu, C., Watanabe, T., Sagi, D., Levi, D. Perceptual learning: functions, mechanisms, and applications. Vision res. 50, 365-367 (2009).
  44. Bavelier, D., Green, C. S., Pouget, A., Schrater, P. Brain plasticity through the life span: learning to learn and action video games. Annu rev neurosci. 35, 391-416 (2012).
  45. Kompaniez, E., Abbey, C. K., Boone, J. M., Webster, M. A. Adaptation aftereffects in the perception of radiological images. PloS one. 8, e76175 (2013).
  46. Ross, H. . Behavior and Perception in Strange Environments. , (1974).
  47. Armann, R., Jeffery, L., Calder, A. J., Rhodes, G. Race-specific norms for coding face identity and a functional role for norms. J vision. 11, 9 (2011).
  48. Oruc, I., Barton, J. J. Adaptation improves discrimination of face identity. Proc. R. Soc. A. 278, 2591-2597 (2011).
  49. Kording, K. P., Tenenbaum, J. B., Shadmehr, R. The dynamics of memory as a consequence of optimal adaptation to a changing body. Nature neurosci. 10, 779-786 (2007).
  50. Neitz, J., Carroll, J., Yamauchi, Y., Neitz, M., Williams, D. R. Color perception is mediated by a plastic neural mechanism that is adjustable in adults. Neuron. 35, 783-792 (2002).
  51. Delahunt, P. B., Webster, M. A., Ma, L., Werner, J. S. Long-term renormalization of chromatic mechanisms following cataract surgery. Visual neurosci. 21, 301-307 (2004).
  52. Bao, M., Engel, S. A. Distinct mechanism for long-term contrast adaptation. Proc Natl Acad Sci USA. 109, 5898-5903 (2012).
  53. Kwon, M., Legge, G. E., Fang, F., Cheong, A. M., He, S. Adaptive changes in visual cortex following prolonged contrast reduction. J vision. 9 (2), 1-16 (2009).
  54. Webster, M. A., Elliott, A., Fairchild, M. D., Franklin, A. . Handbook of Color Psychology. , 197-215 (2015).

Play Video

Cite This Article
Webster, M. A., Tregillus, K. E. Visualizing Visual Adaptation. J. Vis. Exp. (122), e54038, doi:10.3791/54038 (2017).

View Video