近场准点光源照明下基于栅格变形的半标定光度立体法

doi:10.1007/s12204-022-2414-9

J Shanghai Jiaotong Univ Sci ›› 2023, Vol. 28 ›› Issue (5): 577-586.doi: 10.1007/s12204-022-2414-9

近场准点光源照明下基于栅格变形的半标定光度立体法

陈启恒¹, 彭娜² , 吕娜¹, 陶卫¹ ,赵辉¹

（1. 上海交通大学电子信息与电气工程学院, 上海 200240; 2. 上海航天电子技术研究所, 上海 201101）

接受日期:2021-12-31 出版日期:2023-10-20 发布日期:2023-10-20

High Curvature Stripe Profile Extraction Algorithm of Line Structured Light Measuring System

CHEN Qiheng¹(陈启恒),PENG Na²(彭娜)，Lü Na¹(吕娜)，TAO Wei¹(陶卫)，ZHAO Hui^l*(赵辉)

(1. School of Electronic Information and Electrical Engineering, Shanghai Jiao Tong University, Shanghai 200240, China; 2. Shanghai Aerospace Electronic Technology Institute, Shanghai 201101, China)

Accepted:2021-12-31 Online:2023-10-20 Published:2023-10-20

摘要/Abstract

摘要： 在近似点光源的近距离照明条件下，光源的非均匀性是导致光度立体法形貌恢复精度不佳的不可避免的误差因素之一。为了避免对光源进行重复、繁琐的光度校准，需要半校准的光度立体法。本文提出了两种简单有效的基于栅格的半校准光度立体算法。所提出的方法扩展了传统的基于栅格的光度立体法，通过交替迭代地更新法向量、深度图和光源强度，可同时进行法向量和非均匀的光源强度的联合准确估计。本文进行了大量实验证明所提出算法的有效性和鲁棒性。实验表明，即使在极其严重的非均匀照明下，所提出的方法仍然可以有效地抑制误差，以及在实际实验中将形貌恢复精度提高达65.6%。

关键词: 光度立体, 栅格变形, 非均一光源, 形貌重建

Abstract: Non-uniformity of light sources is one of the inevitable error factors causing poor shape recovery accuracy of photometric stereo methods under close-range lighting with quasi point lights. Semi-calibrated photometric stereo methods are required to avoid repeated, tedious and impractical photometric calibration. In this paper, two simple, concise but effective mesh-based semi-calibrated photometric stereo methods are proposed. The proposed methods extend the traditional mesh-based photometric stereo methods and further allow joint and accurate estimation of normals and non-uniform light intensities by alternatively updating normals, depth maps and intensities. Extensive experiments are conducted to validate the effectiveness and robustness of the proposed algorithms. Even under extremely severe non-uniform lighting, the proposed methods can still suppress the error and improve the shape recovery accuracy by up to 65.6% in real-world experiments.

Key words: photometric stereo, mesh deformation, non-uniform light sources, shape recovery

中图分类号:

TP301

陈启恒1, 彭娜2 , 吕娜1, 陶卫1 ,赵辉1. 近场准点光源照明下基于栅格变形的半标定光度立体法[J]. J Shanghai Jiaotong Univ Sci, 2023, 28(5): 577-586.

CHEN Qiheng1(陈启恒),PENG Na2(彭娜)，Lü Na1(吕娜)，TAO Wei(陶卫)，ZHAO Huil*(赵辉). High Curvature Stripe Profile Extraction Algorithm of Line Structured Light Measuring System[J]. J Shanghai Jiaotong Univ Sci, 2023, 28(5): 577-586.

参考文献

[1] HAEFNER B, YE Z Z, GAO M L, et al. Variational uncalibrated photometric stereo under general lighting [C]//2019 IEEE/CVF International Conference on Computer Vision. Seoul, Korea: IEEE, 2019: 8538- 8547.
[2] WITKIN A P. Recovering surface shape and orientation from texture [J]. Artificial Intelligence, 1981, 17(1/2/3): 17-45.
[3] GENG J. Structured-light 3D surface imaging: A tutorial [J]. Advances in Optics and Photonics, 2011, 3(2): 128.
[4] MECCA R, WETZLER A, BRUCKSTEIN A M, et al. Near field photometric stereo with point light sources [J]. SIAM Journal on Imaging Sciences, 2014, 7(4): 2732-2770.
[5] QU′ EAU Y, DURIX B, WU T, et al. LED-based photometric stereo: Modeling, calibration and numerical solution [J]. Journal of Mathematical Imaging and Vision, 2018, 60(3): 313-340.
[6] LOGOTHETIS F, BUDVYTIS I, MECCA R, et al. A CNN based approach for the near-field photometric stereo problem [EB/OL]. (2020-09-12). http://arxiv.org/abs/2009.05792.
[7] SONG Z, NIE Y, SONG Z. Photometric stereo with quasi-point light source [J]. Optics and Lasers in Engineering, 2018, 111: 172-182.
[8] NIE Y, SONG Z. A novel photometric stereo method with nonisotropic point light sources [C]//2016 23rd International Conference on Pattern Recognition. Cancun, Mexico: IEEE, 2016: 1737-1742.
[9] MECCA R, LOGOTHETIS F, BUDVYTIS I, et al. LUCES: A dataset for near-field point light source photometric stereo [EB/OL]. (2021-04-27). http://arxiv.org/abs/2104.13135.[10] LOGOTHETIS F, MECCA R, CIPOLLA R. Semicalibrated near field photometric stereo [C]//2017 IEEE Conference on Computer Vision and Pattern Recognition. Honolulu, HI, USA: IEEE, 2017: 4521- 4530.
[11] ACKERMANN J, LANGGUTH F, FUHRMANN S, et al. Photometric stereo for outdoor webcams [C]//2012 IEEE Conference on Computer Vision and Pattern Recognition. Providence, RI, USA: IEEE, 2012: 262- 269.
[12] CHO D, MATSUSHITA Y, TAI Y W, et al. Photometric stereo under non-uniform light intensities and exposures [M]//Computer vision-ECCV 2016. Cham: Springer, 2016: 170-186.
[13] QU′ EAU Y, WU T, CREMERS D. Semi-calibrated near-light photometric stereo [M]//Scale space and variational methods in computer vision. Cham: Springer, 2017: 656-668.
[14] SANTO H, WAECHTER M, MATSUSHITA Y. Deep near-light photometric stereo for spatially varying re- flectances [M]//Computer vision-ECCV 2020. Cham: Springer, 2020: 137-152.
[15] XIE W Y, DAI C K, WANG C C L. Photometric stereo with near point lighting: A solution by mesh deformation [C]//2015 IEEE Conference on Computer Visionand Pattern Recognition. Boston, MA, USA: IEEE, 2015: 4585-4593.
[16] XIE W Y, NIE Y, SONG Z, et al. Mesh-based computation for solving photometric stereo with near point lighting [J]. IEEE Computer Graphics and Applications, 2019, 39(3): 73-85.
[17] WEI M, SONG Z, NIE Y, et al. Normal-based basrelief modelling via near-lighting photometric stereo [J]. Computer Graphics Forum, 2020, 39(1): 204-219.
[18] LIU C, NARASIMHAN S G, DUBRAWSKI A W. Near-light photometric stereo using circularly placed point light sources [C]//2018 IEEE International Conference on Computational Photography. Pittsburgh, PA, USA: IEEE, 2018: 1-10.
[19] KLAUDINY M, HILTON A. Error analysis of photometric stereo with colour lights [J]. Pattern Recognition Letters, 2014, 48: 81-92.
[20] WANG J, MATSUSHITA Y, SHI B X, et al. Photometric stereo with small angular variations [C]//2015 IEEE International Conference on Computer Vision. Santiago, Chile: IEEE, 2015: 3478-3486.
[21] SHEN H L, CHENG Y. Calibrating light sources by using a planar mirror [J]. Journal of Electronic Imaging, 2011, 20: 013002.

近场准点光源照明下基于栅格变形的半标定光度立体法

High Curvature Stripe Profile Extraction Algorithm of Line Structured Light Measuring System

PDF (PC)

可视化

摘要/Abstract

引用本文

使用本文

参考文献

相关文章 5

编辑推荐

Metrics

本文评价

[1]	. 面向工业异构数据匹配的联合迭代匹配方法[J]. J Shanghai Jiaotong Univ Sci, 2025, 30(2): 375-384.
[2]	苗镇华1, 黄文焘2, 张依恋3, 范勤勤1. 基于深度强化学习的多模态多目标多机器人任务分配算法[J]. J Shanghai Jiaotong Univ Sci, 2024, 29(3): 377-387.
[3]	陈坤1, 2, 赵旭1, 董春玉1, 邸子超1, 陈宗枝1. 基于滤波器预测的抗遮挡目标跟踪算法[J]. J Shanghai Jiaotong Univ Sci, 2024, 29(3): 400-413.
[4]	黄山1，黄洪钟1，曾奇2. 一种四阶段的快速移动机器人局部轨迹规划方法[J]. J Shanghai Jiaotong Univ Sci, 2024, 29(3): 428-435.
[5]	CHEN Jian-hong (陈剑洪), LONG Yu (龙宇), CHEN Ke-fei (陈克非) WANG Yong-tao. An Efficient Threshold Key-Insulated Signature Scheme[J]. 上海交通大学学报（英文版）, 2011, 16(6): 658-662.