Towards Handling Sudden Changes in Feature Maps during Depth Estimation | |
Xue, Yao6; Cao, Yu5; Feng, Xubin4; Xie, Meilin4; Li, Ke3; Zhang, Xingjun2; Qian, Xueming1 | |
刊名 | IEEE Transactions on Multimedia
![]() |
关键词 | depth estimation depth representation multiscale feature |
ISSN号 | 15209210;19410077 |
DOI | 10.1109/TMM.2022.3171400 |
产权排序 | 3 |
英文摘要 | Depth estimation aims to predict depth map from RGB images without high cost equipments. Deep learning based depth estimation methods have shown their effectiveness. However in existing methods, depth information is represented by a per-pixel depth map. Such depth map representation is fragile facing different kinds of depth changes. This paper proposes a Compressive Sensing based Depth Representation (CSDR) scheme, which formulates the problem of depth estimation in pixel space into the task of fixed-length vector regression in representation space. In this way, deep model training errors will not directly interfere depth estimation, and distortions in estimated depth maps can be restrained in the greatest extent. In addition, we improve depth estimation from two other aspects: model structure and loss function. To capture the features in different scales, we propose a Multiscale Encoder \& Multiscale Decoder (MEMD) structure as the vector regression model. To further deal with depth change, we also modify the loss function, where the curvature difference between ground truth and estimation is directly incorporated. With the support of CSDR, MEMD and the curvature loss, the proposed approach achieves superior performance on a challenging depth estimation dataset: NYU-Depth-v2. A range of experiments support our claim that regression in CSDR space performs better than traditionally direct depth map estimation in pixel space. IEEE |
语种 | 英语 |
出版者 | Institute of Electrical and Electronics Engineers Inc. |
内容类型 | 期刊论文 |
源URL | [http://ir.opt.ac.cn/handle/181661/95883] ![]() |
专题 | 西安光学精密机械研究所_光电测量技术实验室 |
作者单位 | 1.School of Electronics and Information Engineering, Xi'an Jiaotong University, Xi'an, Shaanxi, China, 710049 2.Computer Science & Technology, Xi'an Jiaotong University, Xi'an, Shaanxi, China, 710049; 3.School of Software Engineering, Xi'an Jiaotong University, 12480 Xi'an, Shaanxi, China; 4.Space Precision Measurement Laboratory, Xi'an Institute of Optics and Precision Mechanics, Chinese Academy of Sciences, 12381 Xi'an, China; 5.Space Precision Measurement Laboratory, Xi'an Institute of Optics and Precision Mechanics, Chinese Academy of Sciences, 12381 Beijing, Beijing, China; 6.School of Information and Communications Engineering, Xi'an Jiaotong University, 12480 Xi'an, China, 710049; |
推荐引用方式 GB/T 7714 | Xue, Yao,Cao, Yu,Feng, Xubin,et al. Towards Handling Sudden Changes in Feature Maps during Depth Estimation[J]. IEEE Transactions on Multimedia. |
APA | Xue, Yao.,Cao, Yu.,Feng, Xubin.,Xie, Meilin.,Li, Ke.,...&Qian, Xueming. |
MLA | Xue, Yao,et al."Towards Handling Sudden Changes in Feature Maps during Depth Estimation".IEEE Transactions on Multimedia |
个性服务 |
查看访问统计 |
相关权益政策 |
暂无数据 |
收藏/分享 |
除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。
修改评论