RANKING CONSISTENT RATE: NEW EVALUATION CRITERION ON PAIRWISE SUBJECTIVE EXPERIMENTS | |
Shen, Yeji ; Jiang, Tingting | |
2016 | |
关键词 | Subjective Image Quality Assessment Paired Comparison Mean Opinion Score IMAGE QUALITY ASSESSMENT |
英文摘要 | Subjective experimental results are widely used as the ground truth in objective Image Quality Assessment (IQA). Specifically, Pairwise Comparison method has superiority over Mean Opinion Scores (MOS), but there is a problem when measuring the consistency between subjective pairwise comparisons and objective quality predictions. In this paper, we first analyze the existing problem of current evaluation method for the consistency between the pairwise comparisons given by human subjects and the ranking results given by objective IQA algorithms. Then we propose a new direct evaluation method, Ranking Consistent Rate, to solve this problem. Moreover, through our method, we can check the self-consistency of datasets based on pairwise comparisons and evaluate the performance of an IQA algorithm more accurately.; CPCI-S(ISTP); 2077-2081 |
语种 | 英语 |
出处 | 23rd IEEE International Conference on Image Processing (ICIP) |
内容类型 | 其他 |
源URL | [http://ir.pku.edu.cn/handle/20.500.11897/459880] |
专题 | 信息科学技术学院 |
推荐引用方式 GB/T 7714 | Shen, Yeji,Jiang, Tingting. RANKING CONSISTENT RATE: NEW EVALUATION CRITERION ON PAIRWISE SUBJECTIVE EXPERIMENTS. 2016-01-01. |
个性服务 |
查看访问统计 |
相关权益政策 |
暂无数据 |
收藏/分享 |
除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。
修改评论