Learning to Optimize: Reference Vector Reinforcement Learning Adaption to Constrained Many-Objective Optimization of Industrial Copper Burdening System
Ma LB(马连博)3; Li, Nan3; Guo, Yinan2; Wang XW(王兴伟)1; Yang, Shengxiang4; Huang M(黄敏)6; Zhang H(张浩)5
刊名IEEE Transactions on Cybernetics
2021
页码1-14
关键词Copper burdening optimization many-objective optimization reference vector reinforcement learning (RVRL)
ISSN号2168-2267
产权排序6
英文摘要

The performance of decomposition-based algorithms is sensitive to the Pareto front shapes since their reference vectors preset in advance are not always adaptable to various problem characteristics with no a priori knowledge. For this issue, this article proposes an adaptive reference vector reinforcement learning (RVRL) approach to decomposition-based algorithms for industrial copper burdening optimization. The proposed approach involves two main operations, that is: 1) a reinforcement learning (RL) operation and 2) a reference point sampling operation. Given the fact that the states of reference vectors interact with the landscape environment (quite often), the RL operation treats the reference vector adaption process as an RL task, where each reference vector learns from the environmental feedback and selects optimal actions for gradually fitting the problem characteristics. Accordingly, the reference point sampling operation uses estimation-of-distribution learning models to sample new reference points. Finally, the resultant algorithm is applied to handle the proposed industrial copper burdening problem. For this problem, an adaptive penalty function and a soft constraint-based relaxing approach are used to handle complex constraints. Experimental results on both benchmark problems and real-world instances verify the competitiveness and effectiveness of the proposed algorithm.

资助项目National Natural Science Foundation of China[61773103] ; National Natural Science Foundation of China[61973305] ; National Natural Science Foundation of China[61872073] ; National Natural Science Foundation of China[71620107003] ; National Natural Science Foundation of China[61673331] ; National Natural Science Foundation of China[62032013] ; Liaoning Revitalization Talents Program[XLYC1902010] ; Liaoning Revitalization Talents Program[XLYC1802115]
WOS关键词MULTIOBJECTIVE EVOLUTIONARY ALGORITHM ; NONDOMINATED SORTING APPROACH ; DECOMPOSITION ; SEARCH ; MOEA/D
WOS研究方向Automation & Control Systems ; Computer Science
语种英语
WOS记录号WOS:000732887500001
资助机构National Natural Science Foundation of China under Grant 61773103, Grant 61973305, Grant 61872073, Grant 71620107003, Grant 61673331, and Grant 62032013 ; Liaoning Revitalization Talents Program under Grant XLYC1902010 and Grant XLYC1802115
内容类型期刊论文
源URL[http://ir.sia.cn/handle/173321/29350]  
专题沈阳自动化研究所_数字工厂研究室
通讯作者Wang XW(王兴伟); Huang M(黄敏)
作者单位1.College of Computer Science, Northeastern University, Shenyang 110819, China
2.School of Information Science and Engineering, China University of Mining and Technology (Beijing), Beijing 100083, China
3.College of Software, Northeastern University, Shenyang 110819, China
4.School of Computer Science and Informatics, De Montfort University, Leicester LE1 9BH, U.K.
5.Shenyang Institute of Automation, Chinese Academy of Sciences, Shenyang 110016, China.
6.College of Information Science and Engineering, State Key Laboratory of Synthetical Automation for Process Industries, Northeastern University, Shenyang 110819, China
推荐引用方式
GB/T 7714
Ma LB,Li, Nan,Guo, Yinan,et al. Learning to Optimize: Reference Vector Reinforcement Learning Adaption to Constrained Many-Objective Optimization of Industrial Copper Burdening System[J]. IEEE Transactions on Cybernetics,2021:1-14.
APA Ma LB.,Li, Nan.,Guo, Yinan.,Wang XW.,Yang, Shengxiang.,...&Zhang H.(2021).Learning to Optimize: Reference Vector Reinforcement Learning Adaption to Constrained Many-Objective Optimization of Industrial Copper Burdening System.IEEE Transactions on Cybernetics,1-14.
MLA Ma LB,et al."Learning to Optimize: Reference Vector Reinforcement Learning Adaption to Constrained Many-Objective Optimization of Industrial Copper Burdening System".IEEE Transactions on Cybernetics (2021):1-14.
个性服务
查看访问统计
相关权益政策
暂无数据
收藏/分享
所有评论 (0)
暂无评论
 

除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。


©版权所有 ©2017 CSpace - Powered by CSpace