QQ客服 官方微博 反馈留言

	An efficient solution algorithm for factored MDP using feature vector extraction
	Zhang Shuang-Min ; Shi Chun-Yi
	2010-05-06 ; 2010-05-06
关键词	Practical Theoretical or Mathematical Experimental/ computational complexity learning (artificial intelligence) linear programming Markov processes multi-robot systems problem solving/ feature vector extraction factored Markov decision process Robocup system state value function approximation constraints reduction linear programming computation complexity reinforcement learning Robocup free kick multi-agent cooperative problem solving/ C3390 Robotics C1140J Markov processes C1180 Optimisation techniques C4240C Computational complexity C1230L Learning in AI
中文摘要	In factored Markov decision process (FMDP) such as Robocup system, the effect to value evaluation of various states is different from each other within state attributes. There are some important state attributes that can determine the whole state value either uniquely, or at least, approximately. Instead of using the relevance among states to reduce the state space, this paper addresses the problem of curse of dimensionality in large FMDP by approximating state value function through feature vector extraction. A key contribution of this paper is that it reduces the computation complexity by constraints reduction in linear programming, speeds up the production of joint strategy by transplanting the value function to the more complex game in reinforcement learning. Experimental results are provided on Robocup free kick, demonstrating a promising indication of the efficiency of the approach and its' ability of transplanting the learning result. Comparing this algorithm to an existing state-of-the-art approach indicates that it can not only improve the learning speed, but also can transplant state value function to the Robocup with more players instead of learning again.
语种	中文 ; 中文
出版者	Science Press ; China
内容类型	期刊论文
源URL	[http://hdl.handle.net/123456789/10348]
专题	清华大学
推荐引用方式 GB/T 7714	Zhang Shuang-Min,Shi Chun-Yi. An efficient solution algorithm for factored MDP using feature vector extraction[J],2010, 2010.
APA	Zhang Shuang-Min,&Shi Chun-Yi.(2010).An efficient solution algorithm for factored MDP using feature vector extraction..
MLA	Zhang Shuang-Min,et al."An efficient solution algorithm for factored MDP using feature vector extraction".(2010).

个性服务

查看访问统计

相关权益政策

暂无数据

收藏/分享

除非特别说明，本系统中所有内容都受版权保护，并保留所有权利。