Eigenvalue spectrum of neural networks with arbitrary Hebbian length
Zhou, Jianwen2; Jiang, Zijian; Hou, Tianqi4; Chen, Ziming1; Wong, K. Y. Michael; Huang, Haiping
刊名PHYSICAL REVIEW E
2021
卷号104期号:6页码:64307
关键词NEURONAL CORRELATE TERM-MEMORY ASSOCIATION UNDERLIES CAPACITY
ISSN号2470-0045
DOI10.1103/PhysRevE.104.064307
英文摘要Associative memory is a fundamental function in the brain. Here, we generalize the standard associative memory model to include long-range Hebbian interactions at the learning stage, corresponding to a large synaptic integration window. In our model, the Hebbian length can be arbitrarily large. The spectral density of the coupling matrix is derived using the replica method, which is also shown to be consistent with the results obtained by applying the free probability method. The maximal eigenvalue is then obtained by an iterative equation, related to the paramagnetic to spin glass transition in the model. Altogether, this work establishes the connection between the associative memory with arbitrary Hebbian length and the asymptotic eigen-spectrum of the neural-coupling matrix.
学科主题Physics
语种英语
内容类型期刊论文
源URL[http://ir.itp.ac.cn/handle/311006/27610]  
专题理论物理研究所_理论物理所1978-2010年知识产出
作者单位1.Huawei Technol Co Ltd, Cent Res Inst, Theory Lab, Labs 2012, Hong Kong Sci Pk, Hong Kong, Peoples R China
2.Sun Yat Sen Univ, Sch Phys, PMI Lab, Guangzhou 510275, Peoples R China
3.Chinese Acad Sci, Inst Theoret Phys, CAS Key Lab Theoret Phys, Beijing 100190, Peoples R China
4.Hong Kong Univ Sci & Technol, Dept Phys, Clear Water Bay, Hong Kong, Peoples R China
5.Tsinghua Univ, Dept Elect Engn, Beijing 100084, Peoples R China
推荐引用方式
GB/T 7714
Zhou, Jianwen,Jiang, Zijian,Hou, Tianqi,et al. Eigenvalue spectrum of neural networks with arbitrary Hebbian length[J]. PHYSICAL REVIEW E,2021,104(6):64307.
APA Zhou, Jianwen,Jiang, Zijian,Hou, Tianqi,Chen, Ziming,Wong, K. Y. Michael,&Huang, Haiping.(2021).Eigenvalue spectrum of neural networks with arbitrary Hebbian length.PHYSICAL REVIEW E,104(6),64307.
MLA Zhou, Jianwen,et al."Eigenvalue spectrum of neural networks with arbitrary Hebbian length".PHYSICAL REVIEW E 104.6(2021):64307.
个性服务
查看访问统计
相关权益政策
暂无数据
收藏/分享
所有评论 (0)
暂无评论
 

除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。


©版权所有 ©2017 CSpace - Powered by CSpace