Eigenvalue spectrum of neural networks with arbitrary Hebbian length | |
Zhou, Jianwen2; Jiang, Zijian; Hou, Tianqi4; Chen, Ziming1; Wong, K. Y. Michael; Huang, Haiping | |
刊名 | PHYSICAL REVIEW E |
2021 | |
卷号 | 104期号:6页码:64307 |
关键词 | NEURONAL CORRELATE TERM-MEMORY ASSOCIATION UNDERLIES CAPACITY |
ISSN号 | 2470-0045 |
DOI | 10.1103/PhysRevE.104.064307 |
英文摘要 | Associative memory is a fundamental function in the brain. Here, we generalize the standard associative memory model to include long-range Hebbian interactions at the learning stage, corresponding to a large synaptic integration window. In our model, the Hebbian length can be arbitrarily large. The spectral density of the coupling matrix is derived using the replica method, which is also shown to be consistent with the results obtained by applying the free probability method. The maximal eigenvalue is then obtained by an iterative equation, related to the paramagnetic to spin glass transition in the model. Altogether, this work establishes the connection between the associative memory with arbitrary Hebbian length and the asymptotic eigen-spectrum of the neural-coupling matrix. |
学科主题 | Physics |
语种 | 英语 |
内容类型 | 期刊论文 |
源URL | [http://ir.itp.ac.cn/handle/311006/27610] |
专题 | 理论物理研究所_理论物理所1978-2010年知识产出 |
作者单位 | 1.Huawei Technol Co Ltd, Cent Res Inst, Theory Lab, Labs 2012, Hong Kong Sci Pk, Hong Kong, Peoples R China 2.Sun Yat Sen Univ, Sch Phys, PMI Lab, Guangzhou 510275, Peoples R China 3.Chinese Acad Sci, Inst Theoret Phys, CAS Key Lab Theoret Phys, Beijing 100190, Peoples R China 4.Hong Kong Univ Sci & Technol, Dept Phys, Clear Water Bay, Hong Kong, Peoples R China 5.Tsinghua Univ, Dept Elect Engn, Beijing 100084, Peoples R China |
推荐引用方式 GB/T 7714 | Zhou, Jianwen,Jiang, Zijian,Hou, Tianqi,et al. Eigenvalue spectrum of neural networks with arbitrary Hebbian length[J]. PHYSICAL REVIEW E,2021,104(6):64307. |
APA | Zhou, Jianwen,Jiang, Zijian,Hou, Tianqi,Chen, Ziming,Wong, K. Y. Michael,&Huang, Haiping.(2021).Eigenvalue spectrum of neural networks with arbitrary Hebbian length.PHYSICAL REVIEW E,104(6),64307. |
MLA | Zhou, Jianwen,et al."Eigenvalue spectrum of neural networks with arbitrary Hebbian length".PHYSICAL REVIEW E 104.6(2021):64307. |
个性服务 |
查看访问统计 |
相关权益政策 |
暂无数据 |
收藏/分享 |
除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。
修改评论