Statistical mechanics approach to a reinforcement learning model with memory

详细信息    查看全文

• 作者：Adam Lipowski ; Krzysztof Gontarek ; Marcel Ausloos
• 关键词：Game theory ; Reinforcement learning ; Prisoner’ ; s dilemma
• 刊名：Physica A
• 出版年：2009
• 出版时间：1 May 2009
• 年：2009
• 卷：388
• 期：9
• 页码：1849-1856
• 全文大小：722 K

文摘

We introduce a two-player model of reinforcement learning with memory. Past actions of an iterated game are stored in a memory and used to determine player’s next action. To examine the behaviour of the model some approximate methods are used and confronted against numerical simulations and exact master equation. When the length of memory of players increases to infinity the model undergoes an absorbing-state phase transition. Performance of examined strategies is checked in the prisoner’ dilemma game. It turns out that it is advantageous to have a large memory in symmetric games, but it is better to have a short memory in asymmetric ones.