tt293/medium-poker-ai

Code accompanying my Medium series on building an AI for Poker

medium-poker-ai's Issues

Test your Poker Agents on pokerwars.io

Hi Guys,

just wanna let you know that there is a Free Poker Bot Platform to test your agents in a more heterogenous environment. I think the current bots are already pretty competitive although it would be nice to compete against more ml experts. There are around 20-40 bots online almost 24/7.

Jump to pokerwars leaderboard or check out several API languages on pokerwars github

Hope to see some of you there and exchange some insights.

Cheers,
Simon

Convergence of regret matching for RPS against equilibrium strategy

Hey there,

I implemented regret matching in a similar way to you did in part 4 for rock paper scissors while following this paper.

I was wondering if you every tried playing against a stationary equilibrium strategy (rather than "self-play") as when I try that in my implementation it looks like the average strategy fails to converge. However when the opponent plays an exploitable strategy like

opp_strategy = [0.5, 0.2, 0.3]

from your post, it succeeds in finding the optimal strategy. Likewise pitting it against itself will converge to the equilibrium strategy also.

Did you experience anything similar or know of a theoretical reason why regret matching wouldn't find the equilibrium when the opponent is already playing it from the outset?