From ec391813492a4e590255366a85d9628a443c776f Mon Sep 17 00:00:00 2001 From: Nemo Date: Sun, 9 Oct 2022 15:27:34 +0530 Subject: [PATCH] Another related paper on Carcassone --- README.md | 1 + boardgame-research.rdf | 72 ++++++++++++++++++++++++++++++++++++++++++ 2 files changed, 73 insertions(+) diff --git a/README.md b/README.md index 5e76cb8..c207592 100644 --- a/README.md +++ b/README.md @@ -101,6 +101,7 @@ If you aren't able to access any paper on this list, please [try using Sci-Hub]( # Carcassonne - [Playing Carcassonne with Monte Carlo Tree Search](http://arxiv.org/abs/2009.12974) (journalArticle) - [On the Evolution of the MCTS Upper Confidence Bounds for Trees by Means of Evolutionary Algorithms in the Game of Carcassonne](http://arxiv.org/abs/2112.09697) (journalArticle) +- [Evolving the MCTS Upper Confidence Bounds for Trees Using a Semantic-inspired Evolutionary Algorithm in the Game of Carcassonne](http://arxiv.org/abs/2208.13589) (preprint) # Diplomacy - [Learning to Play No-Press Diplomacy with Best Response Policy Iteration](http://arxiv.org/abs/2006.04635v2) (journalArticle) diff --git a/boardgame-research.rdf b/boardgame-research.rdf index 584f699..10a6553 100644 --- a/boardgame-research.rdf +++ b/boardgame-research.rdf @@ -9218,6 +9218,77 @@ guaranteed decent high score. The algorithm got a lowest score of 79 and a 2022-09-07 10:09:15 3 + + preprint + + arXiv + + + + + + Galván + Edgar + + + + + Simpson + Gavin + + + + + Ameneyro + Fred Valdez + + + + + + + + + Computer Science - Neural and Evolutionary Computing + + + Evolving the MCTS Upper Confidence Bounds for Trees Using a Semantic-inspired Evolutionary Algorithm in the Game of Carcassonne + Monte Carlo Tree Search (MCTS) is a sampling best-first method to search for optimal decisions. The success of MCTS depends heavily on how the tree is built and the selection process plays a fundamental role in this. One particular selection mechanism that has proved to be reliable is based on the Upper Confidence Bounds for Trees (UCT). The UCT attempts to balance exploration and exploitation by considering the values stored in the statistical tree of the MCTS. However, some tuning of the MCTS UCT is necessary for this to work well. In this work, we use Evolutionary Algorithms (EAs) to evolve mathematical expressions with the goal to substitute the UCT formula and use the evolved expressions in MCTS. More specifically, we evolve expressions by means of our proposed Semantic-inspired Evolutionary Algorithm in MCTS approach (SIEA-MCTS). This is inspired by semantics in Genetic Programming (GP), where the use of fitness cases is seen as a requirement to be adopted in GP. Fitness cases are normally used to determine the fitness of individuals and can be used to compute the semantic similarity (or dissimilarity) of individuals. However, fitness cases are not available in MCTS. We extend this notion by using multiple reward values from MCTS that allow us to determine both the fitness of an individual and its semantics. By doing so, we show how SIEA-MCTS is able to successfully evolve mathematical expressions that yield better or competitive results compared to UCT without the need of tuning these evolved expressions. We compare the performance of the proposed SIEA-MCTS against MCTS algorithms, MCTS Rapid Action Value Estimation algorithms, three variants of the *-minimax family of algorithms, a random controller and two more EA approaches. We consistently show how SIEA-MCTS outperforms most of these intelligent controllers in the challenging game of Carcassonne. + 2022-08-29 + arXiv.org + + + http://arxiv.org/abs/2208.13589 + + + 2022-10-09 09:56:30 + arXiv:2208.13589 [cs] + arXiv:2208.13589 + + + attachment + arXiv Fulltext PDF + + + https://arxiv.org/pdf/2208.13589.pdf + + + 2022-10-09 09:56:41 + 1 + application/pdf + + + attachment + arXiv.org Snapshot + + + https://arxiv.org/abs/2208.13589 + + + 2022-10-09 09:56:47 + 1 + text/html + 2048 @@ -9253,6 +9324,7 @@ guaranteed decent high score. The algorithm got a lowest score of 79 and a Carcassonne + Diplomacy