I decided to put the whole project on hold and said to myself: 'maybe one day there will be better time for this.'įast-forward to 2021. Not easy if you already have a full-time job and other stuff going on in your life.

Which meant I had to find some time to learn it. Secondly, when I envisioned deploying AlphaZero in the browser I had zero knowledge of web development and frontend in general. I had to figure out much cheaper way to develop interestingly good AI under my personal budget. One of the key factors enabling AlphaZero success is massive computing power (5000 TPU v1 for self-play and 64 TPU v2 for training). It is difficult setup for a side-project. The average number of legal actions per position is somewhere around 7 (my estimate from self-play data). The average length for UTTT game is somewhere between 40 and 50 plies. There were two major problems that essentially made me forget about this project for a long time.įirstly, although Ultimate Tic-Tac-Toe (UTTT) looks easier than Chess or Go, it is still quite a challenging game. After a few weeks of work I realized it's not going to be an easy ride. I discovered Ultimate Tic-Tac-Toe and implemented AlphaZero in early 2018. Probably because I love simple and elegant engineering solutions and AlphaZero is mostly about that. I had read previous papers, but it was AlphaZero specifically that sparked my imagination. In AlphaZero paper Deepmind generalizes previous work so that AI can learn through self-play not only how to master Go, but also Chess and Shogi. Reading scientific papers gave me plenty of ideas, but only after I read AlphaZero preprint I knew: this is it!ĪlphaZero is a third paper in AlphaGo, AlphaGo Zero, AlphaZero, MuZero sequence. Įver since I started working in Machine Learning 5 years ago, I have always wanted to do some cool project for my portfolio. Tl dr I developed AI solution (MCTS + NN) inspired by AlphaZero for playing Ultimate Tic-Tac-Toe game in the browser. Metacademy is a great resource which compiles lesson plans on popular machine learning topics.įor Beginner questions please try /r/LearnMachineLearning, /r/MLQuestions or įor career related questions, visit /r/cscareerquestions/ Please have a look at our FAQ and Link-Collection

Rules For Posts + Research + Discussion + Project + News on Twitter Chat with us on Slack Beginners:

Tic-tac-my-toes reddit