ASMR Programming - Coding Snake A.I. - No Talking

Servet Gulnaroglu
Servet Gulnaroglu
73.2 هزار بار بازدید - 2 سال پیش - Hello my dear coders, Hope
Hello my dear coders,
Hope you like the video. It was my first reinforcement learning experience. I must say it wasn't easy.

My best score was 66, as in the video. I want you to mention your highest scores in the comments, with alpha and gamma values.

This code may be enhanced by adding more states to the RLSnake function. The snake fails when it gets trapped by itself. So we need to add a state that if the snake is in a trap or not.

Please, like and subscribe!
Enjoy and safe coding :)

Twitter: Twitter: gulnaroglus

👨‍💻👨‍💻👨‍💻👨‍💻👨‍💻👨‍💻👨‍💻👨‍💻👨‍💻👨‍💻👨‍💻👨‍💻👨‍💻👨‍💻👨‍💻
Source code : https://github.com/servetgulnaroglu/s...
Live a star on github, if you enjoy!
👨‍💻👨‍💻👨‍💻👨‍💻👨‍💻👨‍💻👨‍💻👨‍💻👨‍💻👨‍💻👨‍💻👨‍💻👨‍💻👨‍💻👨‍💻


📦📦📦📦📦📦📦📦📦📦📦📦📦📦📦
All the products in this video

⌨️  Keyboard: IQUnix OG80 Wormhole TTC ACE switches and Costar Stabilizers (5% discount)
https://iqunix.store/servetgulnaroglu

🖱️ Microsoft Bluetooth Mouse
https://amzn.to/3R4904L

🖥️ Monitor Asus MX239:
https://amzn.to/3dulF3k

🖥️ Monitor Dell 34 Curved Monitor - S3422DW:
https://amzn.to/3BEgmGw

💻 2021 Apple MacBook Pro (14", Chip Apple M1 Pro con CPU 10-core e GPU 16‑core, 16GB RAM, 1TB SSD)
https://amzn.to/3DHAKJn

🎤 Rode NTG4+ Shotgun Microphone
https://amzn.to/3LxXcGS

🪵 IOTXY Solid Wood Writing Desk
https://amzn.to/3qWOQiB

🪑 IWMH Ergonomic Office Chair
https://amzn.to/3DMPM0l
📦📦📦📦📦📦📦📦📦📦📦📦📦📦📦



00:00 Previously
00:48 Today
01:00 Running live-server
01:26 Fixing letter issue left from other video
01:48 Adjustments on the code
06:07 Adding highScore div
07:04 highScore logic  
10:02 Adding averageScore & epochNumber div
11:01 epochNumber & averageScore logic
12:10 Coding Reinforcement Learning AI class
15:07 RLSnake.checkDirections()
24:26 RLSnake.calculateState()
24:42 RLSnake.update()
25:04 RLSnake.reward()
28:20 RLSnake.getQ()
28:47 RLSnake.setQ()
29:20 RLSnake.getAction()
32:25 RLSnake.implementAction()
34:08 Creating an instance of RLSnake
35:09 Handling some errors
36:05 Detecting some issues
38:13 It works!
39:10 Creating gamma and alpha inputs
42:57 Results when alpha=0.1 and gamma=0.1
44:05 Results when alpha=0.2 and gamma=0.2
44:45 Endless loop when we set gamma=0.5
46:15 Results when alpha=0.2 and gamma=0.1
47:34 Realizing a huge mistake
48:30 It works like a charm
49:19 Watching in slow motion (we got highest score)
50:10 Testing with various values
2 سال پیش در تاریخ 1401/06/13 منتشر شده است.
73,208 بـار بازدید شده
... بیشتر