AI Coding Comparison Challenge. 4 AIs build an HTTP Server in Python. See how they do.
33.3 هزار بار بازدید -
2 هفته پیش
-
Company provided demo videos are
Company provided demo videos are awful, and I'm tired of them lying, glossing over errors and hiding what the AIs got wrong.
So I made my own. The full, unredacted video is at • Raw video comparing 4 AIs. Watch the... where you can watch everything each AI did right and wrong.
This video is a summarization of what happened, what I learned, what the different AIs did well or did poorly, who "won" and what recommendations I have based on these results.
If you want to learn more about how Internet Software works, sharpen your skills, and have some fun, you can use this link: iob.fyi/CodeCrafters to sign up for CodeCrafters free and if you do decide to upgrade later, you'll get 40% off.
00:00 Why this AI demo video is different
02:24 The competitors
03:13 Caveat: Current Point in Time. Current versions of products Sept 2024
03:33 The Challenge
06:27 Problem One: "200 OK"
07:43 Problem Two: "404 Not Found"
09:33 Problem Three: Echo/Request Body
10:30 Summary So Far
11:25 Problem Four: User-Agent/Headers
13:02 Problem Five: Adding a Loop
13:15 Problem Six: Returning a File
14:10 Discussion of Results
15:14 Recommendations
15:19 Observations on Companies
16:19 Thanks to CodeCrafters.io for the playing field
16:34 Closing
My video on Software Testing in an AI world, mentioned in this video: • How Testing Software will need to cha...
My video on Devin's Upwork demo: • Debunking Devin: "First AI Software E...
My video on the Claude 3.5 Sonnet coding demo: • AI Coding Crap: More Examples. Claude...
2 هفته پیش
در تاریخ 1403/06/16 منتشر شده
است.
33,371
بـار بازدید شده