Urgent.News

What's breaking now, across hundreds of outlets.

Tech

Vibe coding testing: check your app before users do

Originally published at pantheontable.com/blog/vibe-coding-testing-check-your-app-before-users-do Andrej Karpathy vibe coded a website and felt 80% done. By his own account, it was a bit closer to 20%. If you built an app with an AI tool and it seems to work when you click through it, this is for you. Below is what Karpathy, David Heinemeier Hansson, John Carmack, Joel Spolsky, Simon Willison,…

Andrej Karpathy, a computing expert, built a website using an AI tool and felt it was 80% complete. However, he later realized it was closer to 20% done. He advises that clicking around only verifies paths you have tried, so AI testing involves giving the AI a way to run tests and using the app as a customer would. It is crucial to ask the AI to write tests for core actions, show the command and output, and have a fresh review session.

Test every change on a preview copy before deployment and collect user errors to know when something breaks. Clicking through the app is insufficient; you must test for empty forms, double clicks, weak connections, and second accounts. Karpathy warns that clicking through gives a false sense of completion, and AI tools are good at simple tasks but struggle with complex system integrity.

To check AI-written code, provide a way to know if it succeeded, like a test file, build, linter, or screenshot. The AI should explain the code and run the tests, providing exact commands and outputs. Non-developers should seek expert opinions to validate AI output.

Rewritten by urgent.news; may contain errors — check the original.

Read the original at dev.to →

Report a problem with this story

More in Tech

Fauji Foods Appoints New CEO

Fauji Foods Limited has appointed Haseebullah Zahur as its chief executive officer, effective January 1, 2027, according to a filing … Read More The post Fauji Foods Appoints New CEO appeared first on…

WWW-Authenticate challenge order is security policy

WWW-Authenticate challenge order is security policy An HTTP 401 response tells a client that authentication is required. The WWW-Authenticate header tells it which schemes the server accepts.

  • HTTP servers' challenge order impacts security.
  • RFC 9110 mandates at least one challenge in 401 response.
  • Basic auth should be scoped, not broadly advertised.

Why your yt-dlp cookies stop working after a day

The fix everyone gives for yt-dlp's "Sign in to confirm you're not a bot" is to pass your YouTube cookies. It works. Then a day or two later the same error is back, with the same cookies.txt, and…

  • YouTube rotates session cookies frequently.
  • Exporting cookies from active browser results in stale session.
  • Use private/incognito window to sign in and export cookies.

More from Saturday 21 November →