Getting an app to work has stopped being the hard part. You describe what you want, Lovable or Bolt or v0 builds it, and forty minutes later there's something on a real URL that real people can click.
The hard part moved. It's now everything between "it works" and "it survives contact with the internet."
That gap isn't a vibe. It's measurable. Symbiotic Security crawled 65,643 URLs and fully scanned 1,072 Supabase-backed vibe-coded apps in June 2026: 98% had at least one security issue, 16% had something critical. A separate academic study by Deng et al. found that vibe-coded apps show recurring vulnerability patterns that differ from the ones traditional codebases produce — meaning these aren't random mistakes, they're structural. And an Xint.io analysis reported by SecurityWeek turned up 434 exploitable flaws concentrated in secrets exposure, broken authorization and denial of service.
Same handful of failure modes, over and over. Which is good news, because it means you can check for them in about fifteen minutes.
Below is the list I actually walk through. Everything here you can run against your own domain with curl and browser devtools. No tooling required.
1. Is your .env reachable over HTTP?
The single most common catastrophic finding. It happens when the build output directory and the project root end up being the same thing.
curl -sI https://yourapp.com/.env | head -1
curl -sI https://yourapp.com/.env.local | head -1
curl -sI https://yourapp.com/.env.production | head -1
Enter fullscreen mode Exit fullscreen mode
Anything other than 404 is an emergency. Rotate every key in that file before you do anything else — assume it's already been scraped, because bots hit these paths constantly.
2. Is your .git directory exposed?
Worse than .env, because it hands over your entire history including keys you thought you'd removed.
curl -sI https://yourapp.com/.git/HEAD | head -1
curl -s https://yourapp.com/.git/config
Enter fullscreen mode Exit fullscreen mode
If HEAD returns 200, the whole repository is reconstructable by a stranger.
3. Which keys are sitting in your client bundle?
Open devtools, go to Sources, and search across all files. You're looking for sk-, service_role, SECRET, PRIVATE_KEY, and long strings starting with eyJ (those are JWTs).
The nuance that trips people up: a Supabase anon key in the browser is fine by design. A service_role key is not — it bypasses row-level security entirely. AI assistants confuse the two constantly, because both are "the Supabase key" from the prompt's point of view.
4. Is row-level security actually on?
Having an anon key in the browser is only safe if RLS is enabled on every table. Default-off is the trap. Go through your tables one by one and confirm policies exist. "I'll add policies later" is how the 16% happens.
5. Security headers
curl -sI https://yourapp.com | grep -iE 'content-security-policy|strict-transport-security|x-frame-options|x-content-type-options|referrer-policy|permissions-policy'
Enter fullscreen mode Exit fullscreen mode
Most vibe-coded deploys return none of these. The two that matter most immediately are Content-Security-Policy (or at minimum frame-ancestors) to stop clickjacking, and Strict-Transport-Security so a downgrade attack can't strip your TLS.
6. Published source maps
curl -sI https://yourapp.com/_next/static/chunks/main.js.map | head -1
Enter fullscreen mode Exit fullscreen mode
Source maps in production hand attackers your original, readable source — comments, internal function names, dead code paths and all. Turn them off in your build config, or restrict them to authenticated access.
7. Debug leftovers and orphan routes
Grep your own bundle for console.log and check whether anything sensitive is being printed on page load. Then try the routes nobody meant to ship: /api/debug, /api/test, /admin, /api/seed. AI-generated scaffolding loves to leave these behind, unauthenticated.
8. Rate limiting on auth and API endpoints
Almost never present unless explicitly asked for. Without it, your login endpoint is a free credential-stuffing target and your LLM-backed API route is somebody else's free inference budget. Check whether your host gives you rate limiting at the edge — often it's a config flag you just haven't flipped.
9. Error messages that leak
Trigger a failure deliberately: malformed JSON to a POST endpoint, a bad ID in a path parameter. If you get back a stack trace, a file path, or an ORM error naming your tables and columns, that's free reconnaissance for anyone probing you.
10. Untouched boilerplate
curl -s https://yourapp.com | grep -iE '<title>|og:image|og:description'
Enter fullscreen mode Exit fullscreen mode
If it still says "Create Next App", or there's no Open Graph image, you're broadcasting that nobody reviewed this. It's not a vulnerability, but it changes how everything else about your product gets judged — including by the security researcher deciding whether you're worth poking at.
11. Trackers firing before consent
Open the Network tab, hard-reload, and watch what leaves the page before you've clicked anything. If Google Analytics, Meta Pixel or a session recorder fires on load, you have a consent problem in the EU — and a "we didn't know it was there" problem generally, because AI-generated templates ship with analytics snippets baked in.
Related and easy to miss: Google Fonts loaded at runtime from Google's CDN transmits visitor IP addresses to a third country. A German court ruled on exactly this in 2022 and it kicked off a wave of warning letters. Self-host your fonts. It's faster anyway.
12. Imprint and privacy policy
If you have users in Germany or Austria, an imprint is a legal requirement, not a nice-to-have, and the privacy policy has to actually describe what you're collecting. This is the check that costs nothing and gets skipped the most, because it's boring and nobody's prompt asked for it.
The fifteen-minute version
DOMAIN="https://yourapp.com"
for path in /.env /.env.local /.env.production /.git/HEAD /.git/config \
/api/debug /api/test /admin; do
code=$(curl -s -o /dev/null -w "%{http_code}" "$DOMAIN$path")
echo "$code $path"
done
echo "--- headers ---"
curl -sI "$DOMAIN" | grep -iE 'content-security-policy|strict-transport-security|x-frame-options|x-content-type-options|referrer-policy'
Enter fullscreen mode Exit fullscreen mode
Every 200 in that first block is a finding. Every missing header in the second block is a gap. Run it against your own domain only — this is a self-audit, not a scanner to point at other people's sites.
What to do with the results
Sort into three buckets and be honest about which one you're in.
Exposed secrets, an open .git, or a service_role key in the bundle means stop. Rotate keys, fix, redeploy, and don't announce anything until it's clean.
Missing headers, source maps, debug routes and boilerplate metadata mean iterate — real issues, fixable in an afternoon, not reasons to delay a soft launch to a small audience.
Everything clean means go, with the caveat that this is a point-in-time snapshot. The next AI-generated feature can reintroduce any of it, so re-run before each meaningful deploy.
Disclosure: I work at decivo, where we do exactly this kind of review for teams shipping AI-built products. We wrapped the outside-in portion of this checklist into a free scan called Vibe Code Rescue — you paste a URL, it runs the external checks and gives you a Go / Iterate / Stop verdict. No signup, no code access, nothing stored. The manual checklist above covers the same ground if you'd rather do it yourself, which is genuinely fine by me.
0 Comments
Log in to join the conversation.No comments yet. Be the first to share your thoughts.