| Ask HN: Add flag for AI-generated articles | ||
| 199 points by levkk 2 hours ago | hide | past | favorite | 131 comments | ||
Should HN add the ability to flag articles as AI-generated? This doesn't have to act as a regular flag, i.e., it won't de-rank the article; it could just show up as an indicator, allowing others (like myself) who don't like reading AI-generated text, to skip it. Open questions: 1. Why is the regular voting system not enough? 2. Should HN change in response to the gen AI era? It has been successful not changing fundamentals. | ||
| help |
We don't allow genai text on HN itself - see https://news.ycombinator.com/newsguidelines.html#generated and https://news.ycombinator.com/item?id=47340079. How to enforce it is a separate question, of course, but the rule exists. We don't have a similar rule yet about article content but my sense is that the community mostly doesn't want to read it—or, to put it more conservatively, discounts it. This is why we see so many "just show me the prompt" responses, along with others like this: https://news.ycombinator.com/genai-pushback. I built that list so I have something to send to users who email about why their genai articles got flagged. It's a fascinating arms race right now: the AIs are training on the humans but the human hivemind is also training on the AIs. Readers are developing allergic sensitivities to language that sounds like an LLM produced it. The AIs will adapt to this, but the humans will adapt in turn. Where it ends up is anyone's guess. I have an optimistic view, but I've already been wrong about this so many times that I have low confidence in it. The current picture is that there is an emerging class distinction between writing (and writers) that use genai vs. writing that does not. As soon as the "this sounds like an LLM" allergy kicks in, the writing instantly gets relegated to a low-status bucket in the reader's mind. That doesn't mean it won't still get looked at - but it is now under a stigma. (I was rather pleased with the originality of this until I remembered pg had come up with "writes and write-nots" in https://paulgraham.com/writes.html. Oh well, it's the point that matters.) This has the happy flipside that anyone who would like readers to classify their article as high-status rather than low-status can apply the judo move of simply writing it themselves. Now I need to add the disclaimer that none of this is a dismissal of LLM technology per se. We rely on it heavily, and there's no question that it's useful. The question is how to use it (pg again: https://x.com/paulg/status/2058871512451412457) and whether one should use it on writing that one publishes to other humans. To turn to OP's questions: > Should HN add the ability to flag articles as AI-generated? [...] it could just show up as an indicator Flagging-as-just-an-indicator would be tagging, which we've always resisted adding to HN, but I wouldn't rule it out. What I do think we'll (finally) add is a "please give a reason why you flagged this post" step, and "because I think it's genai" will be one choice among several (spam, offtopic, mean, etc.) > Why is the regular voting system not enough? The regular voting system is never enough. https://hn.algolia.com/?dateRange=all&page=0&prefix=false&so... > Should HN change in response to the gen AI era? To this I am tempted to reply with https://news.ycombinator.com/item?id=48887149 in an homage to https://news.ycombinator.com/item?id=3742902. |
> The AIs will adapt to this I don't think this is true, at least not right now, and in a way I'm actually thankful for it. The frantic rush to chase the only potentially profitable use case for LLMs found so far (writing code) and the resulting focus on coding RLHF means models are actively becoming worse at sounding like humans. This is my favorite example, and it's already relatively outdated: https://progress.openai.com/?prompt=10 |
As opposed to wonderful old HN, where about 95% of the front page is now AI, AI-related, or AI-generated. |
It's sometimes used that way, sometimes a fact, and sometimes both. It's all unclear because we're still in the early stages of this working itself out. |
Why would humans ever be trained to talk like an AI? If they are working in some capacity where there is strong incentive to write llm-slop adjacent content, might as well use the llm slop generator. |
'humans trained to talk like an AI' is just LinkedIn and I would hope that the last thing anyone wants is for HN to become the utter void that is LinkedIn posts. |
It breaks a central goal of HN, which is a non-siloed experience where the entire community is exposed to the same feed. |
Out of curiosity I looked through your post history to find an example of a time you got downvoted for calling out AI comments. The first one I could find was 3 months ago (https://news.ycombinator.com/item?id=47493096), where you got downvoted for calling out an AI comment...to a comment that had zero common signs of AI writing. The OP then replied: > Not AI. Not sure how I feel getting my writing style called out like that though :D |
That isn't related to my comment? My comment is more criticizing accusing something of being AI based on vibes, and likely being wrong about it. |
You could just ask your AI to flag it with an extension, or rewrite it in a style you prefer (or just do a good job summarizing the articles core meaning). |
I am exclusively interested in the remaining 5% that is not AI slop, so yes, I always want to see that information. |
Why do we need anything more than good/bad? If there is a great post on a topic and the author used AI when generating it, what’s so bad about that? |
Take any existing article you find insightful and then ask an LLM to "rewrite it, but make better and more engaging". The result is likely "good + slop", assuming the actual content is preserved. |
A good link aggregator should strive to select the <1% of articles that are actually high quality. Who cares what “everyone” is doing? |
Considering YC invests in AI I doubt you’ll get anything of the sort. Too many people here also think you just have to give in and accept (abuser mentality IMO). |
> Considering YC invests in AI I doubt you’ll get anything of the sort. Conspiracy minded responses are low value, and yours is especially so considering HN bans AI comments. |
Being carelessly overzealous with flags/blocking is a reliable way to kill a community by making it overly toxic, speaking from experience. |
> I am skeptical YC frequency of "AI" related content is representative of actual users interest. Are you implying the front page is botted/manipulated? |
No I actually want to avoid AI generated content even when it is gold. I don’t want it. I dislike it. I hate it. Fuck AI. |
>increasingly I lean towards communities where that is a given for any legitimate shares. I have a hard time finding these communities |
A problem I see is that what someone may consider to be AI-generated actually isn't. And the AI checkers aren't reliable enough to definitely enough say something is AI-generated. |
Yup, and calling out a human-written article as AI-generated would be a serious insult. AI-flagging would incur bigger damage to the community than just having AI-generated contents around. |
If something like this was implemented, the benefit of the doubt would have to be given in ambiguous cases, but I don't think it's that hard to tell most of the time. The latest codemaxxed models all tend to write in very distinct, instantly recognizable ways unless carefully instructed otherwise (honestly a good thing if you want to avoid wasting time reading AI text). A great example is this submission that's currently #1 on the front page (which is also just a thinly veiled advertisement): https://news.ycombinator.com/item?id=48884853 |
Even if you did, how would you even enforce it? Say it was a pure text article, do you count the number of em dashes? Even AI detection scanners purpose built for this are extremely faulty. |
Do the guidelines even matter if they're not enforced? This place is drowning in AI shovelware submissions from accounts that are only used for self promotion. |
Hn rarely allows people to downvote,only after you become an active member for many years And im sure this was designed in order to encourage positive discussion |
This could be a false memory, but I think it’s the idea that the submission downvotes should be reserved for things that break the rules, and in that case, the post should be flagged instead. |
As for the ability to downvote comments, my understanding is that the only requirement is having at least 500 karma. |
Nope, AI writing itself is the problem for me. I don’t care if it is gold. If it is AI, I don’t want it. Same like kosher or vegetarian labels. Label it. |
Sounds like a good job for AI. Why should humans have to waste their time on it? Accounts that post any should just get banned and deleted. |
There absolutely needs to be stigma surrounding LLM generated work that is masquerading as creativity. AI slop is AI slop. |
Yup. Just like vegetarian and kosher and halal. Fuck your meat, I don’t care about how good it is, and fuck your AI, I don’t care how good it is. |
> why is the regular voting system not enough Voting systems can be gamed and as HN becomes bigger and bigger it'll start to attract unsavory audiences who have an agenda. |
0 Comments
Log in to join the conversation.No comments yet. Be the first to share your thoughts.