In the event you’ve seen your favourite illustrator all of a sudden vanish from Instagram, or that one mother or father buddy quietly scrubbing each photograph of their child from Fb, you’re not imagining it. In the previous few years, individuals have eliminated content material from the net over considerations about generative AI.
That may seem like a whole lot of various things: artists pulling their portfolios offline after discovering AI fashions spitting out work in their very own fashion, dad and mom deleting household photographs over fears their children’ faces may find yourself in a deepfake, or companies blocking AI crawlers from accessing their web site fully.
Based mostly on an evaluation of DreamHost clients, we discovered that roughly 5,000 whole web sites utilizing our internet hosting companies are actively blocking some or all AI net crawlers.
In different phrases, there’s an actual and measurable concern about how AI instruments entry, perceive, and ingest the content material all of us put on-line.
It’s not that these worries are new.
The web has at all times been a messy place for consent, privateness, and possession. What’s modified is that AI has compelled everybody: creators, households, and small enterprise house owners alike, to lastly confront simply how little management they’ve over what they put on-line.
At DreamHost, we’ve at all times believed the open net thrives when creators management what they share and the way it’s used. The online works greatest when possession sits with the individuals who constructed it — not simply the platforms that revenue from it.
And that brings us to the center of the matter. The actual query isn’t what AI can do — it’s who will get to resolve.
The Actual AI Ethics Drawback Isn’t the Tech — It’s the Lack of Selection
AI isn’t the villain right here. The actual menace is “platform paternalism,” or firms that make “moral” selections on behalf of everybody else. For instance, in 2024, a number of main content material supply networks (CDNs) and community suppliers started blocking AI crawlers by default, claiming their purpose was to “shield creators.” The consequence was tens of millions of website house owners woke as much as discover selections about their content material already made for them.
It’s like your landlord locking your door for your security, however with out providing you with the appropriate keys. So what began as a comfort rapidly turns right into a lack of company. When gatekeepers resolve what “safety” seems to be like, particular person autonomy shrinks.
The open net was constructed on permissionless innovation, that means anybody may create, share, and iterate with out asking for approval. Intermediaries deciding which bots or instruments can entry content material could rewind that freedom by a long time.
That’s why DreamHost advocates for infrastructure independence: while you host your personal content material, nobody can rewrite your guidelines. Proudly owning your stack means proudly owning your insurance policies, whether or not you welcome AI crawlers or shut them out fully. The ethics don’t come from code; they arrive from selection.
“AI Wants Your Knowledge” and Different Myths
So what retains creators from reclaiming management? Oftentimes, misinformation, like these pervasive myths surrounding AI. These myths are standard as a result of AI use has proliferated across the web and the instruments we use on daily basis.
Fable #1: “AI Wants Your Knowledge To Progress”
Nobody owes for-profit AI firms their work. Licensed and consent-based fashions exist; for instance, Adobe Firefly trains licensed content material with permission and public area works with out copyright. The way forward for AI doesn’t have to rely upon stealing. It could possibly rely upon consent as a substitute.
Fable #2: “If You Choose Out, You’ll Disappear”
Opting out could restrict your look in AI-generated summaries or search snippets, but it surely received’t erase you from the net. Consider it like opting out of Google in 2005. You’d lose attain, not relevance, particularly in case your viewers nonetheless seeks you immediately.
Whereas it is probably not sensible for anybody who depends upon attain to develop their viewers or buyer base (although we nonetheless don’t have nice information on how a lot natural visitors truly comes from GEO), for some creators, visibility isn’t value involuntary use. The hot button is that they get to resolve.
Fable #3: “AI Scraping Is Simply How the Web Works”
Indexing for discovery and appropriating for coaching aren’t the identical factor.

Indexing drives individuals to your website. Coaching replaces you with a statistical copy. Publishers just like the Related Press and Axel Springer are proving there’s a center floor by licensing their content material for mannequin coaching with credit score and compensation.
Even good intentions can backfire. The underside line is that balanced ethics require knowledgeable consent.
Opting Out vs. Staying Open: The Actual Commerce-Offs
Each AI stance — from full openness to whole opt-out — comes with actual alternative prices. Deciding the place you stand depends upon what you worth most, from visibility to manage to sustainability to autonomy.
DreamHost’s inner information exhibits that about 71.5% of all net visitors now comes from bots, not people. Which means many of the requests hitting your website are automated: some helpful (like search indexing or uptime monitoring), others much less so. Managing which crawlers you enable and which you block is moral sustainability in motion.
Beneath are 4 widespread approaches creators take to AI entry and coaching and the way every impacts totally different open net elements, so you possibly can visualize the trade-offs earlier than locking in your stance.
| Absolutely Open | Selective Licensing | Block AI Coaching | Absolutely Opted Out of AI | |
| Visibility and Attain | Highest; AI summaries and search engines like google and yahoo can floor your work in all places. | Reasonable; publicity restricted to companions who license content material. | Low; excluded from AI outcomes however nonetheless seems in conventional search. | None; blocked from each AI and lots of discovery crawlers. |
| Management and Consent | Minimal; platforms resolve for you. | Excessive; ruled by specific licensing phrases. | Robust; you outline permissions by way of robots.txt and HTTP headers. | Absolute; all automated entry is prohibited. |
| Attribution | Low; most AI fashions don’t cite sources. | Excessive; attribution and royalties constructed into contracts. | Medium; compliant crawlers should credit score you. | None; content material is rarely referenced. |
| Environmental Impression | Reasonable; contributes to broad mannequin coaching and indexing load. | Reasonable; restricted, licensed use reduces duplicate coaching. | Reasonable-low; fewer heavy crawlers, extra focused visitors. | Low; least exterior requests and information transfers. |
| Threat of Misuse or Copying | Excessive; fashion or textual content could also be replicated freely. | Reasonable; authorized recourse by way of license phrases. | Low; compliant bots deterred, rogue bots nonetheless attainable. | Very low; minimal floor space to scrape. |
Every path has advantage. Entrepreneurs and small enterprise house owners typically rely upon visibility to develop their audiences, whereas illustrators, journalists, and educators could prioritize possession and consent above all else. The online thrives on range, and moral AI participation ought to replicate that range of targets.
There’s no common proper reply: solely knowledgeable trade-offs that align together with your rules and the way you earn a dwelling on-line. The correct stance isn’t one-size-fits-all, however it is best to kind your stance consciously, and again it up with motion. No matter path you select, make it intentional.
How To Resolve Your AI Stance
Ethics solely matter once they’re practiced. Right here’s learn how to flip principle into motion and outline how AI interacts together with your work.
Step 1: Make clear Your Targets
Begin by rating what issues most to you: visibility, income, sustainability, management.
A small enterprise chasing attain could tolerate broader AI use, whereas an illustrator guarding originality could not. Completely different targets = totally different boundaries.

Listing the place your content material lives: WordPress websites, GitHub repos, social media, cloud storage. Platforms apply their very own AI insurance policies, so internet hosting independence provides you the liberty to set guidelines per website as a substitute of accepting blanket defaults set by the platforms you utilize (with out your enter).
Step 3: Apply Technical Controls
Use your robots.txt file to sign AI bots learn how to behave:
Person-agent: GPTBot |
Add headers (like X-Robots-Tag: noai, noimageai) for additional readability. Simply keep in mind, compliance is voluntary. These tags sign your needs, however they don’t implement them.
Step 4: Publish a Clear AI Coverage
Create a easy web page stating your place. For instance:
| “AI techniques could not use this content material for coaching or replication.” |
Transparency builds belief with purchasers and units clear boundaries for future use.
Step 5: Monitor and Adapt
Use server logs or analytics to trace your bot combine. Assessment quarterly and replace your guidelines as new crawlers emerge.
The Solely AI Ethics That Matter Are Your Personal
AI doesn’t have ethics — individuals do. What issues isn’t whether or not you blocked each crawler or embraced each instrument; it’s that you just made these selections on goal.
The online was constructed on freedom to share, remix, experiment, and construct with out permission. True digital ethics protects that very same spirit of self-determination.
You’ve moved from concern to manage, from uncertainty to possession. At DreamHost, we consider proudly owning your digital presence isn’t simply good enterprise, it’s how you retain your ethics intact in a world run by algorithms.
The open net stays yours, if you happen to select to personal it.
Did you take pleasure in this text?









