Wolfpeach - "Why You Should Avoid Generative AI"

Why You Should Avoid Generative AI


I lurk a bit on Reddit's Pagan and Witch forums, and today I saw something... disconcerting.

Somebody posted a couple of images from a set of artwork they had purchased for scrapbooking. Not wanting to use something with text they didn't understand, they posted to a couple Witch-related pages to ask for a translation. These are the pictures they posted:

A Reddit post from R Pagan with a caption asking Is anyone able to translate this language or what these letters mean? There are two pictures of stickers. The first has an image of a Witch surrounded by plants, with lettering that looks roughly like it says Weliinne WuceeN with some gibberish underneath. The second has a Witch wearing a hat with grapes and roses on it, with a caption that says SHEHT HHCAHC.

You probably already know what the problem is, it's in the title after all: There is nothing to translate. The text is gibberish that was spat out of an AI image generator. People quickly pointed this out, but were quick to add "...but you know, it's still cute though."

AI is a problem. OK, I'm not saying every use of AI is bad--I'm not going to tell you that you can't use it to put together a shopping list or break down your chores into smaller chores--but generative AI used to create "art" and "literature," or even to provide factual information, has created serious issues, not only for artists and writers who are having their work plagiarized and their livelihood threatened, but for people looking for accurate, credible information. And although it's a widespread problem that affects everyone, I am particularly concerned about how this affects the Pagan and Witch community, for a variety of reasons I'm going to talk about today.

AI is going to make our already-existing problem of poor scholarship way, way worse.

I am very eclectic in my practice. I understand that my magical ancestors--the ones who practiced folk magic, who stuck with "superstitious" traditions, the weird Catholics lighting candles and burying statues in the front yard to try selling their houses, all the way back to the ones painting plump animals with tallow and blood in caves--did not stick with one specific cultural practice. They adapted to changing technology by innovating new ways of using magic. Many Witches--including myself--continue to do it this way, and many of us start doing things a certain way and then completely forget why we ever started doing it that way to begin with.

This causes a lot of problems. I started practicing Witchcraft as a literal child based on information I found on the Internet in the late 1990s, and a lot of the things I did at this time became codified in my brain as just "how you do things" that later turned out to be, well... kind of nonsense. As a 12 year old with no prior experience with Witchcraft, some of the things I learned to do were literally just sarcastic jokes Witches wrote at the expense of other Witches that I didn't get because of my lack of experience. So I was this 12 year old who had a binder full of information printed off websites, including "Ancient Egyptian Love Spell: Place a photograph of him under your pillow" and a "How to create a craft name" guide that was just a joke about Silver Ravenwolf and people who followed her work. Recently somebody developed a fake Kabbalah circle meaning "tomato soup" to make a point about cultural appropriation and using symbols you don't understand, which a lot of people did in fact take seriously.

This sort of thing is not limited to 12 year olds' Trapper Keepers and Kabbalah appropriators, either. It is not uncommon to find things in Pagan, Wiccan, and Witchcraft books that are completely uncited and don't make any sense. If you've ever read the commonplace piece of advice that you can substitute rosemary for any other herb in any spell, I'm like 99% certain this proliferated because Scott Cunningham wrote it in a book, where it was published as a fact with no context, citation, or reason. Somebody then put that on the Internet, and it became copied and copied and copied to the point where a lot of people just take it as common knowledge. To this day I've been trying to track down where this advice originally came from, and so far I have found nothing before that Scott Cunningham book. It's just a completely context-less piece of advice with no rhyme or reason at all that everybody just hears at some point and takes at face value.

But here's the thing: Despite my own personal problems with these incidents, all of these are actual practices people do. It is common (and in fact not really a big deal) for people to generate "Silver-Ravenwolf-like" craft names, or to use photographs under a pillow as a spell, or to replace any missing herbs with rosemary, even if I don't personally do those things, even if I wish I knew where those ideas originally came from. We learn them because people do them. Even the fake Kabbalah symbols were not just random aimless dreaming by an AI... they are a social experiment that proves an important point about appropriation, that was developed and done by humans.

AI content does all of the shitty parts of this process with none of the redeeming qualities or even childish innocence. And we're being piled with it right now. People are using AI to generate "artwork" that people are buying and using to decorate their Books of Shadows, thinking the symbols are some esoteric magical language when they're just gibberish. People are using AI to generate books based on the work of actual Pagan and Witch authors, and then publishing them to Amazon to make quick money without doing any real work. Not only are these books plagiarizing actual Pagan and Witch authors, the AI models do not understand these subjects... they're just stringing together a bunch of words that seem like they'd go together based on the works it was trained on. Guardian article "The stupidity of AI," by James Bridle, says the following:

[AI is] inherently stupid. It has read most of the internet, and it knows what human language is supposed to sound like, but it has no relation to reality whatsoever. It is dreaming sentences that sound about right, and listening to it talk is frankly about as interesting as listening to someone’s dreams. It is very good at producing what sounds like sense, and best of all at producing cliche and banality, which has composed the majority of its diet, but it remains incapable of relating meaningfully to the world as it actually is.

He goes on to say:

The belief in this kind of AI as actually knowledgeable or meaningful is actively dangerous. It risks poisoning the well of collective thought, and of our ability to think at all.

Essentially, AI misinterprets facts and often just makes up its own facts based on things like expected word order. As Pagans, we are particularly at risk for this sort of thing, because so much Pagan spirituality relies on unverified personal gnosis. For instance, I can tell you that I will use tomato leaves, flowers, roots, and fruit for almost any magical purpose, and that is absolutely correct! It's because I have a personal spiritual relationship with that plant. Most Pagans reading this in context will understand that this does not mean that tomatoes are actually a good plant to use for every magical purpose, it just means that if you work a lot with a particular plant you have a strong affinity with, it will open opportunities for you to do more work involving that plant than just what you'd find in a typical correspondences list. An AI model attempting to relay and reword information based on things I've written may very well spit back that, hey, tomatoes are a good plant to use in magic for literally anything, without any of that needed context, because that AI is not experiencing anything and has in fact worked with zero plants at all.

Imagine that, but instead of just one little slip-up, it's what the entire book is built on. That's what these AI generated books are, and if we aren't vigilant, it will completely scramble up Pagan and Witch knowledge.

The reality is that AI is not good at the things people are using it for. AI has alreaedy recommended ant poison sandwiches, bleach cocktails, toothpaste beef pasta, and drinking methanol. It has also suggested foraging for deadly plants and eating them. On a less-deadly level, right now Pinterest is full of AI-generated knit and crochet patterns that result in yarn abominations that look nothing like the picture, because AI does not know how to knit or crochet, it just knows how to make something that looks vaguely like a knit or crochet pattern, and there are loads of fake recipes with fake photographs of food that looks interesting and beautiful but does not actually exist. With this kind of complete nonsense already going on, can you trust an AI to make something like an incense blend or herbal remedy for a Pagan book? You cannot, but that's the world we're rapidly moving into right now.

Something that happened while I was writing this: Google decided to completely obliterate the usefullness of its search by adding AI features to it. Immediately it started churning out bullshit, sometimes dangerous information. Google's AI got a lot of training from Reddit, where a lot of responses are sarcastic shitposts, so it was telling people to use white glue to stick cheese to pizza, to stare at the sun for up to 30 minutes, and to smoke 2-3 cigarettes a day while pregnant. If it's this bad for information everyone knows is important, how much quality control do you think it has for magical advice? I mean, when I was like 14, I frequented a Pagan forum where I proudly talked about how I made black salt using acrylic paint. People in the forums immediately told me that was a bad idea, but my original post was still up for years, and had it been on Reddit, there's a very high chance if anybody asked about black salt for magical purposes their stupid AI answer bot would have been telling people to mix acrylic paint into table salt to make it, all because of one dipshit confused teenager. Ugh!

Using AI to generate sigils, deity images, and other symbols is a huge gamble, both on a spiritual and practical level.

Here is where I admit it: When this technology was very first coming out, I was using it. It didn't take me long to abandon it, sure, but before I heard any perspectives about the problematic nature of AI, I was using it to come up with things like sigils, images of my Gods and Goddesses, and divinations... I was treating it as potentially divinely inspired (a problem in its own right). I was doing this because, while I am creatively inclined in a lot of ways, there are also some creative pursuits I struggle with, and I was playing with the idea of using AI to close those gaps.

The problem with this is that when you generate a "novel" symbol, chant, or image, the AI is getting that information from somewhere and kind of scrambling it to turn it into something else. I already mentioned the threat of making something like a toxic herbal blend, but what about toxic symbols? Unfortunately, there are a lot of people who develop Pagan and Witch traditions that are white supremacist, transphobic, homophobic, misogynistic, or otherwise bigoted, and white supremacist Pagan traditions in particular have a whole racist iconography that they use. There are a number of Mjolnir pendants out there that have racist symbols that are obvious to other racist Heathens but subtle to others... what are you going to do if you generate an image of Thor or Mjolnir or Norse iconography that was trained on these symbols? OK, incidental mild similarities between symbols certainly happen, but there is a huge difference between using a symbol that you designed based on your own personal gnosis that has an incidental similarity with a racist symbol and using one that was generated explicitly based on one, even if it no longer looks like it anymore.

And if your "magical symbol" isn't something racist, there's a decent chance that it's based on a fictional series. I found that a lot of my "magical symbols" were slight bastardizations of symbols from Dune, and I had no idea because I never got into Dune. Intentionally using inspiration from fictional works because they resonate with you is fine, but do you really want to be using iconography from science fiction franchises in your magic on accident because that's what the shitty AI you used to generate your symbols was trained on? I certainly don't.

Images of the Gods can result in a similar problem. For one, a lot of people are named after Gods and Goddesses, so if you are generating what you think are photorealistic images of a deity, you may very well just be generating the faces of people who have similar names, and you have no idea how those people would feel about having their likenesses used that way. You can be named Sekhmet or Artemis and not be Pagan. My Patron God is named Seth... this is also straight up just a normal name found in the Bible... do I really need to be worshiping an image that looks like some unholy mix of celebrities named Seth?

I also personally think it's important to keep the element of human inspiration in our depictions of our Gods. When I was naively generating deity images using AI, I had this idea that by removing the human element I was kind of allowing the divine to speak to me through this technology, but it is ultimately spiritually shallow to think of AI this way, because we already know that the results of AI are incompetent garbage (look at the weird "Shrimp Jesus" phemonenon). You are spiritually gambling if you use this stuff to represent your Gods. It would be way better for you to make an image of your God yourself--even if you aren't a particularly good artist--than to try generating one using AI. The ancient world was full of images of the Gods that are not artistically perfect, but they had human and divine inspiration behind them and survived all these years!

To tie all that together, when doing research I found this image (minus my warning of course) on Pinterest looking for a historical statue of Odin. This is not historical--it's a modern piece--but seeing it portrayed as if it were an ancient piece or reproduction of one gave me pause. While it's unclear if the creator of this statue understood this (the link led to an Etsy shop that appears to be gone), the symbol found on it is a Black Sun, which was created in Nazi Germany and is an explicitly Nazi symbol that has no legitimate non-racist history.

A wooden statue of Odin with a black sun symbol incorporated into it

You have no way of knowing if the AI was trained on this shit. And while (at least for now) AI is unlikely to be able to really replicate something like a Black Cross, do you want the images of the Gods you use on your shrine to be poisoned with this sort of thing? I know I don't.

AI is appealing to a lot of people because they feel entitled to the things creatives make but resent having to compensate them fairly for the work. This was already bad, but AI makes it worse.

Again, this is not a problem that was created by AI... one of the first experiences I had with the Pagan Internet was going to the website of a painter who specialized in images of Goddesses and finding a whole page talking about how Pagans were copying her artwork to their websites without permission because they wanted pretty imagery on their websites but didn't want to either put the effort in to produce it themselves or compensate an artist for it. Keep in mind, we are not talking about art produced by a huge media corporation that has the means to compensate its artists, this was an independent artist making spiritual artwork that people found very meaningful, but apparently not meaningful enough to compensate that artist fairly for the work. Selling artwork to individual consumers is how she makes the money she needs to survive, and people were compromising that by making her work available everywhere, frequently without even crediting her or dropping a link.

I know that a lot of people will have excuses for why they actually are entitled to that work ("I can't afford it!" "I don't know how!" "I don't have the aptitude!" up to the extremely arrogant "But this is my Patron God and this art resonates with me therefore I am entitled to it!"), but all of these excuses are only possible because people chronically under-value the work of artists and other creatives, and don't believe their labor is legitimate enough to survive on.

But the thing is, while it's a shitty thing to do, when somebody straight up just copies a piece of art, especially in spaces like Pagan websites, most of the time they are not actually trying to claim credit for the work. As somebody who has done a number of paintings and drawings of my Patron God, I see them pop up on websites sometimes, and while people never seem to remember to credit me (a simple oversight I'm sure), I have yet to see anybody claim that they made the portion of the artwork I made. Even the people who incorporated some of my Set artwork into projects to post as their own are pretty clear that they didn't draw the things they included, they are only claiming the labor they actually did as their own.

AI prompters, by contrast, are claiming the labor that went into making those images as their own labor. While I would never claim all AI prompter types are equal in their cynicism or delusion, many of them give off a vibe that they believe making real art is backwards, that people who don't use AI tools are comparable to early humans painting on cave walls, and that we are obsolete and should be learning to use AI to adapt to modernity. In reality, AI prompting is not artistic labor at all, it is more comparable to commissioning artwork, only instead of compensating somebody for it and saying "I bought this," they are laundering the labor of thousands of non-consenting artists and saying "I made this" instead.

And I know this is a bit of a tangent soapbox, here, but we should not be aspiring to a Jetsons future. The idea that "the future" necessarily means replacing all traditional, handmade labor and skills with robots and push-buttons and diet pills is not only stupid, it would be unsustainable and a shitty future to live in for most people, who want to make creative things and enjoy creative things made by others, not just ask a computer to do it for them.

A result of this lack of respect for artists is that AI-generated images and text are incompetent bullshit that are predominantly good for scams (making anybody using AI suspicious, even if they think they are using it for a good reason).

Because people who use AI to generate "art" don't value the skill, education, and practice it takes to become a competent artist, they also very frequently lack the talent to see major problems in the work they publish. Not all AI images have major tells indicating they are AI, but I really frequently see AI "artists" posting work they're extremely proud of that doesn't make any sense. For example, here is an AI-generated image of a cracked egg. Everything about this egg fucking sucks, the shell is not cracked in a natural way, there is a smudge of random yolk on the inside of the shell even though the yolk is not broken, it just overall is an incompetent image that had no business being on DeviantArt's frontpage. It's also telling that this image has a big watermark, is "copyrighted" (currently AI generated images can't be copyrighted), and is for sale.

A screenshot from Deviantart with an AI-generated image of an egg with a green shell. The shell is broken in an unnatural manner, the yolk is sitting upon the white in an unnatural way, and there is a vague shadow of yolk in a strange place on the back of the shell. It has a DeviantArt watermark on it.

And this, if I'm honest, is not even that shitty of an example. Hell, this person is at least honest about being an AI prompter. The reality is that AI's predominant use--both on the Internet and in print--is scamming people. When this was still a pretty new problem, I ordered a set of deer stickers on Amazon. Not only were they clearly AI when I got them, but there were glaring errors, like one of the deer had five legs (in the listing photo, the stickers were arranged in such a way that a less-obvious sticker was obscuring the extra leg, so these people noticed and just didn't bother to do anything about it). This is a huge problem with children's content (there's an excellent episode of Behind the Bastards about this centering on dinosaur coloring books, you can also read a version of this on their Substack if you're not a fan of podcasts), and as I alluded to earlier when I mentioned Shrimp Jesus, a lot of content on social media is automatically-generated AI images with bot comments that only exists to game algorithms or generate advertising revenue.

Which brings me to why I'm talking about this on a Pagan website: Wicca Magazine. I have been getting a lot of advertisements for them, and this one in particular caught my eye:

The cover of Wicca magazine, which has an image of a woman holding several decorated eggs in her hands. There are a number of butterflies flying around her.

I'm almost entirely sure this is an AI-generated image. The mismatched earrings, the mismatched eyes the weird background flowers that don't make sense, random stylistic mismatches, the overall "vibe," and of course this fucked up butterfly are all big tells:

A monarch butterfly with the entire lower left wing segment missing.

I still periodically get ads for this magazine. So far the worst offender is this one, which features a May pole in the middle of a fire pit, random bonfires at the feet of standing stones, and a string of lights going from a tree straight to the fucking moon:

An ad for Wicca Magazine with an AI-generated image of a Beltane scene, complete with a maypole in the middle of a fire pit, several random fires at the foot of nonsensical standing stones, and a string of lights connected to the moon from the ground.

This is why a lot of people have compared AI to a fae trap... it's stuff that looks enticing at first glance, but the longer you look at it, the more suspicious it gets, like it's the Fae trying to lead you into another dimension and kidnap you or something.

Honestly, whoever is responsible for that should be ashamed, because there are a lot of Pagan artists out there who could use work, and yet they've decided to generate these monstrosities out of plagiarized work instead, without even so much as double-checking to make sure it doesn't have catstrophic errors in the imagery. Furthermore, if a magazine is going to use such incompetent AI on their cover, what will they do to fill the pages of that magazine? If I can't trust a publication to have legitimate cover art, why would I trust what's inside? Was this ever a legitimate magazine? Some of my friends subscribed to it, so I'm not saying the magazine itself is not legitimate outside of its use of AI imagery in its advertising and cover, but I'm not even sure, and I simply cannot trust anybody who uses AI for one thing not to use it for the things that matter.

So what do we do about it?

Obviously, the first thing you should do is, if you currently use AI for any sort of creative thing, be it "art" or chants or sigils or whatever... stop. Again, I can't stress enough, you are not a bad person if you used a widely-available tool without understanding the repercussions (again, I used it for a while, too). But there is simply is no ethical way to use AI for generating artistic works, and we have a moral obligation not to use it.

But what about other people who either aren't aware of these issues or simply don't care? Let's talk about that a bit.

As a community we are constantly guilt tripped about patronizing Pagan small businesses. I have always had a love-hate relationship with this, because a lot of the things "small Pagan businesses" sell, to be quite blunt, are mass-produced garbage that none of us have any business buying to begin with... these items carry with them the moral miasma of environmental degradation, unfair labor practices, and other questionable ethical issues.

This does not mean that I don't advise supporting Pagan small businesses, I just believe that you should do so in a way that benefits actual, for-real Pagan creators, not just resellers or mass-produced goods. That includes artists and writers. It does not include people who are pretending to be artists by writing a paragraph of descriptions for a plagiarism machine repeatedly until they get a result that almost passes for art. These are more comparable to resellers of mass-produced goods, only they don't just compensate the people who did the real work unfairly, they don't compensate them at all and have the nerve to claim they made it.

So commit to never intentionally supporting AI-generated media in the Pagan community. If a business sells it, or uses it in their advertising, and doesn't stop when they are informed? Don't patronize that business. Don't buy their products. I don't care if they're a small business, if a small business can't operate ethically, it doesn't have to exist, no matter how Witchy the owners are. You absolutely can start patronizing them again if they acknowledge they did something wrong and stop doing it, I'm not in the business of eternal punishment here, but don't just avoid buying AI-generated stuff, avoid buying from people who sell it.

Next, don't share AI-generated works in Pagan forums (or in general, but we're talking about Pagan implications here, after all). If somebody does, point out that it is AI and not ethical. People who knowingly post AI to social media are doing so because it gets them a lot of engagement (which gives them dopamine or money depending on who they are and what social media network we're talking about), so one thing I do on all my social media, Pagan or otherwise, is I hide all posts by people who post AI images, unless I have reason to believe it was an accident. If a forum or group creator is pro-AI? I leave that group. If I'm in a group that isn't run by pro-AI people but regularly gets AI submissions? I hide everybody who posts them (again, unless it's clear they didn't know it was AI). I do not argue with people who are bad-faith AI users. AI-users are largely dealing in a currency of engagement, and angry comments help their ratings just as much as supportive ones. So my personal tactic is to take that away, by either hiding their posts or blocking them, depending on the platform. If you use DeviantArt, there are some guides to blocking and suppressing AI content, such as this one by Stop-Ai-Replace.

If you are an artist, consider using Nightshade and/or Glaze if you post your work online. These are not permanent solutions, as generative AI developers are constantly working to break tools like this, but it will give you some protection for a while. You can also use Have I Been Trained? to see if you show up in any AI training datasets and opt out of the ones that honor that. I personally have not stopped posting art online, and don't advocate for doing that (although I am not an artist by trade, I am a hobbyist, and I understand if your opinion on that is different).

Anyway, that's all for now.

Happy Trails,
Wolfpeach

Update: August 2024 - Pagan Irony and Fabricated Diversity

I wanted to update this to add a couple other examples. One of them is specifically Pagan, the other isn't but it's just such a great example of how sinister AI can be.

The Pagan post had me holding my head earlier today, I found it in a Facebook group for local-ish Pagans. This is a baffling example for me, because it is so clearly AI-generated (specifically the two people on the far right of the image do not make sense... the older man has a shaved head and long hair at the same time in an unnatural way, his hands are too large and extremely unnatural, the person on the far right seems to be melting into the praying man and her lower half is obscured in a way it wouldn't naturally be. While I typically give people the benefit of the doubt (as some people's art styles are easily confused for AI), I simply do not believe that this was not made using AI:

A Facebook post with the name and group blurred out. The caption says Some of my art. Digital but NOT AI. The image is of a number of individuals wearing robes and necklaces, one with his hands in a prayer position. His hands are disproportionately large and have too many fingers. It says, in the worst font you have ever seen, 'The old Gods are stirring. It's long past time for pagans to stand together and heal this world.'

Now, I see AI bullshit in Pagan spaces (and everywhere else) a lot, but haven't felt the need to update this essay. What's different about this one? The combination of the imagery, message, and insistance that it isn't AI is a great example of a particular Pagan irony... the poster of this image wants to "heal the world," but has chosen to express this using an image of imaginary people, generated using a technology that fundamentally makes the world a worse place (including environmentally). They are also pictured in ritual, not actually doing anything to heal the world. Listen: I love ritual! Ritual is great for personal healing and it can be a great accompaniment to other actions when you want to make larger changes. So I'm not going to tell you not to do that, and if this were a picture of, say, a bunch of folks doing an Earth Day ritual or something like that, I'd have no negative things to say about it. But as it has been presented here, it just made me groan, because... simply put, I don't fucking get it. Why did somebody make this post? Is this a joke? I don't even know.

Luckily, people did notice the glaring AI and it looks like people are as annoyed as I am.

But here's a story that is more infuriating than annoying. Last month I went to an art exhibit called "The Transperience," and the centerpiece was a video project with a bunch of interviews of trans people. Great! But as this played out, I started to notice the photo slideshow looked... off. People had weird pupils, which I thought was just an artistic choice at first, but after a while it became evident that a significant number of images in this slideshow and on the accompanying website were AI-generated. A lot of them were high-heel-related, like they'd generated lots of photos of people in shoe stores.

An image of a purple-haired, older woman standing in a shoe store. She appears to have no eyeballs.An image of a woman in a black sundress, from the waist down, standing in a shoe store. There is a shelving unit nearby that does not make any physical sense, with several shoes fused together.

There are a lot of these, and I'm not going to post all of them, but one image in particular made me nauseous, which was this one:

An image of a Black woman sitting on a railing. She is wearing a pink strapless dress. She is bald and her face is indistinct. Her legs seem to fuse into one single leg, wearing one single orange high heeled shoe.

I wound up leaving the exhibit as soon as the film was over, because I was honestly really angry. This exhibit was created by, as far as I can tell, an entirely white group of trans feminine folks, with a more multi-gender group of people giving interviews. As far as I can tell there was only one person of color, a Two Spirit person who talked very openly about that experience. While not as diverse as it could have been, it was not a bad project... except for the blatant, lazy use of generative AI. I very often feel like a crazy person when I'm looking at the AI stuff people post, because it's not just that the use of AI is really obvious, but that it's like nobody bothered to even look at the images before putting them up. I can't imagine seeing that image of the woman with the bright orange high heel and thinking it looked even close to polished enough to go in a video that will be playing at a literal museum, and yet there it is.

And I really tried to be charitable here, in my mind, like maybe they chose these images as a representation of gender dysphoria, but even if that were the case, it's not an excuse for using AI, especially without disclosing that it's AI.

Ultimately, I truly believe that what happened here was that the creators of this exhibit noticed there wasn't a lot of diversity, and rather than attempt to find more people of color to involve in the project, they just generated a bunch of fake people of color as filler instead. And, well... that's simply not how it fucking works. There were a million other ways they could have gotten the filler they needed for this without generative AI.

I don't think I have any extra points here... I guess I just wanted to give some more examples of why AI is deeply problematic and why you should avoid it.

Again, Happy Trails,
Wolfpeach

Go Home


©May 2024, Wolfpeach