Monday 13 May 2024

Ungoliant's AI

But she had disowned her Master, desiring to be mistress of her own lust, taking all things to herself to feed her emptiness; and she fled to the south…Thence she had crept towards the light of the Blessed Realm; for she hungered for light and hated it. In a ravine she lived, and took shape as a spider of monstrous form, weaving her black webs in a cleft of the mountains. There she sucked up all light that she could find, and spun it forth again in dark nets of strangling gloom, until no light more could come to her abode; and she was famished. - JRR Tolkien, from The Silmarillion

We return, my friends, to a familiar theme: the Satanic nature of AI art (see also, for example, here).

Notice how Ungoliant is described by Tolkien: evil is only, and can ever only be, parasitic. It draws in and 'sucks up', and then 'spins' the results forth again 'in dark nets of strangling gloom' - it does not create. And in the end it becomes famished, precisely because nothing about it is nourishing (one can think of it, in fact, as the absence of nourishment). 

Hence, of course, Morgoth and Sauron (and Saruman, their pale imitator) cannot create either - they can repurpose and redesign and corrupt what already exists, but they cannot make afresh. They can at best deploy machines to extract what they can from the earth and forge it into materials they can use, but they add nothing to creation itself.

This is fundamentally what AI does - and, for the avoidance of doubt in case there are any literalists out there, I do not mean to suggest that AI is actually Satanic in the sense that the devil is behind it - in that it simply trawls through, and 'sucks up' what already exists, in order to spit it out into repurposed, repackaged chunks. The results are thin, vapid pastiche, interesting only inasmuch as it can fool the human eye into thinking it was produced by a real person, or insofar as it is fascinating trying to figure out what it will do next. It is not substantively art in the sense that it can move, or transcend, or communicate the sublime.

What it can also do is creep us out. In my previous writings on the subject, I have noted that there is something ineffably eerie about AI-produced images - there is a kind of deadness to them. Yet at the same time they also manage to communicate a sense of flat affect, particularly in the human visage - as though the people it depicts have seen great sadness, and horror, and that they have come to the conclusion that the only appropriate means of interacting with the world is to disengage from its pain and sorrow:


It struck me as almost too 'on the nose', then, when I came across this highly thought-provoking piece on the subject of how AI training sets are put together and curated. It begins with the findings that LAION-5B, one of the biggest and most important AI training sets, contains thousands of images of the sexual abuse of children (which in itself I think should probably give you pause if you are in the habit of using this new toy). But it goes from there in an interesting direction, showing to us that what we think of as 'AI' is very much human-directed, and reliant of human input, in this case assessments made by actual human beings to vet the quality of images. As the authors of the piece make clear, this means that while we might think of AI as applying a kind of neutral 'brute force' method of generating images, it is actually doing it on the basis of a set of preferences of real-world human beings, and these are human beings of a very particular kind:

The creators of SAC are transparent about the shortcomings of the set, specifically the fact that the scores were submitted by users who were both WEIRD (Western, Educated, Industrialized, Rich, and Democratic) and developers of AI art, a demographic they describe as leaning toward "nerdy" and "esoteric." Furthermore, they admit that most of the ratings in the dataset were submitted by a "handful of users," whose "aesthetic preferences dominate the dataset."...The concepts of what is and isn't visually appealing can [therefore] be influenced in outsized ways by the tastes of a very small group of individuals, and the processes that are chosen by dataset creators to curate the datasets.

The point here of course is that the type of person who develops AI art and is therefore 'nerdy' and 'esoteric' is likely to be the kind of person who has been hardened by many years of prolonged internet usage against any sort of geniune feeling, and has come to adopt the highly-arch, sardonic, sarcastic and cynical perspective within which any long-term internet user invariably comes to marianade. It is the tastes and preferences of this kind of person - we all know this kind of person - which influence the composition of the datasets on which AI art is generated, and it is their emotional tone which therefore bleeds through most strongly in the AI art which we end up seeing. We don't really see this explicitly, but I think we (those of us who feel as I do, anyway) intuit something of it in the pervasive sense of unease and inchoate nastiness which pervades this stuff wherever it is encountered. It is I think the type of art that would be prized by Melniboneans, or Melkor - and there is actually a reason why it feels that way.

13 comments:

  1. This is old-man-yells-at-cloud, but I am an old man too and I doubt this particular cloud like you do. Every generation has doubted their own innovations effects on the youth--rhetorically this is usually our cue to sneer at the old men. But the old folks were right: letters really did destroy the memory. Cars really did destroy cities. The pill really did destroy marriage. The internet really is destroying your emotions. Etc etc. Marshal McLuhan, ora pro nobis. I don't know what effect AI will have, but I can't imagine any good coming from it.

    ReplyDelete
    Replies
    1. Who are you calling old?!?!?!?! ;)

      Delete
    2. I'm relatively young and I find this stuff horrifying. This isn't a generational divide thing, I think? I know 50 somethings who think AI is the greatest thing ever, I know teenagers who regard it as the antichrist. I find it tends to break down more along someone's personal connection to creatives: writers and artists and musicians and all hate it, middle managers and accountants and the like seem to love it.

      Delete
  2. AI images have all kinds of weird biases. I like experimenting with using (exclusively looooong dead) artists in the prompts as things like making French Symbolists make Cyberpunk art gives interesting results. Which artists names in the prompts give good results is HEAVILY biased towards "WEIRD" artists (especially 19th century English oil painters).

    I like using AI as a tool far more than you do, but I see it as a tool like a camera that needs a lot of human input to do anything worthwhile and a lot of AI images are the equivalent of just spinning in a circle and taking a picture on your phone and hoping that's a good image.

    ReplyDelete
    Replies
    1. This is my fear: that our sense of what art looks like will be totally imbued with the 'weird' rather than the beautiful.

      Delete
    2. They meant “WEIRD” as in the acronym.

      Delete
    3. Yes, and I meant it as in the English word!

      Delete
  3. That last paragraph hit so hard I had to re-read it. That said, I don't care that people mess around with it as a disposable 'haha look at this giraffe morphed with an AT-AT'. But I really don't like seeing it marketed or in marketing. I always make a 'Micheal Bolton Face (from office space) whenever I see it. And believe me, people can tell.

    ReplyDelete
    Replies
    1. I think people viscerally sense there is something 'off' about it.

      Delete
  4. The child abuse stuff isn't surprising: its an open secret in our society that all the rich, powerful and socially influential people are to some extent pedophiles or pedophile enablers. Something that even just 10 years ago id have dismissed as the ravings of some 'right wing lunatic bible thumping flat earth fundamentalist' yet here we are.

    We know those in power do it. They know we know and they stopped caring, they're flaunting it now because they know we can't do a damn thing.

    ReplyDelete
  5. Tangential, but my reading of the Silmarillion was that Melkor did create - he made the fires and the frosts, IIRC, as well as "everything bad" - but diminished himself in the effort. Other valar in their acts of creation were "topped up" by or acted as conduits for the Flame Imperishable, but Melkor who never understood that the Flame and Eru were one and the same was always spending of himself, hence why he ended up such a feeble shadow of himself after the first war.

    ReplyDelete
    Replies
    1. I think that's the point - Melkor was just creating from his own substance, because he can't create afresh?

      Delete
  6. While I don't disagree with most of your points here in general, I feel that using dansumption's image as an example isn't fair. I don't know the prompts or process used, but I'm confident the intent was for the image to be disturbing. It's like using Munch's The Scream in a post about how painting can only convey anxiety or pain or despair.

    ReplyDelete