Thursday 28 March 2024

On Emotion in the Creative Process

I have written a lot in this blog about AI and machine learning, and have probably established my credentials as a sceptic. It is not 'intelligence' and it will not, in my view, ever be able to create anything other than curious pastiche. That is not the same as saying it will not create things that people will utilise: most popular entertainment is basically pastiche. And these days 'entertainment' seems increasingly to mean addictive clickbait, at which AI will presumably excel. But it will not produce anything really worth reading, watching, or hearing.

This is because - I know this will shock and appall readers - human beings are not rational. We make our decisions on the basis of emotions. And anything that does not have emotions therefore cannot replicate human thought or decision-making. In this regard, I strongly recommend listening to this interview with Robert Burton, a neurologist who has written extensively on knowledge and decision-making. A transcript of the crucial passage in the interview runs as follows:

[There was] a cardiac surgeon of some repute, who did a study of whether or not hands-off massage--I have forgotten the name for it now but it's when you run your hand over the patient's body but don't actually touch them--will improve cardiac surgery. And, when they asked him why he came up with this idea, he said, 'Well, I had no a priori opinion on this.' Then, I would say, 'Why would you do this study?' I mean, that would be the equivalent of saying...eating lasagna helped cardiac surgery. You'd say, 'Why?--' and this was sort the plea that I have in my second book, is that: Scientists initiate almost all research, and I mean, I say, 'almost all' I'm just trying to be generous, from the point of view of some preconception. Often one that they don't understand at all. But it's just one that tweaks them. And I was--you think about Albert Einstein and the theories of relativity, and he was working at the Swiss patent office, and one of the big issues at the time was with the nature of time and getting railroad scheduling. So, trying to arrive on time. And he wasn't the only one thinking about it. Now, the question is: If he hadn't worked in the patent office, would he have come up with the same idea? Maybe. Maybe not. But did thinking about time and getting it so the trains--triggered an experiment about the man on the train? Well, you never know. I wouldn't call that a bias. I would just call that prior experience and his native temperament have shaded the way he starts thinking about the experiment. And that's not overcome-able.

The crucial phrases are there in bold. Human beings - even scientists, who are purportedly 'rational' - decide what they are going to investigate, and how they are going to investigate it, on the basis of emotion. Otherwise, why would they be interested in the thing they are investigating, as opposed to the infinite range of other topics they could be investigating? Why are they interested in investigating anything at all? The answers to those questions are based in 'prior experience and native temperament', on how the scientist is being 'tweaked' (which is to say, irrational motives), and not on reason. Why did Einstein investigate relativity? Because he was interested in it. And the 'being interestedness' is itself rooted in emotion, not rationality.

The emotion, then, comes first and is crucial. Why do we get out of bed in the morning? Because we feel that there is a reason to, as opposed to not doing it. More pertinently, why do we want to create a piece of art in the first place, let alone actually go about the process of doing it? Precisely because, well, we want to. The feeling and wanting are necessary - they are where volition comes from. And they are what dictate to us the direction in which we will go during the creative process. Human creativity is in other words only partly iterative, and only partly based on prior influences and knowledge of the genre in which one is working. It is emotion that dictates the decision-making processes which are continually made during the production of any given work of art.

There is a great interview available on YouTube between Rick Beato and Billy Corgan. You'll get a huge kick out of it if you're a Smashing Pumpkins fan and should listen to the whole thing. But if you're not, and just want to get to the salient segment, start listening at this point, an hour and five minutes in. Having been asked about the songwriting process, Billy makes clear that drawing from existing influences is only a very minor part of the exercise. Again, to provide a (somewhat paraphrased) transcript:

'Sometimes it might help when you get stuck to think...well, what would John Lennon do? What would Bob Marley do here? Sometimes that can just get you across the line... But as far as the core of what I do, it's always a mystery to me. And the best way I can describe it to somebody is, I'm at home playing the piano, and I'm singing a melody, and I'll sing a note, and I'll think, that's kind of a weird note, so I'll find the note on the piano... [and sometimes] it's dissonant....and I'll think, 'well that's wrong'. So I'll resing the melody, 'correctly', and there's a little guy in my head that goes, 'No', and there's an argument in my brain, and I cannot, not hear the melody that my brain is telling me to sing, so that's the melody.... and if I derogate from it, there's a voice in my head that says, 'No, that's the wrong melody'...'

He goes on (very illuminatingly when thinking about AI):

'There's the computer part [in my brain], and then there's the part which is felt emotion. It's hard to explain.... You're playing something and you think, well, this part's okay. You try something and you go, well that's a little bit better. But maybe it's too weird or out of context...and then you're into the binary choice of whether to go for the D, which is the 5th, or I could go to the F which is the flatted 7th of a G or something, and then you sing one way, and then you sing the other, and you sit there and go, eeny meeny miny mo....I think that's the moment that makes you a songwriter.'

The point, of course, is that the 'eeny meeny miny mo' moment is where emotion comes in. At any given point in time, when writing a melody, one could come up with one note, or another note, or indeed any other of a range of notes. At that level, the human creative process is the same as an AI process. The difference is that the decision of which note comes next to the human is rooted in emotion, whereas to the AI it can only be rooted in reference to other songs which it 'knows'. The human can make a leap based in the logic of feeling. An AI can only, metaphorically, act randomly or by reference to 'What would John Lennon/Bob Marley do?' reasoning. 

This is the difference between art and pastiche. And this is why 'artificial' 'intelligence' will not produce art. 

14 comments:

  1. To me a big part of creation is establishing what you want to do which then sets both conscious thought and unconscious thought in motion. By unconscious I mean those little connections that seem to happen and spring up when you're engaged in something else - showering, walking, a long work meeting etc. Of course that sounds a little like your own AI but the excitement of realizing you have put the pieces together is an emotional sort of evaluation that hopefully is beyond the machine.

    ReplyDelete
    Replies
    1. Yes, exactly right. The point is that emotion is not algorithmic - it is chemical, and it is influenced by memory. The idea that AI could replicate those things is, frankly, absurd.

      Delete
  2. Even emotion, I think, has its roots in rational causes, at least from an evolutionary standpoint. It seems likely that emotion evolved as an instant feedback mechanism to guide individual and species survival. Things that improved the odds of survival produced positive emotional experiences, while things detrimental to it provoked negative emotions such as disgust, fear, or anger. Our minds are the product not only of the experiences of our individual lifetimes, but of billions of years of evolutionary pressures, which are of course in a constant state of change and flux. Much of our evolved emotional machinery (if I may re-borrow a metaphor back from the artificial) has become obsolete, sometimes even maladaptive, yet it persists in our minds, sometimes consciously, more often deep in the subconscious, and it's become so wildly complex and convoluted it's often impossible to predict how any given stimulus will stir our emotions. At base, it's all built upon survival, but at some point it circled back upon itself, so the experience of emotion is often a goal in itself rather than a tool in pursuit of the goal of survival. (This is known as "psychic profit" in the parlance of economics, the improvement of one's subjective sense of satisfaction and well- being, and it's literally at the root of all purposeful human action. I believe we do make decisions for the most part rationally when determining how to apply means to attain ends, but the choosing of the ends is based upon subjective valuation, or emotion, if you like.)

    I am still somewhat on the fence as to whether an artificial mind, without the myriad pressures and trial-and-error adaptations of biological evolution, could ever actually attain consciousness, volition, and sentience as we understand them, let alone creativity. If it could, its "art" would be reflective of its experience as an artificially designed consciousness, which would likely be completely alien to human minds, and I highly doubt it could ever offer much insight into the human condition, which is really the thing about art that stokes our souls (whatever you might believe a "soul" to be), isn't it?

    A column I read recently goes so far as to suggest that human fallibility itself plays an indispensable role in creativity: an AI, with perfect recall, and able to perfectly apply principles and reproduce procedures, has a much more limited set of possible outcomes when compared to a human mind which sometimes misremembers, misinterprets, and misapplies ideas, inadvertently adding some unpredictability to the process and producing unforeseeable new outcomes.

    Also, though I wouldn't stake my life on this, it's possible we may already be witnessing a breakdown in AI "creativity" as AI absorbs its own influences in addition to that of human creators, a sort of creative inbreeding, if you will. (Explored in the video linked below.)
    https://youtu.be/NcH7fHtqGYM?feature=shared

    ReplyDelete
    Replies
    1. Thanks for an interesting and informative comment!

      Delete
  3. Of course it won't produce art anymore than a camera won't produce art by itself. Still don't see why it can't be used by humans as a tool to help produce art.

    What's being called AI isn't real AI at all, it can't think or do anything like that. But it can still be used as a tool by humans to do many useful things.

    ReplyDelete
    Replies
    1. came here to say exactly this ✨ the disruption we're seeing now is the same sort of thing that happened when the camera came on the scene-- absolute hordes of skilled painters who made their living painting portraits, commercial advertisements, whatever, became unemployable practically overnight. the art of painting itself had to deeply reckon with its purpose in the world.

      Delete
    2. Yeah, if people only considered painting or what have you art and turned up their noses at both photography and AI art that'd make sense to me.

      But the idea that just pointing a machine in the general direction of something pretty and pressing a button is perfectly fine art but using AI as a tool is automatically not art just makes me scratch my head.

      Of course making GOOD photography takes a lot more effort than just pointing the camera in the general direction of something pretty, but then the same can be said of GOOD AI art, which generally requires a good bit of effort on the part of the person using AI as a tool, the same way that good photography requires a good bit of effort and know-how on the part of the photographer.

      People have been using mechanical tools to help them make art for a long loooooong time. People were using camera obscura to trace shit centuries ago.

      Singling out AI tool as somehow fundamentally different is just silly to me. AI tools will be just as accepted as using Photoshop or what have you soon enough.

      Delete
  4. I love the casual naiveté of assuming scientists choose to investigate what they want based on what interests them. Unfortunately in this capitalist hellscape people research what they can get funding for.

    ReplyDelete
    Replies
    1. I'm an academic; I'm perfectly familiar with the way the imperatives of funding affect what gets researched in broad terms - varying a great deal by field. (Although the idea that the command-economy, picking-winners basis on which research funding gets allocated is a result of capitalism is pretty whacky.)

      Delete
  5. You seem to be saying that this emotional component (which seems to me is doubtlessly present) is somehow ineffable and acausal: inspirations and genre conventions, the kind that are mimicked by AI, come from prior inputs, but emotion just arises out of nothing.

    Obviously, I can't prove otherwise, but I think it's much more likely this emotional component is also very much causal, and just seems more ineffable to us, because it's more difficult to (impossible?) to place ourselves outside of it to look at it.

    "A man's at odds to know his mind cause his mind is aught he has to know it with. He can know his heart, but he dont want to. Rightly so. Best not to look in there. It aint the heart of a creature that is bound in the way that God has set for it. You can find meanness in the least of creatures, but when God made man the devil was at his elbow. A creature that can do anything. Make a machine. And a machine to make the machine. And evil that can run itself a thousand years, no need to tend it."

    ReplyDelete
    Replies
    1. I'm not sure I agree. It's not that it's ineffable or acausal - it's that it's not algorithmic. It's embodied, chemical, experiential.

      Delete