Now that I’ve learned to turn weather data feeds into poetry, I want to take it to another level. For my next AI poetry project, I want to use MARTA public transit data to create poems with audio and visuals, but I want to use different prompts and/or workflows.
At the moment I’m thinking of riffing off an idea from The Ghettobirds collection: imagining MARTA as a sentient being, with the data functioning as surrogates for senses. I’m also thinking I’d like to put myself – or others – directly into the creative loop. Thinking biometrics or likes.
After my initial weather-driven AI poetry experiments, I wanted to go to the next level to create more engaging videos. This time I used multiple AI tools to create the poetry, speech, music, and visuals. Every element, from words to images to sound, reflects the creative capabilities of AI in capturing the essence of weather and nature. The result is a ten-minute compilation showcasing poems generated by ChatGPT interpreting weather data with no text edits.
Visuals
To create the visuals, I created a JSON file containing the information saved from generating several weather poems. Then I wrote a Python script that looped through the file, asking ChatGPT to generate an image based on the poem text and its corresponding weather data.
I then took each image and the audio from each poem to create animations using Kaiber.ai.
Voices
To add some texture to the vocals, I modified my original weather poem process to exclude background music, leaving only video and speech. I also added a random choice between four voice models from ElevenLabs. I then used another Python script to add time-stretched tracks to the vocals, giving it a more otherworldly feel.
To be honest, my wife was not impressed with this decision: she had trouble making out the speech and recommended I at least create subtitles (which I did, but you may have to turn them on manually).
Music
All the background music was composed by AIVA.ai. I picked from one of a thousand tracks or sections of track I’ve generated over the course of a year, then put them together manually in Audacity.
Final Composition
Once I had my audio and visual elements, I put them together using the OpenShot video editor (in case you haven’t noticed, I like to use open source software whenever I can).
Conclusion
Overall, this was another really fun learning experience. I like what came out, flaws and all. And there are definitely flaws.
The poems are interesting, but are clearly hallucinating at times. Granted, I gave ChatGPT permission to do so, so I shouldn’t be surprised.
I do wish I had more control over the animations, or better yet automate the process, but I don’t know how to do that. Yet. Same goes for the additional processing for the vocals and music.
More importantly I want my next project to have more of my poetic voice. This particular project has its merits and its own beauty – but it showcases more of my skills as a programmer than as a poet.
Actually…I’m going to take that back. I’m going to go out on a limb and posit that this is one of my voices, one that is an amalgamation of the programmer, the poet, the LLM, the external data, and the AI services.
I feel strongly that I must be in the loop when it comes to art that I claim is mine. Where I am in that loop, however, will depend on the art I am creating and why I’m creating it.
That won’t sit well with many creators or consumers of art.
To those folks I say this: So be it – I’ll see you in the marketplace of ideas.
I have a lot of ideas rolling around in my head regarding chapbooks; some involving speculative poetry and some not.
I’ve recently completed a project whereby I used ChatGPT to generate poems based on weather data for random American cities, so it would make perfect sense to have the next chapbook use that project as a starting point.
It really wouldn’t be hard to pick either a specific state and compose a predetermined number of poems based on a single day’s weather within that state.
Or I could focus on a single city and create a chapbook based on a 14-day weather forecast. This approach would allow for a deeper exploration of a city’s weather patterns over time.
Either these projects would basically be looking at these places as if they were under an x-ray light, missing large amounts of detail we normally take for granted, but capturing glimpses of patterns that would not be seen any other way—at least that’s the hope.
Either option would start with a raw set of poems to work with within a week or two. What will take longer, though, will be putting together an editing process that gives me more control over the finished pieces. I want the chapbook(s) to serve as proofs-of-concept, demonstrating the combination of artificial intelligence and human creativity to enhance and inspire the artistic process.
The heart in the iron… (composed by me with AI using an Allpoetry account devoted to such experiments)
Moreover, I envision incorporating multiple media into the chapbook to complement the poems:
Photographs and videos (real and surreal)
soundscapes
spoken text. etc.
I would also explore the possibility of adding interactive elements, such as QR codes that link to multimedia to the poems, giving them literally more dimensions.
Who knows – maybe this will captivate someone’s imagination by inviting readers to engage with weather and poetry and technology in a new and profound way.
Alrighty then…enough dreaming. Time to get to doing.
This is a somewhat real-time deep dive into one of the ways I use generative AI (in this case ChatGPT4) to develop a poem, along with my views on doing so.
Apologies in advance for the clickbait-y title.
After searching YouTube for videos on the topic, I wound up being more than a little disappointed. All I found were either rants about “AI will ruin poetry” or demos of “look at how cool this is with only a prompt or two”.
I can do better than that, even with an admittedly less than perfect presentation.????
Be warned, this is a long one, folks, so buckle up.
So…very late, but I got something out there. I made heavy use of Microsoft Azure components like Logic Apps, Azure Functions, and Storage Accounts. And I got to use a lot of Python.
In the end, I put together something that generates – or attempts to generate – a poem three times a day, based on the weather from a random US city and state. The github repo only contains the python code along with a couple of unfinished sections.
There’s more that I would like to do, like automatically upload to YouTube, but for now I’m going to call this “good enough”.
My wife did offer some possible uses of the code as it stands: I could create generate poems for all the cities in one state and make that an audiobook. Or take one city and create a month’s worth of poems. Might just try that, as that takes little effort.
I’ve spent the past couple of days just writing out plans for how to put together my project for National Poetry Generation Month. And to be honest, I’m getting to the point where I feel like I’m overthinking things.
I’ve written so much and doodled so much that I think that if I don’t actually just start putting code to IDE, I’m never going to get this thing done.