Skip to content

Category: Uncategorized

Composing an AI Symphony: Weather Poems Transformed into Art and Sound

After my initial weather-driven AI poetry experiments, I wanted to go to the next level to create more engaging videos. This time I used multiple AI tools to create the poetry, speech, music, and visuals. Every element, from words to images to sound, reflects the creative capabilities of AI in capturing the essence of weather and nature. The result is a ten-minute compilation showcasing poems generated by ChatGPT interpreting weather data with no text edits.

Visuals

To create the visuals, I created a JSON file containing the information saved from generating several weather poems. Then I wrote a Python script that looped through the file, asking ChatGPT to generate an image based on the poem text and its corresponding weather data.

I then took each image and the audio from each poem to create animations using Kaiber.ai.

Voices

To add some texture to the vocals, I modified my original weather poem process to exclude background music, leaving only video and speech. I also added a random choice between four voice models from ElevenLabs. I then used another Python script to add time-stretched tracks to the vocals, giving it a more otherworldly feel.

To be honest, my wife was not impressed with this decision: she had trouble making out the speech and recommended I at least create subtitles (which I did, but you may have to turn them on manually).

Music

All the background music was composed by AIVA.ai. I picked from one of a thousand tracks or sections of track I’ve generated over the course of a year, then put them together manually in Audacity.

Final Composition

Once I had my audio and visual elements, I put them together using the OpenShot video editor (in case you haven’t noticed, I like to use open source software whenever I can).

Conclusion

Overall, this was another really fun learning experience. I like what came out, flaws and all.
And there are definitely flaws.

The poems are interesting, but are clearly hallucinating at times. Granted, I gave ChatGPT permission to do so, so I shouldn’t be surprised.

I do wish I had more control over the animations, or better yet automate the process, but I don’t know how to do that. Yet. Same goes for the additional processing for the vocals and music.

More importantly I want my next project to have more of my poetic voice. This particular project has its merits and its own beauty – but it showcases more of my skills as a programmer than as a poet.

Actually…I’m going to take that back. I’m going to go out on a limb and posit that this is one of my voices, one that is an amalgamation of the programmer, the poet, the LLM, the external data, and the AI services.

I feel strongly that I must be in the loop when it comes to art that I claim is mine. Where I am in that loop, however, will depend on the art I am creating and why I’m creating it.

That won’t sit well with many creators or consumers of art.

To those folks I say this: So be it – I’ll see you in the marketplace of ideas.

Comments closed

Chapbooks, Chapbooks, Chapbooks

I have a lot of ideas rolling around in my head regarding chapbooks; some involving speculative poetry and some not.

I’ve recently completed a project whereby I used ChatGPT to generate poems based on weather data for random American cities, so it would make perfect sense to have the next chapbook use that project as a starting point.

It really wouldn’t be hard to pick either a specific state and compose a predetermined number of poems based on a single day’s weather within that state.

Or I could focus on a single city and create a chapbook based on a 14-day weather forecast. This approach would allow for a deeper exploration of a city’s weather patterns over time.

Either these projects would basically be looking at these places as if they were under an x-ray light, missing large amounts of detail we normally take for granted, but capturing glimpses of patterns that would not be seen any other way—at least that’s the hope.

Either option would start with a raw set of poems to work with within a week or two. What will take longer, though, will be putting together an editing process that gives me more control over the finished pieces. I want the chapbook(s) to serve as proofs-of-concept, demonstrating the combination of artificial intelligence and human creativity to enhance and inspire the artistic process.

The heart in the iron…
(composed by me with AI using an Allpoetry account devoted to such experiments)

Moreover, I envision incorporating multiple media into the chapbook to complement the poems:

  • Photographs and videos (real and surreal)
  • soundscapes
  • spoken text. etc.

I would also explore the possibility of adding interactive elements, such as QR codes that link to multimedia to the poems, giving them literally more dimensions.

Who knows – maybe this will captivate someone’s imagination by inviting readers to engage with weather and poetry and technology in a new and profound way.

Alrighty then…enough dreaming. Time to get to doing.

Comments closed

NaPoGenMo 2024 Notes: A Poetic Digestive System

I had this line of thought of emulating a digestive process:

  • Maceration (chewing up data/text – ingestion?)
  • Digestion (breaking down/transformation)
  • Extraction (refining)
  • Excretion (discarding waste)

Also put down some ideas for ways to take the text apart.

Poetic "digestor" notes
Poetic “digestor” notes

Potential methods for processing text
Potential methods for processing text

Comments closed

Throwing Boots at AI APIs

For National Poetry Generation Month (NaPoGenMo) 2024, I’m going to aim to play with throwing different data at one or more LLMs, then creating functions inspired by the Oulipo movement make something that is at least interesting in planning if not execution 🙂

Comments closed

I’m Back

It’s been way too long since I’ve updated this site. With all the attention paid to social media, I’ve let the site wither.

I have ideas I want to go into great detail on, and I believe this is where I can best describe them.

So going forward, I’ll strive to post here first, and social media second.

Stay tuned.

Comments closed