Baseline Test

This is my attempt to construct a diffusion model prompt for animation. The audio I used was the famous interrogation scene from Blade Runner 2049, and it is an actual poem by Nobokov (Pale Fire) that has been wonderfully adapted for the screen. It was fascinating to observe how Ai Deep Learning and making a meaningful picture, almost complementing each other in most brutal ways.

Did conversion of video markers from timecode divided by 24fps to get the actual frames and formatted them in excel to direct diffusion over-time.
Below is the resulting prompts (and my lazy imagination)