AI filmmaking experiments
In this example I trained a Lora with flux.gym in pinokio and added it to my workflow in ComfyUI to create AI selfies basically … or more or less realistic looking images in front of different backgrounds.
All (not the videos) on local hardware and local open source software.
FLUX – Dev | Flux Checkpoint | Civitai
black-forest-labs/FLUX.1-dev · Hugging Face
this was a random test of creating images with text 2 image prompts in comfy UI with flux.dev
after that I added some motion with kling and lumalabs…
This was a quick test as in how to create multiple shots with the same character as well as to create environments based on photographs
Music: Sting – Englishman In New York (Kide Tech Edit)
Video: AI (lumalabs, runway, kling)
This youtube playlist shows the latest tests I did when I visited the Hamburger Kunsthalle. This test was solely for the purpose of experimenting the current Gen-AI capabilities.
The movement was created with current AI tools and the output is based on real photographs of real art pieces of the art museum in Hamburg.
ArtStation – Today at the Museum, vfx.hs-flensburg
#runwy #kling #lumalabs #dreamMachine
…is a teaser for the pilot a future mini series. Each episode plays in a different time and setting, but they are all mysteriously intertwined. Are you curious to know more?
Written, Directed & Edited By Florian Werzinski
Voices & Sound Effects: https://pixabay.com/sound-effects/
Video Created with: LUMA LABS KLING RUNWAY
Music: Universal Production Music
ArtStation – MURDER on the ORIENT EXPRESS
