Welcome to the all-new Creative Workflow Lab. Now open for paid subscriptions, publishing weekly.
Insights, news, trends, and tools for creative professionals.
Welcome into my lab. I'm Shannon Leonard. Think of me as your insider source on the bleeding edge of AI and creative tech. As a creative producer with over 10 years of experience and an obsession with AI's impact since 2019, I've got you covered.
The media production landscape is in constant flux. AI, software, workflows – I track it all. Let me sift through the noise, so you can focus on your craft.
Get your weekly dose of essential creative workflow news, tools, and trends. No fluff, just the pivotal updates. Whether you're a video editor, graphic designer, or someone fueled by creativity, this place is for you. Let’s navigate the fast-paced world of creative workflows together.
Plus, monthly video tutorials and AI workflow explainers. Consider this your roadmap to unlocking new AI production possibilities.
Stay on top of new tools and workflows, streamline your process, and push the boundaries of media production.
Step into the all-new Creative Workflow Lab with a paid subscription.
To kick this off, I thought it would appropriate to start by catching you up with recent creative workflow news from the past few weeks.
Latest Creative Workflow Tools, News, & Trends (March 2024)
Artists Leverage Sora Early Access To Produce Amazing Visuals
The News: OpenAI’s Sora is making waves with its early access launch, showcasing visuals that far surpass anything currently available from competitors like Runway, Pika, and others. Despite being in a private beta phase, Sora's outputs have already caught the attention of the creative industry, signaling a significant shift in video generation technology.
Why It’s Relevant for Creative Professionals: The emergence of Sora as a frontrunner in high-quality video outputs is a game-changer for Hollywood and large production teams. The remarkable improvement in quality—that I’d say looks at least 10x better than existing services—means that solo media studios and independent creators will soon have access to production capabilities that were previously exclusive to big studios.
This shift not only democratizes high-quality media production but also pushes the boundaries of what can be achieved creatively. No official launch date for Sora has been announced yet. It’s expected that it will be publicly available (in some form) by the end of 2024.
Adobe Firefly's New “Structure Reference” Feature for AI Image Generation
The News: Adobe Firefly has introduced a feature that allows you to generate unique images by uploading a “structure reference” image, which then serves as a blueprint for the layout of the new AI-generated images. This capability, combined with style references, offers a high level of control and flexibility in image creation.
Why It’s Relevant for Creative Professionals: For designers and visual artists, this feature from Adobe Firefly represents a solid advancement in how images can be generated and manipulated. The ability to use a “structure reference” offers a unique blend of precision and creativity, making it easier to produce text-based graphics or transform photos into different styles. This tool opens up new possibilities for creative experimentation, allowing professionals to explore new concepts or iterate on designs with greater efficiency. (The image at the top of this post was made with Firefly and the new structure reference feature.)
Hume: Revolutionizing Emotion Detection in AI
The News: Hume introduces a groundbreaking approach to detecting emotionality in human speech using AI, potentially transforming how creatives interact with technology. The upcoming API launch suggests wide-ranging implications for interactive storytelling and creative collaboration.
Why It’s Relevant for Creative Professionals: The ability of AI to detect and respond to emotional cues can significantly enhance the creative process. For writers, filmmakers, and other content creators, Hume's technology offers exciting prospects for developing more nuanced and emotionally resonant works. Whether it's fine-tuning a script based on emotional feedback or creating interactive narratives that adapt to the viewer's reactions, Hume's innovation paves the way for a more intuitive and collaborative relationship between creators and their tools. It’s not going to have an immediate impact on our workflows but the demo they released is worth trying out to get a sense of how these systems work.
New Startup Infinity.ai is Shaping the Future of Generative Video
The News: Infinity.ai, a startup fresh out of the gate, aims to revolutionize storytelling starting with digitally cloning humans. With ambitious plans, Infinity.ai is at the forefront of generative video technology.
Why It’s Relevant for Creative Professionals: While it's still early days, the potential for AI-generated characters and narratives to contribute to or lead production efforts cannot be underestimated. Engaging with these technologies now, even on an experimental basis, can provide valuable insights and skills that will be advantageous as they become more integrated into the creative industries. In the competitive landscape of generative video platforms, Runway, Pika, HeyGen and LTX Studio are also significant contenders.
OpenAI Voice Cloning and Eleven Labs: The Race for Realism
The News: OpenAI's voice cloning technology requires only a 15-second sample to generate convincing synthetic voices, setting a new benchmark in the field. This development places OpenAI in direct competition with Eleven Labs, which also offers voice cloning but requires longer samples for similar results. Despite Eleven Labs being operational for commercial use and OpenAI's technology still in demo phase, the comparison between the two highlights significant progress in synthetic voice generation.
Why It’s Relevant for Creative Professionals: The advancement of voice cloning technology has profound implications for content creators, especially in the realms of podcasting, animation, and video production. The ability to generate realistic voiceovers on-demand is already impacting post-production workflows, offering producers flexibility and efficiency. This technology also opens up new creative possibilities, such as easily experimenting with different narrative voices or creating content in multiple languages without needing fluent speakers. As the technology continues to develop, staying informed and experimenting with these tools could offer producers a competitive advantage, enabling them to produce more diverse and engaging content with fewer resources.
Suno AI: Leading the Charge in Generative Music
The News: Suno AI distinguishes itself in the crowded field of generative audio services by enabling the creation of radio-quality music with minimal input. Its latest model, v3, allows users to produce full two-minute songs in seconds, a breakthrough in music generation technology. This tool is designed to democratize music creation, making it accessible to professionals and amateurs alike.
Why It’s Relevant for Creative Professionals: Suno AI's advancements underscore the transformative potential of AI in the music industry. For music producers, composers, and even marketers, the ability to quickly generate high-quality tracks tailored to specific needs could drastically change the creative landscape. I’ve tried Stable Audio and Suno definitely achieves higher quality outputs. This technology not only streamlines the production process but also encourages experimentation with different genres and styles. As AI-generated music becomes more sophisticated, creative professionals in the music industry will need to explore how these tools can complement their skill sets, potentially leading to innovative collaborations between human creativity and AI efficiency.
Thanks for reading! Consider upgrading to support the newsletter and get every week’s top creative workflow news, AI tools, and media production trends delivered to your inbox with a paid subscription.