VP Land
Posts
Twelve Labs Puts AI to Use & Blackmagic's Spatial Camera

Twelve Labs Puts AI to Use & Blackmagic's Spatial Camera

🌐 URSA Cine Immersive, Canon's New Dual Fisheye Lens

Powered by

Has anything happened in generative AI lately? 😏

Luma Labs entered the Gen AI video chat with their own model called Dream Machine (which is open to the public). Runway teased Gen-3 Alpha. And Tribeca just hosted their Sora shorts special program.

But in this issue of VP Land, we’ll take a look at Utility AI (which we did a deep dive into with this video).

Twelve Labs had a really interesting hackathon to build practical video tools.

And spatial/immersive video is alive and well and about to get a big boost from a new camera from Blackmagic.

Let’s jump into it!

Hackathon to Build AI Tools to Edit Faster

Last weekend, we got to check out the results of a hackathon Twelve Labs hosted with FBRC.ai.

Teams were able to pick from one of four challenges, ranging from using Twelve Labs’ AI to help find b-roll for a given script to automatically creating highlight reels from press conferences.

Here’s a recap of the winning projects:

The first-place winner, ThirteenLabs, created an AI-powered video editor that automates the creation of highlight reels and summaries using Twelve Labs' multimodal AI APIs and language models. It could also translate and dub the video into other languages.
In second place, Team Top Summarizer's AISR tool generates quick summaries and highlight reels from sports press conference videos
Tied for third place, Samur.ai generates real-time summaries and highlight reels from sports press conferences based on user prompts, using AWS Transcribe and Rekognition services.
And the other third place winner: Team The Johans' Ai-ssistant Editor organizes video footage and builds rough cuts based on scripts and stylistic choices, saving time in the editing process.

Read a more detailed breakdown of each team and watch their demo videos here

SPONSOR MESSAGE

MASV is a faster, easier way to transfer large files to anyone, anywhere in the world—with just an internet connection.

Trusted by media and entertainment organizations across the globe, MASV plays an essential role in thousands of video workflows, giving production professionals absolute confidence in media delivery.

Unlike other file transfer services, MASV has no size limits and always delivers blazing-fast transfer speeds.

Try MASV for free.

Oh, and btw, they integrate with Twelve Labs

New Gear for Spatial Video

Blackmagic Design has announced a comprehensive workflow solution for creating cinematic Apple Immersive Video content for the Apple Vision Pro headset.

The company announced the Blackmagic URSA Cine Immersive, the first commercial camera system designed specifically for capturing Apple Immersive Video, and updates to DaVinci Resolve that enable editing spatial video content.

Read more about the camera’s specs

Canon’s New VR Lens

Canon also announced a new lens in their lineup to help shoot VR content: the RF-S3.9mm F3.5 STM Dual Fisheye lens. The lens is compatible with the EOS R7 camera and will be available in June 2024.

We were also at Cine Gear last week - here’s a roundup of some of our video coverage:

🎥 Blackmagic's cloud sync feature enables editors to work with footage in real-time as it's being recorded, streamlining remote collaboration.

🔘 The C400's back-illuminated sensor enables 100% coverage of Canon's Dual Pixel CMOS autofocus, including body and animal detection, for improved focusing accuracy.

🎨 The Panasonic GH7 is the first non-ARRI camera to feature the ARRI Log C3 color profile, allowing for seamless integration with ARRI workflows.

💡 Aputure's new LS 600c Pro II light offers improved output, heat dissipation, and dimming capabilities while maintaining the same price and form factor as its predecessor.