Exploring Cartwheel: A New AI Prompt Tool for 3D Motion Capture

Recently, I was invited to beta test Cartwheel, a new AI-powered tool that turns text prompts into functional 3D motion capture. The tool supports various formats, including FBX, making it versatile for 3D projects. Naturally, I jumped at the chance to try it out and wanted to share my thoughts on its progress so far.

First Impressions

The website is still in its early stages, and while the design is basic, it’s highly functional. The simplicity actually works in its favor, making it easy to navigate and test. The main feature is a prompting section where you type in your desired actions, and the tool generates a video of a 3D character performing the movement based on your input. The character rigs act as a point of reference, and you can make some basic customizations. However, the real magic lies in how accurately the tool interprets the prompts.

Testing the Prompts

To get a sense of how well Cartwheel performs, I started with some simple prompts like "give a thumbs up," "point to the top right," and "do a headstand." The tool handled these quite well, with the animations looking smooth and functional.

One of the features I was particularly curious about was its ability to sequence movements. For this test, I asked it to point to the top right, do a cartwheel, give a thumbs up, and finish with the Macarena. While this was a more complex sequence and proved challenging for the AI, the results were promising. Although it wasn’t perfect, it did manage to perform the Macarena, which was impressive given the current stage of development.

Exporting and Working with Files

After generating the animations, Cartwheel offers several export options. Basic exports are available as straightforward videos, but there’s also a pro-level option, which I found particularly useful. In my case, I exported the animation as a GILB file for Blender, as well as an FBX file, which includes the animation data.

When I imported the FBX into Cinema 4D, I noticed the model appeared larger than a typical character, which was easily fixable. There was also a slight hovering effect with the character, but overall, the movements came through with the correct frame rates and looked accurate.

Final Thoughts

It's still early days for Cartwheel, but I’m genuinely impressed with what it can already do. Character animation is a highly specialized skill—just look at how much time Disney spent perfecting it. The ability to simply input a prompt and get a functional animation opens up a world of possibilities for non-specialists.

Motion capture usually requires expensive equipment and expertise, but Cartwheel eliminates much of that complexity. While I don’t see it replacing high-end motion capture for blockbuster films anytime soon, it has great potential for simpler projects where detailed, high-end motion capture isn’t necessary.

As the tool evolves, I expect it will handle more complex prompts and refine its output. For now, Cartwheel is a fantastic solution for those who lack the technical skills or resources to do full-scale motion capture but still want to create realistic character animations. I’m excited to see where they take it from here!

Previous
Previous

The Potential of Runway Gen 3 Alpha for AI-Generated Animations

Next
Next

Your Ultimate Midjourney Cheat Sheet