Real-time Animation Generation and Control on Rigged Models via Large ...
WEBA showroom for various animations generated by large language models (LLM). Our method takes a rigged 3D model and produces novel animations specified via natural language descriptions in a matter of seconds.
Real-time Animation Generation and Control on Rigged Models via Large ...
WEBOct 27, 2023 · We introduce a novel method for real-time animation control and generation on rigged models using natural language input. First, we embed a large language model (LLM) in Unity to output structured texts that can be …
Keyframer: Empowering Animation Design using Large Language Models
WEBFeb 8, 2024 · We combined emerging design principles for language-based prompting of design artifacts with code-generation capabilities of LLMs to build a new AI-powered animation tool called Keyframer. With Keyframer, users can create animated illustrations from static 2D images via natural language prompting.
Keyframer: Empowering Animation Design using Large Language Models ...
WEBWe evaluated Keyframer with 13 users with a range of animation and programming experience, examining their prompting strategies and how they considered incorporating design variants into their process.
Keyframer: Empowering Animation Design using Large Language Models - GitHub
WEBKeyframer is a design tool for animating static images using natural language prompts. It enables users to refine animations by directly editing generated designs and explore alternatives by requesting variants.
VideoPoet: A large language model for zero-shot video generation
WEBDec 19, 2023 · An overview of VideoPoet, capable of multitasking on a variety of video-centric inputs and outputs. The LLM can optionally take text as input to guide generation for text-to-video, image-to-video, video-to-audio, stylization, and outpainting tasks. Resources used: Wikimedia Commons and DAVIS.
WEBWe introduce a novel method for real-time animation control and generation on rigged models using natural language input. First, we embed a large language model (LLM) in Unity to output structured texts that can be parsed into diverse and realistic animations.
Real-time Animation Generation and Control on Rigged Models via Large ...
WEBOct 27, 2023 · First, we embed a large language model (LLM) in Unity to output structured texts that can be parsed into diverse and realistic animations. Second, we illustrate LLM's potential to enable flexible state transition between existing animations. We showcase the robustness of our approach through qualitative results on …
Real-time Animation Generation and Control on Rigged Models via Large ...
WEBWe introduce a novel method for real-time animation control and generation on rigged models using natural language input. First, we embed a large language model (LLM) in Unity to output structured texts that can be parsed into diverse and realistic animations.
GitHub - ActiveVisionLab/Awesome-LLM-3D: Awesome-LLM-3D: …
WEBDec 16, 2023 · Here is a curated list of papers about 3D-Related Tasks empowered by Large Language Models (LLMs). It contains various tasks including 3D understanding, reasoning, generation, and embodied agents. Also, we include other Foundation Models (CLIP, SAM) for the whole picture of this area.