date
type
status
slug
summary
tags
category
icon
password
by Simon Meng, mp.weixin.qq.comSee original
Large language models are growing larger, seemingly poised to take over everything. However, it seems that no one has yet considered "space" as a compatible "modality" for LLMs 🤔—here, space is not narrowly defined as a 3D model or point cloud but includes spatial relationships that reflect human perception habits. For instance, at the end of a narrow, dimly lit corridor, people expect a bright and tranquil courtyard, with a cozy room nearby; such relationships are crucial for providing comfort in virtual environments.
 
 
As a group of tech enthusiasts architects , we have developed a GNN (Graph Neural Network) model that can learn spatial topological relationships and architectural experiences. This model reconnects LLMs with game engines and 3D assets, enabling the abstract spatial descriptions output by LLMs to be rapidly transformed into fully traversable, immersive experiences that align with human perceptual habits in 3D (game level) prototypes. Furthermore, it supports quick modifications and adjustments through dialogue!
🤩 Ultimately, we aim to create a cross-modal spatial reasoning model that is ready for the AI-native game + XR + metaverse era on the horizon!
🤗 This is just one facet of our spatial computing research; our ongoing work also includes full-scene 3D content migration based on text input and LLM dialogue, akin to generalized neural radiance fields (NeRF). We are well aware that these are difficult yet right pursuits. Fortunately, we are lucky enough to have completed a seed round financing led by Qiji Chuangtan, allowing our dreams to continue.
相关文章
DreamGaussian: The Stable Diffusion Moment of AIGC 3D Generation
Lazy loaded image
How I Used AI to Create a Promotional Video for Xiaomi's Daniel Arsham Limited Edition Smartphone
Lazy loaded image
3D scene editing has entered the era of AI text interaction
Lazy loaded image
Works Series - Dimensional Recasting
Lazy loaded image
The 2022 Venice - Metaverse Art Annual Exhibition: How Nature Inspires Design
Lazy loaded image
Hidden Time Space 5: Cloudscape Artistry — "Vintage" AI Model Generates Retro Chinese-Style Landscape Animation
Lazy loaded image
A Guide to Combating Anxiety in the AI Era — Are Humans "Doomed" After Being Surrounded by AI?He actually uses artificial intelligence to 'dream'.
Loading...
Simon Shengyu Meng
Simon Shengyu Meng
AI artist driven by curiosity, cross-disciplinary researcher, PhD candidate, science communication blogger.
最新发布
Works Series - Boundless Intelligence
Oct 13, 2024
Works Series - RE-Imaginate nature
Oct 8, 2024
Supernova Explosion | Simon Meng | AI Genesis
Oct 5, 2024
At the end of 2023, I want to share two comforting AI tools with you and have a heartfelt chat.
Oct 5, 2024
"Slacking Off" but Accidentally Discovering a New Vision for AI — Interview with GAAC Contestants Wang Zheng and Meng Shengyu
Oct 5, 2024
Using AI to transcend every doomsday of humanity until the end of the universe!
Oct 5, 2024
公告
--- About me ---
--- Contact Me ---
Design and Art Creation | AIGC Consultation and Training | Commercial Deployment