While single-concept customization has been studied in 3D, multi-concept customization remains largely unexplored. To address this, we propose MultiDreamer3D that can generate coherent multi-concept 3D content in a divide-and-conquer manner. First, we generate 3D bounding boxes using an LLM-based layout controller. Next, a selective point cloud generator creates coarse point clouds for each concept. These point clouds are placed in the 3D bounding boxes and initialized into 3D Gaussian Splatting with concept labels, enabling precise identification of concept attributions in 2D projections. Finally, we refine 3D Gaussians via concept-aware interval score matching, guided by concept-aware diffusion. Our experimental results show that MultiDreamer3D not only ensures object presence and preserves the distinct identities of each concept but also successfully handles complex cases such as property change or interaction. To the best of our knowledge, we are the first to address the multi-concept customization in 3D.
尽管单一概念的定制在3D领域已被研究，但多概念定制仍然 largely 未被探索。为了解决这一问题，我们提出了MultiDreamer3D，它可以以分而治之的方式生成一致的多概念3D内容。首先，我们使用基于大型语言模型（LLM）的布局控制器生成3D边界框。接着，选择性点云生成器为每个概念创建粗略的点云。这些点云被放置在3D边界框内，并初始化为带有概念标签的3D高斯溅射，从而在2D投影中实现精确的概念归属识别。最后，我们通过概念感知的区间评分匹配和概念感知扩散来精炼3D高斯。实验结果表明，MultiDreamer3D不仅确保了物体的存在并保持每个概念的独特身份，而且成功处理了如属性变化或交互等复杂情况。根据我们所知，我们是首个解决3D中多概念定制问题的方法。