UrbanIR: Large-Scale Urban Scene Inverse Rendering from a Single Video
Chih-Hao Lin, 刘博涵 (Bohan Liu), Yi-Ting Chen, Kuan-Sheng Chen, David Forsyth, Jia-Bin Huang, Anand Bhattad, Shenlong Wang
摘要
此摘要由英文原文自動翻譯。
我們提出UrbanIR(Urban Scene Inverse Rendering)——一個新的逆圖形學模型,能從單一段影片實現各種光照條件下場景的真實感自由視角渲染。它能從寬基線影片(如車載攝影機)精確推斷形狀、反照率、能見度以及太陽與天空光照,有別於NeRF的密集視角設定。在此情境下,標準方法常產生不佳的幾何與材質估計,例如不精確的屋頂表徵與大量「漂浮物」。UrbanIR以新損失函數解決這些問題,降低逆圖形推論誤差與渲染瑕疵。其技術能精確估計原始場景中的陰影體積。模型輸出支援可控編輯,可實現夜間模擬、重新光照場景與插入物體的擬真自由視角渲染,標誌著對現有最先端方法的顯著改進。
原始摘要(英文)
We present UrbanIR (Urban Scene Inverse Rendering), a new inverse graphics model that enables realistic, free-viewpoint renderings of scenes under various lighting conditions with a single video. It accurately infers shape, albedo, visibility, and sun and sky illumination from wide-baseline videos, such as those from car-mounted cameras, differing from NeRF's dense view settings. In this context, standard methods often yield subpar geometry and material estimates, such as inaccurate roof representations and numerous 'floaters'. UrbanIR addresses these issues with novel losses that reduce errors in inverse graphics inference and rendering artifacts. Its techniques allow for precise shadow volume estimation in the original scene. The model's outputs support controllable editing, enabling photorealistic free-viewpoint renderings of night simulations, relit scenes, and inserted objects, marking a significant improvement over existing state-of-the-art methods.
本文貢獻
Inverse rendering of large-scale urban scenes from a single casually-captured video: decomposing the city into albedo, geometry, and transient lighting, enabling photorealistic relighting and editing far beyond prior single-image methods.
BibTeX
@inproceedings{lin2025urbanir,
title = {UrbanIR: Large-Scale Urban Scene Inverse Rendering from a Single Video},
author = {Chih-Hao Lin and Bohan Liu and Yi-Ting Chen and Kuan-Sheng Chen and David Forsyth and Jia-Bin Huang and Anand Bhattad and Shenlong Wang},
booktitle = {International Conference on 3D Vision (3DV)},
year = {2025},
url = {https://arxiv.org/abs/2306.09349}
}