A Probabilistic Approach to the Semantic Interpretation of Building Facades

Show full item record

Please use this identifier to cite or link to this item: http://hdl.handle.net/1853/4483

Title: A Probabilistic Approach to the Semantic Interpretation of Building Facades
Author: Alegre, Fernando ; Dellaert, Frank
Abstract: We present a probabilistic image-based approach to the semantic interpretation of building facades. We are motivated by the 4D Atlanta project at Georgia Tech, which aims to create a system that takes a collection of historical imagery of a city and infers a 3D model parameterized by time. Here it is necessary to recover, from historical imagery, metric and semantic information about buildings that might no longer exist or have undergone extensive change. Current approaches to automated 3D model reconstruction typically recover only geometry, and a systematic approach that allows hierarchical classification of structural elements is still largely missing. We extract metric and semantic information from images of facades, allowing us to decode the structural elements in them and their inter-relationships, thus providing access to highly structured descriptions of buildings. Our method is based on constructing a Bayesian generative model from stochastic context-free grammars that encode knowledge about facades. This model combines low-level segmentation and high-level hierarchical labelling so that the levels reinforce each other and produce a detailed hierarchical partition of the depicted facade into structural blocks. Markov chain Monte Carlo sampling is used to approximate the posterior over partitions given an image.
Type: Technical Report
URI: http://hdl.handle.net/1853/4483
Date: 2004
Relation: GVU Technical Report;GIT-GVU-04-31
Publisher: Georgia Institute of Technology
Subject: Segmentation
Facades
Stochastic grammars
Sampling
Generative model
Image parsing
Semantic
Inference
Structural elements
Bayesian

All materials in SMARTech are protected under U.S. Copyright Law and all rights are reserved, unless otherwise specifically indicated on or in the materials.

Files in this item

Files Size Format View
04-31.pdf 682.7Kb PDF View/ Open

This item appears in the following Collection(s)

Show full item record