This work centers on digital stack photography and its applications.
A stack of images refer, in a broader sense, to an ensemble of
associated images taken with variation in one or more than one various
values in one or more parameters in system configuration or setting.
An image stack captures and contains potentially more information than
any of the constituent images. Digital stack photography (DST)
techniques explore the rich information to render a synthesized image
that oversteps the limitation in a digital camera's capabilities.
This work considers in particular two basic DST problems, which had
been challenging, and their applications. One is high-dynamic-range
(HDR) imaging of non-stationary dynamic scenes, in which the stacked
images vary in exposure conditions. The other
is large scale panorama composition from multiple images. In this
case, the image components are related to each other by the spatial
relation among the subdomains of the same scene they covered and
captured jointly. We consider the non-conventional, practical and
challenge situations where the spatial overlap among the sub-images is
sparse (S), irregular in geometry and imprecise from the designed
geometry (I), and the captured data over the overlap zones are noisy
(N) or lack of features. We refer to these conditions simply as the
S.I.N. conditions.
There are common challenging issues with both problems. For example,
both faced the dominant problem with image alignment for
seamless and artifact-free image composition. Our solutions to the
common problems are manifested differently in each of the particular
problems, as a result of adaption to the specific properties in each
type of image ensembles. For the exposure stack, existing
alignment approaches struggled to overcome three main challenges:
inconsistency in brightness, large displacement in dynamic scene and
pixel saturation. We exploit solutions in the following three
aspects. In the first, we introduce a model that addresses and admits
changes in both geometric configurations and optical conditions, while
following the traditional optical flow description. Previous models
treated these two types of changes one or the other, namely, with
mutual exclusions. Next, we extend the pixel-based optical flow model
to a patch-based model. There are two-fold advantages. A patch has
texture and local content that individual pixels fail to present. It
also renders opportunities for faster processing, such as via
two-scale or multiple-scale processing. The extended model is then
solved efficiently with an EM-like algorithm, which is reliable in the
presence of large displacement. Thirdly, we present a generative
model for reducing or eliminating typical artifacts as a side effect
of an inadequate alignment for clipped pixels. A patch-based texture
synthesis is combined with the patch-based alignment to achieve an
artifact free result.
For large-scale panorama composition under the S.I.N. conditions, we
have developed an effective solution scheme that significantly reduces
both processing time and artifacts. Previously existing approaches can
be roughly categorized as either geometry-based composition or feature
based composition. In the former approach, one relies on precise
knowledge of the system geometry, by design and/or calibration. It
works well with a far-away scene, in which case there is only limited
variation in projective geometry among the sub-images. However, the
system geometry is not invariant to physical conditions such as
thermal variation, stress variation and etc.. The composition with
this approach is typically done in the spatial space. The other
approach is more robust to geometric and optical conditions. It works
surprisingly well with feature-rich and stationary scenes, not well
with the absence of recognizable features. The composition based on
feature matching is typically done in the spatial gradient domain. In
short, both approaches are challenged by the S.I.N. conditions. With
certain snapshot data sets obtained and contributed by Brady et al,
these methods either fail in composition or render images with
visually disturbing artifacts. To overcome the S.I.N. conditions, we
have reconciled these two approaches and made successful and
complementary use of both priori and approximate information about
geometric system configuration and the feature information from the
image data. We also designed and developed a software architecture
with careful extraction of primitive function modules that can be
efficiently implemented and executed in parallel. In addition to a
much faster processing speed, the resulting images are clear and
sharper at the overlapping zones, without typical ghosting artifacts.
","abstract_html":"<p>This work centers on digital stack photography and its applications.</p><p>A stack of images refer, in a broader sense, to an ensemble of</p><p>associated images taken with variation in one or more than one various </p><p>values in one or more parameters in system configuration or setting.</p><p>An image stack captures and contains potentially more information than</p><p>any of the constituent images. Digital stack photography (DST)</p><p>techniques explore the rich information to render a synthesized image</p><p>that oversteps the limitation in a digital camera's capabilities.</p><p>This work considers in particular two basic DST problems, which had</p><p>been challenging, and their applications. One is high-dynamic-range</p><p>(HDR) imaging of non-stationary dynamic scenes, in which the stacked</p><p>images vary in exposure conditions. The other</p><p>is large scale panorama composition from multiple images. In this</p><p>case, the image components are related to each other by the spatial</p><p>relation among the subdomains of the same scene they covered and</p><p>captured jointly. We consider the non-conventional, practical and</p><p>challenge situations where the spatial overlap among the sub-images is</p><p>sparse (S), irregular in geometry and imprecise from the designed</p><p>geometry (I), and the captured data over the overlap zones are noisy</p><p>(N) or lack of features. We refer to these conditions simply as the</p><p>S.I.N. conditions.</p><p>There are common challenging issues with both problems. For example,</p><p>both faced the dominant problem with image alignment for</p><p>seamless and artifact-free image composition. Our solutions to the</p><p>common problems are manifested differently in each of the particular</p><p>problems, as a result of adaption to the specific properties in each</p><p>type of image ensembles. For the exposure stack, existing</p><p>alignment approaches struggled to overcome three main challenges:</p><p>inconsistency in brightness, large displacement in dynamic scene and</p><p>pixel saturation. We exploit solutions in the following three</p><p>aspects. In the first, we introduce a model that addresses and admits</p><p>changes in both geometric configurations and optical conditions, while</p><p>following the traditional optical flow description. Previous models</p><p>treated these two types of changes one or the other, namely, with</p><p>mutual exclusions. Next, we extend the pixel-based optical flow model</p><p>to a patch-based model. There are two-fold advantages. A patch has</p><p>texture and local content that individual pixels fail to present. It</p><p>also renders opportunities for faster processing, such as via</p><p>two-scale or multiple-scale processing. The extended model is then</p><p>solved efficiently with an EM-like algorithm, which is reliable in the</p><p>presence of large displacement. Thirdly, we present a generative</p><p>model for reducing or eliminating typical artifacts as a side effect</p><p>of an inadequate alignment for clipped pixels. A patch-based texture</p><p>synthesis is combined with the patch-based alignment to achieve an</p><p>artifact free result.</p><p>For large-scale panorama composition under the S.I.N. conditions, we</p><p>have developed an effective solution scheme that significantly reduces</p><p>both processing time and artifacts. Previously existing approaches can</p><p>be roughly categorized as either geometry-based composition or feature</p><p>based composition. In the former approach, one relies on precise</p><p>knowledge of the system geometry, by design and/or calibration. It</p><p>works well with a far-away scene, in which case there is only limited</p><p>variation in projective geometry among the sub-images. However, the</p><p>system geometry is not invariant to physical conditions such as</p><p>thermal variation, stress variation and etc.. The composition with</p><p>this approach is typically done in the spatial space. The other</p><p>approach is more robust to geometric and optical conditions. It works</p><p>surprisingly well with feature-rich and stationary scenes, not well</p><p>with the absence of recognizable features. The composition based on</p><p>feature matching is typically done in the spatial gradient domain. In</p><p>short, both approaches are challenged by the S.I.N. conditions. With</p><p>certain snapshot data sets obtained and contributed by Brady et al, </p><p>these methods either fail in composition or render images with</p><p>visually disturbing artifacts. To overcome the S.I.N. conditions, we</p><p>have reconciled these two approaches and made successful and</p><p>complementary use of both priori and approximate information about</p><p>geometric system configuration and the feature information from the</p><p>image data. We also designed and developed a software architecture</p><p>with careful extraction of primitive function modules that can be</p><p>efficiently implemented and executed in parallel. In addition to a</p><p>much faster processing speed, the resulting images are clear and</p><p>sharper at the overlapping zones, without typical ghosting artifacts.</p>","abstract_has_math":false,"creators":["Hu, Jun"],"institution":null,"degree_name":null,"degree_level":null,"degree_discipline":null,"degree_department":null,"school":null,"contributors":[],"advisors":["Sun, Xiaobai"],"committee_chairs":[],"committee_members":[],"year":2014,"date_issued":"2014","date_published":"2014","updated_at":"2026-07-24T02:07:15Z","subjects":["Computer science","Computational Photography","HDR","Panorama"],"languages":[],"rights":[],"rights_urls":[],"identifier_entries":[]},"links":{"outbound_url":"https://hdl.handle.net/10161/8691","outbound_label":"Handle","outbound_source":"dc:identifier.uri"},"metadata_groups":[{"id":"people","label":"People","entries":[{"key":"dc:contributor.advisor","label":"Advisor","values":["Sun, Xiaobai"]},{"key":"dc:creator","label":"Author","values":["Hu, Jun"]}]},{"id":"academic_context","label":"Academic Context","entries":[{"key":"dc:date.accessioned","label":"Dc Date Accessioned","values":["2014-05-14T19:17:23Z"]},{"key":"dc:date.available","label":"Dc Date Available","values":["2015-05-09T04:30:05Z"]},{"key":"dc:date.issued","label":"Date","values":["2014"]},{"key":"dc:type","label":"Dc Type","values":["Dissertation"]}]},{"id":"subjects_keywords","label":"Subjects and Keywords","entries":[{"key":"dc:subject","label":"Dc Subject","values":["Computer science","Computational Photography","HDR","Panorama"]}]},{"id":"identifiers","label":"Identifiers","entries":[{"key":"dc:identifier.uri","label":"Identifier URI","values":["https://hdl.handle.net/10161/8691"]}]},{"id":"additional","label":"Additional Metadata","entries":[{"key":"dc:description.abstract","label":"Abstract","values":["This work centers on digital stack photography and its applications.
A stack of images refer, in a broader sense, to an ensemble of
associated images taken with variation in one or more than one various
values in one or more parameters in system configuration or setting.
An image stack captures and contains potentially more information than
any of the constituent images. Digital stack photography (DST)
techniques explore the rich information to render a synthesized image
that oversteps the limitation in a digital camera's capabilities.
This work considers in particular two basic DST problems, which had
been challenging, and their applications. One is high-dynamic-range
(HDR) imaging of non-stationary dynamic scenes, in which the stacked
images vary in exposure conditions. The other
is large scale panorama composition from multiple images. In this
case, the image components are related to each other by the spatial
relation among the subdomains of the same scene they covered and
captured jointly. We consider the non-conventional, practical and
challenge situations where the spatial overlap among the sub-images is
sparse (S), irregular in geometry and imprecise from the designed
geometry (I), and the captured data over the overlap zones are noisy
(N) or lack of features. We refer to these conditions simply as the
S.I.N. conditions.
There are common challenging issues with both problems. For example,
both faced the dominant problem with image alignment for
seamless and artifact-free image composition. Our solutions to the
common problems are manifested differently in each of the particular
problems, as a result of adaption to the specific properties in each
type of image ensembles. For the exposure stack, existing
alignment approaches struggled to overcome three main challenges:
inconsistency in brightness, large displacement in dynamic scene and
pixel saturation. We exploit solutions in the following three
aspects. In the first, we introduce a model that addresses and admits
changes in both geometric configurations and optical conditions, while
following the traditional optical flow description. Previous models
treated these two types of changes one or the other, namely, with
mutual exclusions. Next, we extend the pixel-based optical flow model
to a patch-based model. There are two-fold advantages. A patch has
texture and local content that individual pixels fail to present. It
also renders opportunities for faster processing, such as via
two-scale or multiple-scale processing. The extended model is then
solved efficiently with an EM-like algorithm, which is reliable in the
presence of large displacement. Thirdly, we present a generative
model for reducing or eliminating typical artifacts as a side effect
of an inadequate alignment for clipped pixels. A patch-based texture
synthesis is combined with the patch-based alignment to achieve an
artifact free result.
For large-scale panorama composition under the S.I.N. conditions, we
have developed an effective solution scheme that significantly reduces
both processing time and artifacts. Previously existing approaches can
be roughly categorized as either geometry-based composition or feature
based composition. In the former approach, one relies on precise
knowledge of the system geometry, by design and/or calibration. It
works well with a far-away scene, in which case there is only limited
variation in projective geometry among the sub-images. However, the
system geometry is not invariant to physical conditions such as
thermal variation, stress variation and etc.. The composition with
this approach is typically done in the spatial space. The other
approach is more robust to geometric and optical conditions. It works
surprisingly well with feature-rich and stationary scenes, not well
with the absence of recognizable features. The composition based on
feature matching is typically done in the spatial gradient domain. In
short, both approaches are challenged by the S.I.N. conditions. With
certain snapshot data sets obtained and contributed by Brady et al,
these methods either fail in composition or render images with
visually disturbing artifacts. To overcome the S.I.N. conditions, we
have reconciled these two approaches and made successful and
complementary use of both priori and approximate information about
geometric system configuration and the feature information from the
image data. We also designed and developed a software architecture
with careful extraction of primitive function modules that can be
efficiently implemented and executed in parallel. In addition to a
much faster processing speed, the resulting images are clear and
sharper at the overlapping zones, without typical ghosting artifacts.
"]},{"key":"dc:title","label":"Title","values":["Digital Stack Photography and Its Applications"]}]}],"canonical_facts":{"dc:contributor.advisor":["Sun, Xiaobai"],"dc:creator":["Hu, Jun"],"dc:date.accessioned":["2014-05-14T19:17:23Z"],"dc:date.available":["2015-05-09T04:30:05Z"],"dc:date.issued":["2014"],"dc:description.abstract":["This work centers on digital stack photography and its applications.
A stack of images refer, in a broader sense, to an ensemble of
associated images taken with variation in one or more than one various
values in one or more parameters in system configuration or setting.
An image stack captures and contains potentially more information than
any of the constituent images. Digital stack photography (DST)
techniques explore the rich information to render a synthesized image
that oversteps the limitation in a digital camera's capabilities.
This work considers in particular two basic DST problems, which had
been challenging, and their applications. One is high-dynamic-range
(HDR) imaging of non-stationary dynamic scenes, in which the stacked
images vary in exposure conditions. The other
is large scale panorama composition from multiple images. In this
case, the image components are related to each other by the spatial
relation among the subdomains of the same scene they covered and
captured jointly. We consider the non-conventional, practical and
challenge situations where the spatial overlap among the sub-images is
sparse (S), irregular in geometry and imprecise from the designed
geometry (I), and the captured data over the overlap zones are noisy
(N) or lack of features. We refer to these conditions simply as the
S.I.N. conditions.
There are common challenging issues with both problems. For example,
both faced the dominant problem with image alignment for
seamless and artifact-free image composition. Our solutions to the
common problems are manifested differently in each of the particular
problems, as a result of adaption to the specific properties in each
type of image ensembles. For the exposure stack, existing
alignment approaches struggled to overcome three main challenges:
inconsistency in brightness, large displacement in dynamic scene and
pixel saturation. We exploit solutions in the following three
aspects. In the first, we introduce a model that addresses and admits
changes in both geometric configurations and optical conditions, while
following the traditional optical flow description. Previous models
treated these two types of changes one or the other, namely, with
mutual exclusions. Next, we extend the pixel-based optical flow model
to a patch-based model. There are two-fold advantages. A patch has
texture and local content that individual pixels fail to present. It
also renders opportunities for faster processing, such as via
two-scale or multiple-scale processing. The extended model is then
solved efficiently with an EM-like algorithm, which is reliable in the
presence of large displacement. Thirdly, we present a generative
model for reducing or eliminating typical artifacts as a side effect
of an inadequate alignment for clipped pixels. A patch-based texture
synthesis is combined with the patch-based alignment to achieve an
artifact free result.
For large-scale panorama composition under the S.I.N. conditions, we
have developed an effective solution scheme that significantly reduces
both processing time and artifacts. Previously existing approaches can
be roughly categorized as either geometry-based composition or feature
based composition. In the former approach, one relies on precise
knowledge of the system geometry, by design and/or calibration. It
works well with a far-away scene, in which case there is only limited
variation in projective geometry among the sub-images. However, the
system geometry is not invariant to physical conditions such as
thermal variation, stress variation and etc.. The composition with
this approach is typically done in the spatial space. The other
approach is more robust to geometric and optical conditions. It works
surprisingly well with feature-rich and stationary scenes, not well
with the absence of recognizable features. The composition based on
feature matching is typically done in the spatial gradient domain. In
short, both approaches are challenged by the S.I.N. conditions. With
certain snapshot data sets obtained and contributed by Brady et al,
these methods either fail in composition or render images with
visually disturbing artifacts. To overcome the S.I.N. conditions, we
have reconciled these two approaches and made successful and
complementary use of both priori and approximate information about
geometric system configuration and the feature information from the
image data. We also designed and developed a software architecture
with careful extraction of primitive function modules that can be
efficiently implemented and executed in parallel. In addition to a
much faster processing speed, the resulting images are clear and
sharper at the overlapping zones, without typical ghosting artifacts.
"],"dc:identifier.uri":["https://hdl.handle.net/10161/8691"],"dc:subject":["Computer science","Computational Photography","HDR","Panorama"],"dc:title":["Digital Stack Photography and Its Applications"],"dc:type":["Dissertation"]},"updated_at":"2026-07-24T02:07:15Z"}