+ Site Statistics
+ Search Articles
+ Subscribe to Site Feeds
Most Shared
PDF Full Text
+ PDF Full Text
Request PDF Full Text
+ Follow Us
Follow on Facebook
Follow on Twitter
Follow on LinkedIn
+ Translate
+ Recently Requested

Structure-preserving interpolation of temporal and spatial image sequences using an optical flow-based method

Structure-preserving interpolation of temporal and spatial image sequences using an optical flow-based method

Methods of Information in Medicine 46(3): 300-307

Modern tomographic imaging devices enable the acquisition of spatial and temporal image sequences. But, the spatial and temporal resolution of such devices is limited and therefore image interpolation techniques are needed to represent images at a desired level of discretization. This paper presents a method for structure-preserving interpolation between neighboring slices in temporal or spatial image sequences. In a first step, the spatiotemporal velocity field between image slices is determined using an optical flow-based registration method in order to establish spatial correspondence between adjacent slices. An iterative algorithm is applied using the spatial and temporal image derivatives and a spatiotemporal smoothing step. Afterwards, the calculated velocity field is used to generate an interpolated image at the desired time by averaging intensities between corresponding points. Three quantitative measures are defined to evaluate the performance of the interpolation method. The behavior and capability of the algorithm is demonstrated by synthetic images. A population of 17 temporal and spatial image sequences are utilized to compare the optical flow-based interpolation method to linear and shape-based interpolation. The quantitative results show that the optical flow-based method outperforms the linear and shape-based interpolation statistically significantly. The interpolation method presented is able to generate image sequences with appropriate spatial or temporal resolution needed for image comparison, analysis or visualization tasks. Quantitative and qualitative measures extracted from synthetic phantoms and medical image data show that the new method definitely has advantages over linear and shape-based interpolation.

(PDF emailed within 0-6 h: $19.90)

Accession: 055962258

Download citation: RISBibTeXText

PMID: 17492116

DOI: 10.1160/ME9047

Related references

Interpolation and combination rules for the temporal and spatial enhancement of SEVIRI and MODIS thermal image sequences. International Journal of Remote Sensing 38(7): 1889-1911, 2017

Optical flow based volumetric spatio-temporal interpolation. Conference Proceedings 2008: 3979-3982, 2009

Image sequence interpolation based on optical flow, segmentation, and optimal control. IEEE Transactions on Image Processing 21(3): 1020-1030, 2011

Spatio-Temporal Image Pattern Prediction Method Based on a Physical Model With Time-Varying Optical Flow. IEEE Transactions on Geoscience and Remote Sensing 51(5): 3023-3036, 2013

A MAP-based image interpolation method via Viterbi decoding of Markov chains of interpolation functions. IEEE Transactions on Image Processing 23(1): 424-438, 2014

HEVC-EPIC: Fast Optical Flow Estimation from Coded Video via Edge-Preserving Interpolation. IEEE Transactions on Image Processing 2018, 2018

Tracking pylorus in ultrasonic image sequences with edge-based optical flow. IEEE Transactions on Medical Imaging 31(3): 843-855, 2012

Optical Flow Analysis Based on Spatio-Temporal Correlation of Dynamic Image. Systems and Computers in Japan 21(4): 97-108, 1990

A segmentation method for lung nodule image sequences based on superpixels and density-based spatial clustering of applications with noise. Plos One 12(9): E0184290, 2017

Medical Image Registration and Interpolation by Optical Flow with Maximal Rigidity. Journal of Mathematical Imaging and Vision 23(1): 47-65, 2005

A Markov random field approach for topology-preserving registration: application to object-based tomographic image interpolation. IEEE Transactions on Image Processing 21(4): 2047-2061, 2012

Optical Flow Estimation Combining Spatial-Temporal Derivatives Based Nonlinear Filtering. Ieice Transactions on Information and Systems E97.D(9): 2559-2562, 2014

Temporal-spatial characteristics and grading structure of vegetation fraction based on TM image in Guangzhou. Journal of Plant Resources and Environment 15(4): 25-29, 2006

Local spatial properties based image interpolation scheme using SVMs. Journal of Systems Engineering and Electronics 19(3): 618-623, 2008

An IR and visible image sequence automatic registration method based on optical flow. Machine Vision and Applications 24(5): 947-958, 2013