Reconfigurable vlsi architecture design for real time image stabilization

Автор: Bibhuti Bikramaditya , Ohyun Kwon , Sateesh Kumar Talapuri Venkata Sai , Benjamin Ryu , Joonki Paik

Журнал: Техническая акустика @ejta

Статья в выпуске: т.6, 2006 года.

Бесплатный доступ

This paper proposes reconfigurable VLSI (Very Large Scale Integration) architecture design of real time image stabilization to remove the unwanted displacement due to camera motion and the displacement of the target. This is based on image preprocessing, based many steps (namely light compensation, thresholding, scaling and offset, histogram equalization, LUT operator), followed by sub image phase correlation for motion estimation and kalman filtering for motion correction and stabilization. For the implementation into VLSI, FPGA (Field Programmable Gate Arrays) board consisting 3Ч2 array of vertex 2 as processing element (PEs) is interfaced with PCI port of the PC and the camcorder is connected to USB port of the FPGA board for capturing, visualization and testing of the image if any. Image preprocessing techniques are applied on input image before actual processing to suppress the unwanted distortion or to enhance some image features, which is important for further processing. Global motion is estimated from the local motion vector (LMV) and the average of two maximum peak amplitudes from the block of LMV decides its global motion vector, thereby accumulating motion vector for panning. The kalman filtering based motion correction system stabilizes image caused by unwanted movement or camera vibration. This proposed system design is expected to achieve a target frame rate of 30 fps, integration time 3.33 ms per frame producing 7.5 mbps image data when pixel is converted to 8 bit digital value for 320Ч240 QVGA input image. The proposed design algorithms has been implemented and verified with Frame grabber board (Matrox Meteor-II Mil-lite software) that is interfaced with camcorder and PC. Similarly, the same design has also been tested using ARM Emulator and DM320 Board (ARM9TDMI core, DSP core).

Еще

Короткий адрес: https://sciup.org/14316049

IDR: 14316049

Список литературы Reconfigurable vlsi architecture design for real time image stabilization

  • J. K. Paik, Y. C. Park, D. W. Kim. An adaptive motion decision system for digital image stabilizer based on edge pattern matching. IEEE Trans. Consumer Electronics, vol. 38, pp. 607-615, 1992.
  • K. Uomori, A. Morimura, H. Ishii, Y. Kitamura. Automatic image stabilization system by full-digital signal processing. IEEE Trans. Consumer Electronics, vol. 36, pp. 510-519, 1990.
  • S. Erturk. Digital image stabilization with Sub-image Phase correlation based global Motion Estimation. IEEE Trans. Consumer Electronics, vol. 49, pp. 1320-1325, 2003.
  • S. Erturk, T. J. Dennis. Image sequence stabilization based on DFT filtering. IEEE Proc. on Image Vision and Signal Processing, vol. 127, pp. 95-102, 2000.
  • H. Foroosh, J. B. Zerubia, M. Berthod. Extension of phase correlation to subpixel registration. IEEE Trans. Image Processing, vol. 11, pp. 188-200, 2002.
  • L. Marcenaro, G. Vernazza, C. S. Regazzoni. Image stabilization algorithms for videosurveillance applications. Proc. Int. Conf. on Image Processing, vol. 1, pp. 349-352, 2001.
  • Thomas H. Drayer, Josheph G. Tront, Tichard W. Conners, Philip A. Araman. A Development system for Real Time Image Vision Hardware Using Field Programmable Gate Arrays. In a proceedings of the 32-nd Hawaii International Conference on System Sciences. 1999.
  • Robbert D. Turney, Ali M. Reza, Justin G. R. Delva. FPGA Implementation of the Adaptive Temporal Kalman Filter for real time video filtering. http://www.xilinx.com/products/logicore/dsp/temporal_kalman_fltr.pdf
  • Pedro Cobos Arribus, Felix Monasterio and Huelin Macia. FPGA Board for real time vision development systems. http://ieeexplore.ieee.org/Xplore/login.jsp?url=/iel5/7865/21660/01004106.pdf?arnumber =1004106
  • Thomas Hudson Drayer. A design methodology for creating Programmable Logic based Real time Image Processing Hardware. PhD Dissertation. Virginia Polytechnic institute and State University.
Еще
Статья научная