The purpose of this book is to provide a practical introduction to the th- ries, techniques and applications of image fusion. The present work has been designed as a textbook for a one-semester ?nal-year undergraduate, or ?r- year graduate, course in image fusion. It should also be useful to practising engineers who wish to learn the concepts of image fusion and apply them to practical applications. In addition, the book may also be used as a supp- mentary text for a graduate course on topics in advanced image processing. The book complements the author’s previous work on multi-sensor data [1] fusion by concentrating exclusively on the theories, techniques and app- cations of image fusion. The book is intended to be self-contained in so far as the subject of image fusion is concerned, although some prior exposure to the ?eld of computer vision and image processing may be helpful to the reader. Apart from two preliminary chapters, the book is divided into three parts.

Part I Theories 1 Introduction . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3 1.1 Synergy . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3 1.2 Fusion Categories . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5 1.3 Image Fusion Process . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5 1.4 Pixel Level Algorithms . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 6 1.4.1 Averaging . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 7 1.4.2 Multi-scale . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 7 1.4.3 Region . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 7 1.5 Organization . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 7 1.6 Further Reading . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 7 2 Image Sensors . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 9 2.1 Digital Camera . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 9 2.2 Optical System . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 10 2.2.1 Perspective projection . . . . . . . . . . . . . . . . . . . . . . . . . . . . 10 2.2.2 Orthographic projection . . . . . . . . . . . . . . . . . . . . . . . . . . . 11 2.3 Recording Systems . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 11 2.3.1 Noise . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 11 2.4 Sampling . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 11 2.4.1 Quantization. . . . . .. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 12 2.4.2 Bayer . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 12 2.5 Spatial vs. Spectral Resolution . . . . . . . . . . . . . . . . . . . . . . . . . . . 13 2.5.1 Spatial Resolution . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 14 2.5.2 Spectral Resolution . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 15 2.6 Further Reading . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 15 3 Image Registration . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 17 3.1 Introduction . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 17 3.2 Pairwise Transformation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 18 3.3 Hierarchical Registration . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 19 3.4 Mosaic Image . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 20 3.4.1 Stitching . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 22 3.5 Similarity Measures . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 23 3.6 Software . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 23 3.7 Further Reading . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 24 4 Radiometric Calibration . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 25 4.1 Histogram matching . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 25 4.2 Robust Equalization . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 26 4.3 Midway Image Equalization . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 26 4.4

The purpose of this book is to provide a practical introduction to the th- ries, techniques and applications of image fusion. The present work has been designed as a textbook for a one-semester ?nal-year undergraduate, or ?r- year graduate, course in image fusion. It should also be useful to practising engineers who wish to learn the concepts of image fusion and apply them to practical applications. In addition, the book may also be used as a supp- mentary text for a graduate course on topics in advanced image processing. The book complements the author’s previous work on multi-sensor data [1] fusion by concentrating exclusively on the theories, techniques and app- cations of image fusion. The book is intended to be self-contained in so far as the subject of image fusion is concerned, although some prior exposure to the ?eld of computer vision and image processing may be helpful to the reader. Apart from two preliminary chapters, the book is divided into three parts.