1. 程式人生 > >[opencv]模板匹配演算法(單影象模板匹配和基於模板匹配的目標跟蹤)

[opencv]模板匹配演算法(單影象模板匹配和基於模板匹配的目標跟蹤)

1.模板匹配opencv函式

matchTemplate(InputArray image, InputArray temp, OutputArray result, int method)
Parameters:
  • image – Image where the search is running. It must be 8-bit or 32-bit floating-point.
  • templ – Searched template. It must be not greater than the source image and have the same data type.
  • result – Map of comparison results. It must be single-channel 32-bit floating-point. If image is W \times Hand templ is w \times h , then result is (W-w+1) \times (H-h+1) .
  • method – Parameter specifying the comparison method (see below).
第一個引數為輸入源影象,第二個引數為輸入模板影象,第三個引數為匹配結果,記錄在源影象上滑動視窗和模板的相似程度,第四個引數為匹配方法。 匹配方法: CV_TM_SQDIEF平方差匹配法,最好匹配為0,值越大匹配越差 CV_TM_SQDIEF_NORMED歸一化平方差匹配法 CV_TM_CCORR相關匹配法,採用乘法操作,數值越大表明匹配越好 CV_TM_CCORR_NORMED歸一化相關匹配法 CV_TM_CCOEFF相關係數匹配法,最好匹配為1,最差為-1 CV_TM_CCOEFF_NORMED歸一化相關係數匹配法 各匹配方法原理見以上鍊接。 minMaxLoc
(InputArray src, double* minVal, double* maxVal=0, Point* minLoc=0, Point* maxLoc=0, InputArraymask=noArray())
Parameters:
  • src – Source single-channel array.
  • minVal – Pointer to the returned minimum value. NULL is used if not required.
  • maxVal – Pointer to the returned maximum value. NULL is used if not required.
  • minLoc – Pointer to the returned minimum location (in 2D case). NULL is used if not required.
  • maxLoc – Pointer to the returned maximum location (in 2D case). NULL is used if not required.
  • mask – Optional mask used to select a sub-array.
尋找矩陣中最大最小值以及對應座標。

2.單影象模板匹配

原圖:
模板影象:
程式碼如下:
#include "stdafx.h"
#include "cv.h"
#include "highgui.h"
#include "cxcore.h"

using namespace std;
using namespace cv;

int _tmain(int argc, _TCHAR* argv[])
{
	Mat img,templ,result;
	img = imread("1.jpg");
	templ = imread("2.jpg");

	int result_cols = img.cols - templ.cols + 1;
	int result_rows = img.rows - templ.rows + 1;
	result.create(result_cols, result_rows, CV_32FC1);

	matchTemplate(img, templ, result, CV_TM_SQDIFF_NORMED);//CV_TM_SQDIFF_NORMED CV_TM_SQDIFF
	normalize(result, result, 0, 1, NORM_MINMAX, -1, Mat());

	double minVal;
	double maxVal;
	Point minLoc;
	Point maxLoc;
	Point matchLoc;

	minMaxLoc(result, &minVal, &maxVal, &minLoc, &maxLoc, Mat());

	matchLoc = minLoc;

	rectangle(img, matchLoc, Point(matchLoc.x + templ.cols, matchLoc.y + templ.rows), Scalar(0,255,0), 2, 8, 0);

	imshow("img", img);
	waitKey(0);

	return 0;
}

效果如下:

3.基於模板匹配的目標跟蹤

由於採用滑鼠畫矩形框的方式進行模板影象的提取,所以對滑鼠響應函式進行說明。 cvSetMouseCallback(const char* name, CvMouseCallback onMouse, void* param=NULL )
Parameters:
  • name – Window name
  • param – The optional parameter passed to the callback.
第一個引數為使用視窗名,第二個為onMouse滑鼠訊息訊息處理函式,第三個為傳給滑鼠訊息的任定引數。 這裡新增onMouse函式如下:
void onMouse(int event,int x,int y,int flags,void*param)//事件回傳代號,座標,代號,Mouse事件的代號名稱
{
	if (pause)
	{
		switch (event)
		{
		case CV_EVENT_MOUSEMOVE:
			if (drawbox){
				box.width = x - box.x;
				box.height = y - box.y;
			}
			break;
		case CV_EVENT_LBUTTONDOWN:
			drawbox = true;
			box = Rect(x, y, 0, 0);
			break;
		case CV_EVENT_LBUTTONUP:
			drawbox = false;
			if (box.width < 0){
				box.x += box.width;
				box.width *= -1;
			}
			if (box.height < 0){
				box.y += box.height;
				box.height *= -1;
			}

			cvtColor(img,imggray,CV_RGB2GRAY);
			templ = imggray(box);
			tracking = true;	
			rectangle(frame, box, Scalar(0, 255, 0), 3);
			imshow("ORI", frame);	
			imshow("Templ", templ);

			break;
		}
	}
}

Event:

 #define CV_EVENT_MOUSEMOVE 0                    滑動  #define CV_EVENT_LBUTTONDOWN 1              左鍵點選  #define CV_EVENT_RBUTTONDOWN 2             右鍵點選  #define CV_EVENT_MBUTTONDOWN 3            中鍵點選  #define CV_EVENT_LBUTTONUP 4                     左鍵放開  #define CV_EVENT_RBUTTONUP 5                    右鍵放開  #define CV_EVENT_MBUTTONUP 6                    中鍵放開  #define CV_EVENT_LBUTTONDBLCLK 7           左鍵雙擊  #define CV_EVENT_RBUTTONDBLCLK 8         右鍵雙擊  #define CV_EVENT_MBUTTONDBLCLK 9         中鍵雙擊
flags: 
#define CV_EVENT_FLAG_LBUTTON 1             左鍵拖曳  #define CV_EVENT_FLAG_RBUTTON 2           右鍵拖曳  #define CV_EVENT_FLAG_MBUTTON 4           中鍵拖曳  #define CV_EVENT_FLAG_CTRLKEY 8            (8~15)按Ctrl不放事件  #define CV_EVENT_FLAG_SHIFTKEY 16        (16~31)按Shift不放事件  #define CV_EVENT_FLAG_ALTKEY 32            (32~39)按Alt不放事件
模板匹配跟蹤函式如下:
void track(Mat gray, Mat &templ, Rect &box)
{
	double minVal;
	double maxVal;
	Point minLoc;
	Point maxLoc;
	matchTemplate(gray, templ, result, CV_TM_SQDIFF);
	minMaxLoc(result, &minVal, &maxVal, &minLoc, &maxLoc, Mat());
	matchLoc = minLoc;
	rectangle(gray, matchLoc, Point(matchLoc.x + templ.cols, matchLoc.y + templ.rows), Scalar(0,0,255), 2, 8, 0);
}


GIF效果如下: