好久沒寫部落格了，最近有點忙，然後自己也有點懶。。。。。。
最近確定自己要搞計算機視覺方向，然後就開始看斯坦福的cs231n課程，準備寫系列部落格記錄自己的學習過程及心得。
———————————–————以下是正文——————————————————–

KNN(K-鄰近演算法)

L1 distance: 曼哈頓距離

表示式：

import numpy as np


class KNN_L1:
    def __init__(self)
 
:
        pass

    def train(self, x, y):
        self.x_train = x
        self.y_train = y

    def predict(self, x):
        num_test = x.shape[0]
        Ypred = np.zeros(num_test, dtype=self.y_train.dtype)
            # 求和
            distances = np.sum(np.abs(self.x_train-x[i, :]), axis=1)
            # 求最小索引
 

            min_index = np.argmin(distances)
            # 排序
            Ypred[i] = self.y_train[min_index]
        return Ypred

L2 distance: 歐式距離

表示式：

import numpy as np


class KNN_L2:

    def __init__(self):
        pass
 


    def train(self,X,y):
        self.X_train=X
        self.y_train=y

    def predict(self,X,k=1,num_loops=0):
        if num_loops==0:
            dists=self.compute_distances_no_loops(X)
        elif num_loops==1:
            dists=self.compute_distances_one_loops(X)
        elif num_loops==2:
            dists=self.compute_distances_one_loops(X)
        return self.predict_labels(dists,k=k)

    #雙重迴圈
    def compute_distances_two_loops(self,X):
        num_test=X.shape[0]
        num_train=self.X_train.shape[0]
        dists=np.zeros((num_test,num_train))
        for i in range(num_test):
            for j in range(num_train):
                dists[i,j]=np.sqrt(np.sum(X[i,:]-self.X_train[j,:])**2))
        return dists

    # 一層迴圈
    def compute_distances_one_loop(self, X):
        num_test = X.shape[0]
        num_train = self.X_train.shape[0]
        dists = np.zeros((num_test, num_train))
        for i in range(num_test):
            dists[i, :] = np.sqrt(np.sum(np.square(self.X_train - X[i, :]), axis=1))
        return dists

    #無迴圈
    def compute_distances_no_loops(self, X):
        num_test = X.shape[0]
        num_train = self.X_train.shape[0]
        dists = np.zeros((num_test, num_train))
        test_sum = np.sum(np.square(X), axis=1)
        train_sum = np.sum(np.square(self.X_train), axis=1)
        inner_product = np.dot(X, self.X_train.T)
        dists = np.sqrt(-2 * inner_product + test_sum.reshape(-1, 1) + train_sum)
        return dists

    def predict_labels(self, dists, k=1):  # 2
        num_test = dists.shape[0]
        y_pred = np.zeros(num_test)
        for i in range(num_test):
            closest_y = []
            y_indicies = np.argsort(dists[i, :], axis=0)
            closest_y = self.y_train[y_indicies[: k]]  
            y_pred[i] = np.argmax(np.bincount(closest_y))  
        return y_pred

L1與L2區別

1.L1與座標軸有關，會隨著座標軸改變而改變，L2不會隨著座標軸的改變而改變
2.L1適用於某個有重要意義的特徵向量，L2適用於某個空間通用量，不知道其實際意義