最適輸送理論(OT: Optimal Transport)

距離空間

距離空間とは,距離の構造にあたる「距離関数」を備えた集合のこと。

距離関数(distance function)、距離計量(distance metric)とは

集合X上の函数 d: X × X → R (ここで、R は実数全体の成す集合)が距離函数であるとは、x, y, zX の任意の元として、以下の条件をすべて満たす

  1. d(x, y) ≥ 0 (非負性 non-negativity)
  2. d(x, y) = 0 if and only if x = y (同一律 reflexivity)
  3. d(x, y) = d(y, x) (対称律 symmetry)
  4. d(x, z) ≤ d(x, y) + d(y, z) (劣加法性あるいは三角不等式 triangle inequality)

距離計量

  1. Minkowski (Lp) distance
    • Manhattan distance/City block distabce(L1)
    • Euclidian distance (L2)
    • Chessboard distance/Chebyshev distance (Loo, infinity})
  2. Jaccard distance
  3. Hausdorff distance
  4. earth mover's distance
  5. Mahalanobis metric, d_M(x,y)=sqrt{(x-y)^TM(x-y)}
  6. Fréchet distance:dis bet. curves, trajectories, prob. distributions

非計量距離(類似性・非類似性)

  1. fractional Lp distances
  2. cosine measure
  3. Jeffrey-divergence
  4. k-median distance
  5. partial Hausdorff distance (pHD)
  6. (dynamic) time warping distance (DTW)
  7. longest common subsequence(LCSS)
  8. Kullback-Leibler divergence
  9. Bregman divergence/distance
  10. user-defined similarity measure

学習・動的距離

  1. dynamic preference
  2. multi-metric (dynamic combinations of metrics),

Distance Metric Learning

Metric learning is the task of learning a distance function over objects. Distance Metric learning is to learn a distance metric for the input space of data from a given collection of pair of similar/dissimilar points that preserves the distance relation among the training data.

Kernel Methods

In pattern analysis, the general task is to find and study general types of relations (for example clusters, rankings, principal components, correlations, classifications) in datasets. Kernel methods require only a user-specified kernel, i.e., a similarity function over pairs of data points in raw representation, instead explicitly transforming raw representation into feature vector representations.

参考文献

  1. T. Skopal, Unified Framework for Fast Exact and Approximate Search in Dissimilarity Spaces, ACM TODS 2007 pp.1-45
  2. 佐藤 竜馬,最適輸送入門
  3. 太田 慎一,最適輸送理論とその周辺

Last-modified: 2023-09-16 (土) 16:32:13