Metric learning with submodular functions

[摘要] Most of the metric learning mainly focuses on using single feature weights with L-p norms, or the pair of features with Mahalanobis distances to learn the similarities between the samples, while ignoring the potential value of higher-order interactions in the feature space. In this paper, we investigate the possibility of learning weights to coalitions of features whose cardinality can be greater than two, with the help of set-functions. With the more particular property of submodular set-function, we propose to define a metric for continuous features based on Lovasz extension of submodular functions, and then present a dedicated metric learning approach. According to the submodular constraints, it naturally leads to a higher complexity price so that we use the xi-additive fuzzy measure to decrease this complexity, by reducing the order of interactions that are taken into account. This approach finally gives a computationally, feasible problem. Experiments on various datasets show the effectiveness of the approach. (C) 2020 Elsevier B.V. All rights reserved.

[发布日期] 2020-11-27

[关键词] Metric learning;Nonlinear metric;Submodular functions