×

Regularized nonmonotone submodular maximization. (English) Zbl 07858271

Summary: In this paper, we present a thorough study of the regularized submodular maximization problem, in which the objective \(f := g-\ell\) can be expressed as the difference between a submodular function and a modular function. This problem has drawn much attention in recent years. While existing works focuses on the case of \(g\) being monotone, we investigate the problem with a nonmonotone \(g\). The main technique we use is to introduce a distorted objective function, which varies weights of the submodular component \(g\) and the modular component \(\ell\) during the iterations of the algorithm. By combining the weighting technique and measured continuous greedy algorithm, we present an algorithm for the matroid-constrained problem, which has a provable approximation guarantee. In the cardinality-constrained case, we utilize random greedy algorithm and sampling technique together with the weighting technique to design two efficient algorithms. Moreover, we consider the unconstrained problem and propose a much simpler and faster algorithm compared with the algorithms for solving the problem with a cardinality constraint.

MSC:

90C27 Combinatorial optimization
90C59 Approximation methods and heuristics in mathematical programming
68Q25 Analysis of algorithms and problem complexity

References:

[1] Kempe, D, Kleinberg, J, Tardos, É. Maximizing the spread of influence through a social network. In: Proceedings of the Ninth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining; 2003. p. 137-146.
[2] Krause, A, Guestrin, C. Near-optimal observation selection using submodular functions. In: AAAI; Vol. 7; 2007. p. 1650-1654.
[3] Lin, H, Bilmes, J. Multi-document summarization via budgeted maximization of submodular functions. In: Human Language Technologies: The 2010 Annual Conference of the North American Chapter of the Association for Computational Linguistics; 2010. p. 912-920.
[4] Lehmann, B, Lehmann, D, Nisan, N.Combinatorial auctions with decreasing marginal utilities. Games Econ Behav. 2006;55(2):270-296. · Zbl 1125.91043
[5] Vondrák, J. Optimal approximation for the submodular welfare problem in the value oracle model. In: Proceedings of the Fortieth Annual ACM Symposium on Theory of Computing; 2008. p. 67-74. · Zbl 1231.91094
[6] Grötschel, M, Lovász, L, Schrijver, A.The ellipsoid method and its consequences in combinatorial optimization. Combinatorica. 1981;1(2):169-197. · Zbl 0492.90056
[7] Schrijver, A.A combinatorial algorithm minimizing submodular functions in strongly polynomial time. J Comb Theory Ser B. 2000;80(2):346-355. · Zbl 1052.90067
[8] Iwata, S, Fleischer, L, Fujishige, S.A combinatorial strongly polynomial algorithm for minimizing submodular functions. J ACM. 2001;48(4):761-777. · Zbl 1127.90402
[9] Feige, U.A threshold of ln n for approximating set cover. J ACM. 1998;45(4):634-652. · Zbl 1065.68573
[10] Krause, A, Guestrin, CE. Near-optimal nonmyopic value of information in graphical models; 2012. arXiv preprint arXiv:12071394.
[11] Nikolakaki, SM, Ene, A, Terzi, E. An efficient framework for balancing submodularity and cost. In: Proceedings of the 27th ACM SIGKDD Conference on Knowledge Discovery & Data Mining; 2021. p. 1256-1266.
[12] Kazemi, E, Minaee, S, Feldman, M, et al. Regularized submodular maximization at scale. In: International Conference on Machine Learning. PMLR; 2021. p. 5356-5366.
[13] Nemhauser, GL, Wolsey, LA, Fisher, ML.An analysis of approximations for maximizing submodular set functions-i. Math Program. 1978;14(1):265-294. · Zbl 0374.90045
[14] Fisher, ML, Nemhauser, GL, Wolsey, LA. An analysis of approximations for maximizing submodular set functions-II. In: Polyhedral combinatorics. Springer; 1978. p. 73-87. · Zbl 0408.90085
[15] Nemhauser, GL, Wolsey, LA.Best algorithms for approximating the maximum of a submodular set function. Math Oper Res. 1978;3(3):177-188. · Zbl 0395.90072
[16] Calinescu, G, Chekuri, C, Pal, M, et al. Maximizing a monotone submodular function subject to a matroid constraint. SIAM J Comput. 2011;40(6):1740-1766. · Zbl 1234.68459
[17] Buchbinder, N, Feldman, M, Naor, J, et al. Submodular maximization with cardinality constraints. In: Proceedings of the Twenty-Fifth Annual ACM-SIAM Symposium on Discrete Algorithms. SIAM; 2014. p. 1433-1452. · Zbl 1423.90212
[18] Gharan, SO, Vondrák, J. Submodular maximization by simulated annealing. In: Proceedings of the Twenty-Second Annual ACM-SIAM Symposium on Discrete Algorithms. SIAM; 2011. p. 1098-1116. · Zbl 1377.90073
[19] Feldman, M, Naor, J, Schwartz, R. A unified continuous greedy algorithm for submodular maximization. In: 2011 IEEE 52nd Annual Symposium on Foundations of Computer Science. IEEE; 2011. p. 570-579. · Zbl 1292.90248
[20] Buchbinder, N, Feldman, M, Seffi, J, et al. A tight linear time (1/2)-approximation for unconstrained submodular maximization. SIAM J Comput. 2015;44(5):1384-1402. · Zbl 1330.68346
[21] Feige, U, Mirrokni, VS, Vondrák, J.Maximizing non-monotone submodular functions. SIAM J Comput. 2011;40(4):1133-1153. · Zbl 1230.90198
[22] Sviridenko, M, Vondrák, J, Ward, J.Optimal approximation for submodular and supermodular optimization with bounded curvature. Math Oper Res. 2017;42(4):1197-1218. · Zbl 1386.90129
[23] Feldman, M.Guess free maximization of submodular and linear sums. Algorithmica. 2021;83(3):853-878. · Zbl 1512.68449
[24] Harshaw, C, Feldman, M, Ward, J, et al. Submodular maximization beyond non-negativity: guarantees, fast algorithms, and applications. In: International Conference on Machine Learning. PMLR; 2019. p. 2634-2643.
[25] Vondrák, J.Symmetry and approximability of submodular maximization problems. SIAM J Comput. 2013;42(1):265-304. · Zbl 1292.90261
[26] Alon, N, Spencer, JH.The probabilistic method. Hoboken, New Jersey: John Wiley & Sons; 2004.
[27] Mirzasoleiman, B, Badanidiyuru, A, Karbasi, A, et al. Lazier than lazy greedy. In: Proceedings of the AAAI Conference on Artificial Intelligence. Vol. 29; 2015.
[28] Buchbinder, N, Feldman, M, Schwartz, R.Comparing apples and oranges: query trade-off in submodular maximization. Math Oper Res. 2017;42(2):308-329. · Zbl 1364.68367
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.