-
Pattern recovery by SLOPE
Authors:
Małgorzata Bogdan,
Xavier Dupuis,
Piotr Graczyk,
Bartosz Kołodziejek,
Tomasz Skalski,
Patrick Tardivel,
Maciej Wilczyński
Abstract:
SLOPE is a popular method for dimensionality reduction in the high-dimensional regression. Indeed some regression coefficient estimates of SLOPE can be null (sparsity) or can be equal in absolute value (clustering). Consequently, SLOPE may eliminate irrelevant predictors and may identify groups of predictors having the same influence on the vector of responses. The notion of SLOPE pattern allows t…
▽ More
SLOPE is a popular method for dimensionality reduction in the high-dimensional regression. Indeed some regression coefficient estimates of SLOPE can be null (sparsity) or can be equal in absolute value (clustering). Consequently, SLOPE may eliminate irrelevant predictors and may identify groups of predictors having the same influence on the vector of responses. The notion of SLOPE pattern allows to derive theoretical properties on sparsity and clustering by SLOPE. Specifically, the SLOPE pattern of a vector provides: the sign of its components (positive, negative or null), the clusters (indices of components equal in absolute value) and clusters ranking. In this article we give a necessary and sufficient condition for SLOPE pattern recovery of an unknown vector of regression coefficients.
△ Less
Submitted 6 March, 2023; v1 submitted 22 March, 2022;
originally announced March 2022.
-
A semi-Lagrangian scheme for Hamilton-Jacobi-Bellman equations with oblique boundary conditions
Authors:
Elisa Calzola,
Elisabetta Carlini,
Xavier Dupuis,
Francisco J. Silva
Abstract:
We investigate in this work a fully-discrete semi-Lagrangian approximation of second order possibly degenerate Hamilton-Jacobi-Bellman (HJB) equations on a bounded domain with oblique boundary conditions. These equations appear naturally in the study of optimal control of diffusion processes with oblique reflection at the boundary of the domain.
The proposed scheme is shown to satisfy a consiste…
▽ More
We investigate in this work a fully-discrete semi-Lagrangian approximation of second order possibly degenerate Hamilton-Jacobi-Bellman (HJB) equations on a bounded domain with oblique boundary conditions. These equations appear naturally in the study of optimal control of diffusion processes with oblique reflection at the boundary of the domain.
The proposed scheme is shown to satisfy a consistency type property, it is monotone and stable. Our main result is the convergence of the numerical solution towards the unique viscosity solution of the HJB equation. The convergence result holds under the same asymptotic relation between the time and space discretization steps as in the classical setting for semi-Lagrangian schemes. We present some numerical results that confirm the numerical convergence of the scheme.
△ Less
Submitted 21 September, 2021;
originally announced September 2021.
-
The Geometry of Sparse Analysis Regularization
Authors:
Xavier Dupuis,
Samuel Vaiter
Abstract:
Analysis sparsity is a common prior in inverse problem or machine learning including special cases such as Total Variation regularization, Edge Lasso and Fused Lasso. We study the geometry of the solution set (a polyhedron) of the analysis l1-regularization (with l2 data fidelity term) when it is not reduced to a singleton without any assumption of the analysis dictionary nor the degradation opera…
▽ More
Analysis sparsity is a common prior in inverse problem or machine learning including special cases such as Total Variation regularization, Edge Lasso and Fused Lasso. We study the geometry of the solution set (a polyhedron) of the analysis l1-regularization (with l2 data fidelity term) when it is not reduced to a singleton without any assumption of the analysis dictionary nor the degradation operator. In contrast with most theoretical work, we do not focus on giving uniqueness and/or stability results, but rather describe a worst-case scenario where the solution set can be big in terms of dimension. Leveraging a fine analysis of the sub-level set of the regularizer itself, we draw a connection between support of a solution and the minimal face containing it, and in particular prove that extremal points can be recovered thanks to an algebraic test. Moreover, we draw a connection between the sign pattern of a solution and the ambient dimension of the smallest face containing it. Finally, we show that any arbitrary sub-polyhedra of the level set can be seen as a solution set of sparse analysis regularization with explicit parameters.
△ Less
Submitted 13 April, 2022; v1 submitted 3 July, 2019;
originally announced July 2019.
-
First and second order optimality conditions for optimal control problems of state constrained integral equations
Authors:
J. Frédéric Bonnans,
Constanza De La Vega,
Xavier Dupuis
Abstract:
This paper deals with optimal control problems of integral equations, with initial-final and running state constraints. The order of a running state constraint is defined in the setting of integral dynamics, and we work here with constraints of arbitrary high orders. First and second-order necessary conditions of optimality are obtained, as well as second-order sufficient conditions.
This paper deals with optimal control problems of integral equations, with initial-final and running state constraints. The order of a running state constraint is defined in the setting of integral dynamics, and we work here with constraints of arbitrary high orders. First and second-order necessary conditions of optimality are obtained, as well as second-order sufficient conditions.
△ Less
Submitted 6 June, 2012; v1 submitted 16 May, 2012;
originally announced May 2012.
