-
Trust-Region Sequential Quadratic Programming for Stochastic Optimization with Random Models
Authors:
Yuchen Fang,
Sen Na,
Michael W. Mahoney,
Mladen Kolar
Abstract:
In this work, we consider solving optimization problems with a stochastic objective and deterministic equality constraints. We propose a Trust-Region Sequential Quadratic Programming method to find both first- and second-order stationary points. Our method utilizes a random model to represent the objective function, which is constructed from stochastic observations of the objective and is designed…
▽ More
In this work, we consider solving optimization problems with a stochastic objective and deterministic equality constraints. We propose a Trust-Region Sequential Quadratic Programming method to find both first- and second-order stationary points. Our method utilizes a random model to represent the objective function, which is constructed from stochastic observations of the objective and is designed to satisfy proper adaptive accuracy conditions with a high but fixed probability. To converge to first-order stationary points, our method computes a gradient step in each iteration defined by minimizing a quadratic approximation of the objective subject to a (relaxed) linear approximation of the problem constraints and a trust-region constraint. To converge to second-order stationary points, our method additionally computes an eigen step to explore the negative curvature of the reduced Hessian matrix, as well as a second-order correction step to address the potential Maratos effect, which arises due to the nonlinearity of the problem constraints. Such an effect may impede the method from moving away from saddle points. Both gradient and eigen step computations leverage a novel parameter-free decomposition of the step and the trust-region radius, accounting for the proportions among the feasibility residual, optimality residual, and negative curvature. We establish global almost sure first- and second-order convergence guarantees for our method, and present computational results on CUTEst problems, regression problems, and saddle-point problems to demonstrate its superiority over existing line-search-based stochastic methods.
△ Less
Submitted 26 September, 2024; v1 submitted 24 September, 2024;
originally announced September 2024.
-
Variations on Bollobás systems of $d$-partitions
Authors:
Yu Fang,
Xiaomiao Wang,
Tao Feng
Abstract:
This paper investigates five kinds of systems of $d$-partitions of $[n]$, including symmetric Bollobás systems, strong Bollobás systems, Bollob��s systems, skew Bollobás systems, and weak Bollobás systems. Many known results on variations of Bollobás systems are unified. Especially we give a negative answer to a conjecture on Bollobás systems of $d$-partitions of $[n]$ that was presented by Hegedüs…
▽ More
This paper investigates five kinds of systems of $d$-partitions of $[n]$, including symmetric Bollobás systems, strong Bollobás systems, Bollobás systems, skew Bollobás systems, and weak Bollobás systems. Many known results on variations of Bollobás systems are unified. Especially we give a negative answer to a conjecture on Bollobás systems of $d$-partitions of $[n]$ that was presented by Hegedüs and Frankl [European J. Comb., 120 (2024), 103983]. Even though this conjecture does not hold for general Bollobás systems, we show that it holds for strong Bollobás systems of $d$-partitions of $[n]$.
△ Less
Submitted 18 September, 2024;
originally announced September 2024.
-
Constraining Genetic Symbolic Regression via Semantic Backpropagation
Authors:
Maximilian Reissmann,
Yuan Fang,
Andrew Ooi,
Richard Sandberg
Abstract:
Evolutionary symbolic regression approaches are powerful tools that can approximate an explicit mapping between input features and observation for various problems. However, ensuring that explored expressions maintain consistency with domain-specific constraints remains a crucial challenge. While neural networks are able to employ additional information like conservation laws to achieve more appro…
▽ More
Evolutionary symbolic regression approaches are powerful tools that can approximate an explicit mapping between input features and observation for various problems. However, ensuring that explored expressions maintain consistency with domain-specific constraints remains a crucial challenge. While neural networks are able to employ additional information like conservation laws to achieve more appropriate and robust approximations, the potential remains unrealized within genetic algorithms. This disparity is rooted in the inherent discrete randomness of recombining and mutating to generate new mapping expressions, making it challenging to maintain and preserve inferred constraints or restrictions in the course of the exploration. To address this limitation, we propose an approach centered on semantic backpropagation incorporated into the Gene Expression Programming (GEP), which integrates domain-specific properties in a vector representation as corrective feedback during the evolutionary process. By creating backward rules akin to algorithmic differentiation and leveraging pre-computed subsolutions, the mechanism allows the enforcement of any constraint within an expression tree by determining the misalignment and propagating desired changes back. To illustrate the effectiveness of constraining GEP through semantic backpropagation, we take the constraint of physical dimension as an example. This framework is applied to discovering physical equations from the Feynman lectures. Results have shown not only an increased likelihood of recovering the original equation but also notable robustness in the presence of noisy data.
△ Less
Submitted 11 September, 2024;
originally announced September 2024.
-
Regularity for a class of degenerate fully nonlinear nonlocal elliptic equations
Authors:
Yuzhou Fang,
Vicentiu D. Radulescu,
Chao Zhang
Abstract:
We consider a wide class of fully nonlinear integro-differential equations that degenerate when the gradient of the solution vanishes. By using compactness and perturbation arguments, we give a complete characterization of the regularity of viscosity solutions according to different diffusion orders. More precisely, when the order of the fractional diffusion is sufficiently close to 2, we obtain H…
▽ More
We consider a wide class of fully nonlinear integro-differential equations that degenerate when the gradient of the solution vanishes. By using compactness and perturbation arguments, we give a complete characterization of the regularity of viscosity solutions according to different diffusion orders. More precisely, when the order of the fractional diffusion is sufficiently close to 2, we obtain Hölder continuity for the gradient of any viscosity solutions and further derive an improved gradient regularity estimate at the origin. For the order of the fractional diffusion in the interval $(1, 2)$, we prove that there is at least one solution of class $C^{1, α}_{\rm loc}$. Additionally, if the order of the fractional diffusion is in the interval $(0,1]$, the local Hölder continuity of solutions is inferred.
△ Less
Submitted 28 August, 2024;
originally announced August 2024.
-
A Fast Fourier-Galerkin Method for Solving Boundary Integral Equations on Torus-Shaped Surfaces
Authors:
Yiying Fang,
Ying Jiang,
Jiafeng Su
Abstract:
In this paper, we introduce a fast Fourier-Galerkin method for solving boundary integral equations on torus-shaped surfaces, which are diffeomorphic to a torus. We analyze the properties of the integral operator's kernel to derive the decay pattern of the entries in the representation matrix. Leveraging this decay pattern, we devise a truncation strategy that efficiently compresses the dense repre…
▽ More
In this paper, we introduce a fast Fourier-Galerkin method for solving boundary integral equations on torus-shaped surfaces, which are diffeomorphic to a torus. We analyze the properties of the integral operator's kernel to derive the decay pattern of the entries in the representation matrix. Leveraging this decay pattern, we devise a truncation strategy that efficiently compresses the dense representation matrix of the integral operator into a sparser form containing only $\mathcal{O}(N\ln^2 N)$ nonzero entries, where $N$ denotes the degrees of freedom of the discretization method. We prove that this truncation strategy achieves a quasi-optimal convergence order of $\mathcal{O}(N^{-p/2}\ln N)$, with $p$ representing the degree of regularity of the exact solution to the boundary integral equation. Additionally, we confirm that the truncation strategy preserves stability throughout the solution process. Numerical experiments validate our theoretical findings and demonstrate the effectiveness of the proposed method.
△ Less
Submitted 8 October, 2024; v1 submitted 4 August, 2024;
originally announced August 2024.
-
Strong asymptotic convergence of a slowly damped inertial primal-dual dynamical system controlled by a Tikhonov regularization term
Authors:
Ting-Ting Zhu,
Rong Hu,
Ya-Ping Fang
Abstract:
We propose a slowly damped inertial primal-dual dynamical system controlled by a Tikhonov regularization term, where the inertial term is introduced only for the primal variable, for the linearly constrained convex optimization problem in a Hilbert space. Under mild conditions on the underlying parameters, by a Lyapunov analysis approach, we prove the strong asymptotic convergence of the trajector…
▽ More
We propose a slowly damped inertial primal-dual dynamical system controlled by a Tikhonov regularization term, where the inertial term is introduced only for the primal variable, for the linearly constrained convex optimization problem in a Hilbert space. Under mild conditions on the underlying parameters, by a Lyapunov analysis approach, we prove the strong asymptotic convergence of the trajectory of the proposed dynamic to the minimal norm element of the primal-dual solution set of the problem, along with convergence rate results for the primal-dual gap, the objective residual and the feasibility violation. We perform some numerical experiments to illustrate the theoretical findings.
△ Less
Submitted 20 June, 2024; v1 submitted 13 June, 2024;
originally announced June 2024.
-
Quantitative analysis and its applications for Keller-Segel type systems
Authors:
Mengyao Ding,
Yuzhou Fang,
Chao Zhang
Abstract:
In this paper, we utilize the De Giorgi iteration to quantitatively analyze the upper bound of solutions for Keller-Segel type systems. The refined upper bound estimate presented here has broad applications in determining large time behaviours of weak solutions and improving the regularity for models involving the $p$-Laplace operator. To demonstrate the applicability of our findings, we investiga…
▽ More
In this paper, we utilize the De Giorgi iteration to quantitatively analyze the upper bound of solutions for Keller-Segel type systems. The refined upper bound estimate presented here has broad applications in determining large time behaviours of weak solutions and improving the regularity for models involving the $p$-Laplace operator. To demonstrate the applicability of our findings, we investigate the asymptotic stability of a chemotaxis model with nonlinear signal production and a chemotaxis-Navier-Stokes model with a logistic source. Additionally, within the context of $p$-Laplacian diffusion, we establish Hölder continuity for a chemotaxis-haptotaxis model and a chemotaxis-Stokes model.
△ Less
Submitted 12 June, 2024;
originally announced June 2024.
-
On the weak Harnack inequalities for nonlocal double phase problems
Authors:
Yuzhou Fang,
Chao Zhang
Abstract:
This paper is devoted to studying the weak Harnack inequalities for nonlocal double phase functionals by using expansion of positivity, whose prototype is $$ \iint_{\mathbb{R}^n\times\mathbb{R}^n} \left(\frac{|u(x)-u(y)|^p}{|x-y|^{n+sp}}+a(x,y)\frac{|u(x)-u(y)|^q}{|x-y|^{n+tq}}\right) \,dxdy $$ with $a\ge0$ and $0<s\le t<1<p\le q$. The core of our approach is to establish several measure theoretic…
▽ More
This paper is devoted to studying the weak Harnack inequalities for nonlocal double phase functionals by using expansion of positivity, whose prototype is $$ \iint_{\mathbb{R}^n\times\mathbb{R}^n} \left(\frac{|u(x)-u(y)|^p}{|x-y|^{n+sp}}+a(x,y)\frac{|u(x)-u(y)|^q}{|x-y|^{n+tq}}\right) \,dxdy $$ with $a\ge0$ and $0<s\le t<1<p\le q$. The core of our approach is to establish several measure theoretical estimates based on the nonlocal Caccioppoli-type inequality, where the challenges consist in controlling subtle interaction between the pointwise behaviour of modulating coefficient and the growth exponents. Meanwhile, a quantitative boundedness result on the minimizer of such functionals is also discussed.
△ Less
Submitted 30 May, 2024;
originally announced May 2024.
-
Statistical Rounding Error Analysis for the Computation of Random Vectors and Matrices
Authors:
Yiming Fang,
Li Chen
Abstract:
The conventional rounding error analysis provides worst-case bounds with an associated failure probability and ignores the statistical property of the rounding errors. In this paper, we develop a new statistical rounding error analysis for random vectors and matrices computation. By assuming the relative errors are independent random variables, we derive the approximate closed-form expressions for…
▽ More
The conventional rounding error analysis provides worst-case bounds with an associated failure probability and ignores the statistical property of the rounding errors. In this paper, we develop a new statistical rounding error analysis for random vectors and matrices computation. By assuming the relative errors are independent random variables, we derive the approximate closed-form expressions for the expectation and variance of the rounding errors in various key computations for vectors and random matrices. Numerical experiments validate the accuracy of our derivations and demonstrate that our analytical expressions are generally at least two orders of magnitude tighter than alternative worst-case bounds, exemplified through the inner products.
△ Less
Submitted 1 October, 2024; v1 submitted 13 May, 2024;
originally announced May 2024.
-
Solving maximally comonotone inclusion problems via an implicit Newton-like inertial dynamical system and its discretization
Authors:
Z. Z. Tan,
R. Hu,
Y. P. Fang
Abstract:
This paper deals with an implicit Newton-like inertial dynamical system governed by a maximally comonotone inclusion problem in a Hilbert space. Under suitable conditions, we establish not only pointwise estimates and integral estimates for the velocity and the value of the associated Yosida regularization operator along the trajectory of the system, but also the weak convergence of the trajectory…
▽ More
This paper deals with an implicit Newton-like inertial dynamical system governed by a maximally comonotone inclusion problem in a Hilbert space. Under suitable conditions, we establish not only pointwise estimates and integral estimates for the velocity and the value of the associated Yosida regularization operator along the trajectory of the system, but also the weak convergence of the trajectory to a zero of the maximally comonotone operator. Moreover, a new inertial algorithm is developed via a time discretization of the proposed system. Our analysis reveals that the resulting discrete algorithm exhibits fast convergence properties matching the ones of the continuous time counterpart. Finally, the theoretical results are illustrated by numerical experiments.
△ Less
Submitted 10 May, 2024;
originally announced May 2024.
-
Fast convergence rates and trajectory convergence of a Tikhonov regularized inertial primal\mbox{-}dual dynamical system with time scaling and vanishing damping
Authors:
Ting-Ting Zhu,
Rong Hu,
Ya-Ping Fang
Abstract:
A Tikhonov regularized inertial primal\mbox{-}dual dynamical system with time scaling and vanishing damping is proposed for solving a linearly constrained convex optimization problem in Hilbert spaces. The system under consideration consists of two coupled second order differential equations and its convergence properties depend upon the decaying speed of the product of the time scaling parameter…
▽ More
A Tikhonov regularized inertial primal\mbox{-}dual dynamical system with time scaling and vanishing damping is proposed for solving a linearly constrained convex optimization problem in Hilbert spaces. The system under consideration consists of two coupled second order differential equations and its convergence properties depend upon the decaying speed of the product of the time scaling parameter and the Tikhonov regularization parameter (named the rescaled regularization parameter) to zero. When the rescaled regularization parameter converges rapidly to zero, the system enjoys fast convergence rates of the primal-dual gap, the feasibility violation, the objective residual, and the gradient norm of the objective function along the trajectory, and the weak convergence of the trajectory to a primal-dual solution of the linearly constrained convex optimization problem. When the rescaled regularization parameter converges slowly to zero, the generated primal trajectory converges strongly to the minimal norm solution of the problem under suitable conditions. Finally, numerical experiments are performed to illustrate the theoretical findings.
△ Less
Submitted 23 April, 2024;
originally announced April 2024.
-
Optimized electrified meeting-point-based feeder bus services with capacitated charging stations and partial recharges
Authors:
Tai-Yu Ma,
Yumeng Fang,
Richard D. Connors,
Francesco Viti,
Haruko Nakao
Abstract:
Meeting-point-based feeder services using EVs have good potential to achieve an efficient and clean on-demand mobility service. However, customer-to-meeting-point, vehicle routing, and charging scheduling need to be jointly optimized to achieve the best system performance. To this aim, we assess the effect of different system parameters and configure them based on our previously developed hybrid m…
▽ More
Meeting-point-based feeder services using EVs have good potential to achieve an efficient and clean on-demand mobility service. However, customer-to-meeting-point, vehicle routing, and charging scheduling need to be jointly optimized to achieve the best system performance. To this aim, we assess the effect of different system parameters and configure them based on our previously developed hybrid metaheuristic algorithm. A set of test instances based on morning peak hour commuting scenarios between the cities of Arlon and Luxembourg are used to evaluate the impact of the set parameters on the optimal solutions. The experimental results suggest that higher meeting point availability can achieve better system performance. By jointly configuring different system parameters, the overall system performance can be significantly improved (-10.8% total kilometers traveled by vehicles compared to the benchmark) to serve all requests. Our experimental results show that the meeting-point-based system can reduce up to 70.2% the fleet size, 6.4% the in-vehicle travel time and 49.4% the kilometers traveled when compared to a traditional door-to-door dial-a-ride system.
△ Less
Submitted 9 January, 2024;
originally announced January 2024.
-
A hybrid metaheuristic to optimize electric first-mile feeder services with charging synchronization constraints and customer rejections
Authors:
Tai-Yu Ma,
Yumeng Fang,
Richard D. Connors,
Francesco Viti,
Haruko Nakao
Abstract:
This paper addresses the on-demand meeting-point-based feeder electric bus routing and charging scheduling problem under charging synchronization constraints. The problem considered exhibits the structure of the location routing problem, which is more difficult to solve than many electric vehicle routing problems with capacitated charging stations. We propose to model the problem using a mixed-int…
▽ More
This paper addresses the on-demand meeting-point-based feeder electric bus routing and charging scheduling problem under charging synchronization constraints. The problem considered exhibits the structure of the location routing problem, which is more difficult to solve than many electric vehicle routing problems with capacitated charging stations. We propose to model the problem using a mixed-integer linear programming approach based on a layered graph structure. An efficient hybrid metaheuristic solution algorithm is proposed. A mixture of random and greedy partial charging scheduling strategies is used to find feasible charging schedules under the synchronization constraints. The algorithm is tested on instances with up to 100 customers and 49 bus stops/meeting points. The results show that the proposed algorithm provides near-optimal solutions within less one minute on average compared with the best solutions found by a mixed-integer linear programming solver set with a 4-hour computation time limit. A case study on a larger sized case with 1000 customers and 111 meeting points shows the proposed method is applicable to real-world situations.
△ Less
Submitted 8 February, 2024; v1 submitted 8 January, 2024;
originally announced January 2024.
-
Classification and Treatment Learning with Constraints via Composite Heaviside Optimization: a Progressive MIP Method
Authors:
Yue Fang,
Junyi Liu,
Jong-Shi Pang
Abstract:
This paper proposes a Heaviside composite optimization approach and presents a progressive (mixed) integer programming (PIP) method for solving multi-class classification and multi-action treatment problems with constraints. A Heaviside composite function is a composite of a Heaviside function (i.e., the indicator function of either the open $( \, 0,\infty )$ or closed $[ \, 0,\infty \, )$ interva…
▽ More
This paper proposes a Heaviside composite optimization approach and presents a progressive (mixed) integer programming (PIP) method for solving multi-class classification and multi-action treatment problems with constraints. A Heaviside composite function is a composite of a Heaviside function (i.e., the indicator function of either the open $( \, 0,\infty )$ or closed $[ \, 0,\infty \, )$ interval) with a possibly nondifferentiable function. Modeling-wise, we show how Heaviside composite optimization provides a unified formulation for learning the optimal multi-class classification and multi-action treatment rules, subject to rule-dependent constraints stipulating a variety of domain restrictions. A Heaviside composite function has an equivalent discrete formulation, and the resulting optimization problem can in principle be solved by integer programming (IP) methods. Nevertheless, for constrained learning problems with large data sets, a straightforward application of off-the-shelf IP solvers is usually ineffective in achieving global optimality. To alleviate such a computational burden, our major contribution is the proposal of the PIP method by leveraging the effectiveness of state-of-the-art IP solvers for problems of modest sizes. We provide the theoretical advantage of the PIP method with the connection to continuous optimization and show that the computed solution is locally optimal for a broad class of Heaviside composite optimization problems. The numerical performance of the PIP method is demonstrated by extensive computational experimentation.
△ Less
Submitted 4 January, 2024; v1 submitted 3 January, 2024;
originally announced January 2024.
-
Non-ergodic convergence rate of an inertial accelerated primal-dual algorithm for saddle point problems
Authors:
X. He,
N. J. Huang,
Y. P. Fang
Abstract:
In this paper, we design an inertial accelerated primal-dual algorithm to address the convex-concave saddle point problem, which is formulated as $\min_{x}\max_{y} f(x) + \langle Kx, y \rangle - g(y)$. Remarkably, both functions $f$ and $g$ exhibit a composite structure, combining ``nonsmooth'' + ``smooth'' components. Under the assumption of partially strong convexity in the sense that $f$ is con…
▽ More
In this paper, we design an inertial accelerated primal-dual algorithm to address the convex-concave saddle point problem, which is formulated as $\min_{x}\max_{y} f(x) + \langle Kx, y \rangle - g(y)$. Remarkably, both functions $f$ and $g$ exhibit a composite structure, combining ``nonsmooth'' + ``smooth'' components. Under the assumption of partially strong convexity in the sense that $f$ is convex and $g$ is strongly convex, we introduce a novel inertial accelerated primal-dual algorithm based on Nesterov's extrapolation. This algorithm can be reduced to two classical accelerated forward-backward methods for unconstrained optimization problem. We show that the proposed algorithm achieves a non-ergodic $\mathcal{O}(1/k^2)$ convergence rate, where $k$ represents the number of iterations. Several numerical experiments validate the efficiency of our proposed algorithm.
△ Less
Submitted 16 April, 2024; v1 submitted 19 November, 2023;
originally announced November 2023.
-
Accelerated linearized alternating direction method of multipliers with Nesterov extrapolation
Authors:
X. He,
N. J. Huang,
Y. P. Fang
Abstract:
The alternating direction method of multipliers (ADMM) has found widespread use in solving separable convex optimization problems. In this paper, by employing Nesterov extrapolation technique, we propose two families of accelerated linearized ADMMs for addressing two-block linearly constrained separable convex optimization problems where each block of the objective function exhibits a ``nonsmooth'…
▽ More
The alternating direction method of multipliers (ADMM) has found widespread use in solving separable convex optimization problems. In this paper, by employing Nesterov extrapolation technique, we propose two families of accelerated linearized ADMMs for addressing two-block linearly constrained separable convex optimization problems where each block of the objective function exhibits a ``nonsmooth'' + ``smooth'' composite structure. Our proposed accelerated linearized ADMMs extend two classical Nesterov acceleration methods designed for unconstrained composite optimization problems to linearly constrained problems. These methods are capable of achieving non-ergodic convergence rates of $\mathcal{O}(1/k^2)$, provided that one block of the objective function exhibits strong convexity and the gradients of smooth terms are Lipschitz continuous. We show that the proposed methods can reduce to accelerated linearized augmented Lagrangian methods (ALMs) for solving one-block linearly constrained convex optimization problems. By choosing different extrapolation parameters, we explore the relationship between the proposed methods and some existing accelerated methods. Numerical results are presented to validate the efficacy and reliability of the proposed algorithms.
△ Less
Submitted 9 May, 2024; v1 submitted 25 October, 2023;
originally announced October 2023.
-
Three dimensional quotient singularity and 4d $\mathcal{N}=1$ AdS/CFT correspondence
Authors:
Yuanyuan Fang,
Jing Feng,
Dan Xie
Abstract:
We systematically study the AdS/CFT correspondence induced by D3 branes probing three dimensional Gorenstein quotient singularity $\mathbb{C}^3/G$. The field theory is given by the McKay quiver, which has a vanishing NSVZ beta function assuming that all the chiral fields have the $U(1)_R$ charge $\frac{2}{3}$. Various physical quantities such as quiver Hilbert series, superconformal index, central…
▽ More
We systematically study the AdS/CFT correspondence induced by D3 branes probing three dimensional Gorenstein quotient singularity $\mathbb{C}^3/G$. The field theory is given by the McKay quiver, which has a vanishing NSVZ beta function assuming that all the chiral fields have the $U(1)_R$ charge $\frac{2}{3}$. Various physical quantities such as quiver Hilbert series, superconformal index, central charges, etc are computed, which match exactly with those computed using the singularity. We also study the relevant deformation of those theories and find the dual geometry, therefore generate many new interesting AdS/CFT pairs. The quiver gauge theory defined using finite subgroups of $SO(3)$ group has some interesting features, for example, its Seiberg duality behavior is quite interesting.
△ Less
Submitted 24 October, 2023;
originally announced October 2023.
-
Dispersive Estimates for Maxwell's Equations in the Exterior of a Sphere
Authors:
Alden Waters,
Yan-Long Fang
Abstract:
The goal of this article is to establish general principles for high frequency dispersive estimates for Maxwell's equation in the exterior of a perfectly conducting ball. We construct entirely new generalized eigenfunctions for the corresponding Maxwell propagator. We show that the propagator corresponding to the electric field has a global rate of decay in $L^1-L^{\infty}$ operator norm in terms…
▽ More
The goal of this article is to establish general principles for high frequency dispersive estimates for Maxwell's equation in the exterior of a perfectly conducting ball. We construct entirely new generalized eigenfunctions for the corresponding Maxwell propagator. We show that the propagator corresponding to the electric field has a global rate of decay in $L^1-L^{\infty}$ operator norm in terms of time $t$ and powers of $h$. In particular we show that some, but not all, polarizations of electromagnetic waves scatter at the same rate as the usual wave operator. The Dirichlet Laplacian wave operator $L^1-L^{\infty}$ norm estimate should not be expected to hold in general for Maxwell's equations in the exterior of a ball because of the Helmholtz decomposition theorem.
△ Less
Submitted 25 September, 2024; v1 submitted 1 August, 2023;
originally announced August 2023.
-
Tikhonov regularized second-order plus first-order primal-dual dynamical systems with asymptotically vanishing damping for linear equality constrained convex optimization problems
Authors:
Ting Ting Zhu,
Rong Hu,
Ya Ping Fang
Abstract:
In this paper, in the setting of Hilbert spaces, we consider a Tikhonov regularized second-order plus first-order primal-dual dynamical system with asymptotically vanishing damping for a linear equality constrained convex optimization problem. The convergence properties of the proposed dynamical system depend heavily upon the choice of the Tikhonov regularization parameter. When the Tikhonov regul…
▽ More
In this paper, in the setting of Hilbert spaces, we consider a Tikhonov regularized second-order plus first-order primal-dual dynamical system with asymptotically vanishing damping for a linear equality constrained convex optimization problem. The convergence properties of the proposed dynamical system depend heavily upon the choice of the Tikhonov regularization parameter. When the Tikhonov regularization parameter decreases rapidly to zero, we establish the fast convergence rates of the primal-dual gap, the objective function error, the feasibility measure, and the gradient norm of the objective function along the trajectory generated by the system. When the Tikhonov regularization parameter tends slowly to zero, we prove that the primal trajectory of the Tikhonov regularized dynamical system converges strongly to the minimal norm solution of the linear equality constrained convex optimization problem. Numerical experiments are performed to illustrate the efficiency of our approach.
△ Less
Submitted 21 April, 2024; v1 submitted 7 July, 2023;
originally announced July 2023.
-
A second order dynamical system method for solving a maximal comonotone inclusion problem
Authors:
Zengzhen Tan,
Rong Hu,
Yaping Fang
Abstract:
In this paper a second order dynamical system model is proposed for computing a zero of a maximal comonotone operator in Hilbert spaces. Under mild conditions, we prove existence and uniqueness of a strong global solution of the proposed dynamical system. A proper tuning of the parameters can allow us to establish fast convergence properties of the trajectories generated by the dynamical system. T…
▽ More
In this paper a second order dynamical system model is proposed for computing a zero of a maximal comonotone operator in Hilbert spaces. Under mild conditions, we prove existence and uniqueness of a strong global solution of the proposed dynamical system. A proper tuning of the parameters can allow us to establish fast convergence properties of the trajectories generated by the dynamical system. The weak convergence of the trajectory to a zero of the maximal comonotone operator is also proved. Furthermore, a discrete version of the dynamical system is considered and convergence properties matching to that of the dynamical system are established under a same framework. Finally, the validity of the proposed dynamical system and its discrete version is demonstrated by two numerical examples.
△ Less
Submitted 7 July, 2023;
originally announced July 2023.
-
Regularity theory for nonlocal equations with general growth in the Heisenberg group
Authors:
Yuzhou Fang,
Chao Zhang
Abstract:
We deal with a wide class of generalized nonlocal $p$-Laplace equations, so-called nonlocal $G$-Laplace equations, in the Heisenberg framework. Under natural hypotheses on the $N$-function $G$, we provide a unified approach to investigate in the spirit of De Giorgi-Nash-Moser theory, some local properties of weak solutions to such kind of problems, involving boundedness, Hölder continuity and Harn…
▽ More
We deal with a wide class of generalized nonlocal $p$-Laplace equations, so-called nonlocal $G$-Laplace equations, in the Heisenberg framework. Under natural hypotheses on the $N$-function $G$, we provide a unified approach to investigate in the spirit of De Giorgi-Nash-Moser theory, some local properties of weak solutions to such kind of problems, involving boundedness, Hölder continuity and Harnack inequality. To this end, an improved nonlocal Caccioppoli-type estimate as the main auxiliary ingredient is exploited several times.
△ Less
Submitted 4 July, 2023;
originally announced July 2023.
-
On the extreme order statistics for stationary Gaussian sequences subject to random missing observations
Authors:
Yuan Fang,
Zhongquan Tan
Abstract:
Let $\mathbf{X}=\{X_{n}\}_{n\geq 1}$ be a sequence of stationary Gaussian variables and suppose that only some of the random variables from $\mathbf{X}$ can be observed. In this paper, by studying the limiting properties of multidimensional exceedance point processes for $\mathbf{X}$, we derived the joint limit distribution of extreme order statistics for the Gaussian sequence $\mathbf{X}$ and its…
▽ More
Let $\mathbf{X}=\{X_{n}\}_{n\geq 1}$ be a sequence of stationary Gaussian variables and suppose that only some of the random variables from $\mathbf{X}$ can be observed. In this paper, by studying the limiting properties of multidimensional exceedance point processes for $\mathbf{X}$, we derived the joint limit distribution of extreme order statistics for the Gaussian sequence $\mathbf{X}$ and its observed ones. The joint limit distribution of the locations and heights of the maxima for the Gaussian sequence $\mathbf{X}$ and its observed ones are also obtained.
△ Less
Submitted 4 June, 2024; v1 submitted 24 June, 2023;
originally announced June 2023.
-
Cost-reduction implicit exponential Runge-Kutta methods for highly oscillatory systems
Authors:
Xianfa Hu,
Wansheng Wang,
Bin Wang,
Yonglei Fang
Abstract:
In this paper, two novel classes of implicit exponential Runge-Kutta (ERK) methods are studied for solving highly oscillatory systems. First of all, we analyze the symplectic conditions of two kinds of exponential integrators, and present a first-order symplectic method. In order to solve highly oscillatory problems, the highly accurate implicit ERK integrators (up to order four) are formulated by…
▽ More
In this paper, two novel classes of implicit exponential Runge-Kutta (ERK) methods are studied for solving highly oscillatory systems. First of all, we analyze the symplectic conditions of two kinds of exponential integrators, and present a first-order symplectic method. In order to solve highly oscillatory problems, the highly accurate implicit ERK integrators (up to order four) are formulated by comparing the Taylor expansions of numerical and exact solutions, it is shown that the order conditions of two new kinds of exponential methods are identical to the order conditions of classical Runge-Kutta (RK) methods. Moreover, we investigate the linear stability properties of these exponential methods. Finally, numerical results not only present the long time energy preservation of the first-order symplectic method, but also illustrate the accuracy and efficiency of these formulated methods in comparison with standard ERK methods.
△ Less
Submitted 4 December, 2023; v1 submitted 11 June, 2023;
originally announced June 2023.
-
Local regularity for nonlocal double phase equations in the Heisenberg group
Authors:
Yuzhou Fang,
Chao Zhang,
Junli Zhang
Abstract:
We prove interior boundedness and Hölder continuity for the weak solutions of nonlocal double phase equations in the Heisenberg group $\mathbb{H}^n$. This solves a problem raised by Palatucci and Piccinini et. al. in 2022 and 2023 for nonlinear integro-differential problems in the Heisenberg group $\mathbb{H}^n$. Our proof of the a priori estiamtes bases on the spirit of De Giorgi-Nash-Moser theor…
▽ More
We prove interior boundedness and Hölder continuity for the weak solutions of nonlocal double phase equations in the Heisenberg group $\mathbb{H}^n$. This solves a problem raised by Palatucci and Piccinini et. al. in 2022 and 2023 for nonlinear integro-differential problems in the Heisenberg group $\mathbb{H}^n$. Our proof of the a priori estiamtes bases on the spirit of De Giorgi-Nash-Moser theory, where the important ingredients are Caccioppoli-type inequality and Logarithmic estimate. To achieve this goal, we establish a new and crucial Sobolev-Poincaré type inequality in local domain, which may be of independent interest and potential applications.
△ Less
Submitted 19 May, 2023;
originally announced May 2023.
-
Local behaviour of the mixed local and nonlocal problems with nonstandard growth
Authors:
Mengyao Ding,
Yuzhou Fang,
Chao Zhang
Abstract:
We consider the mixed local and nonlocal functionals with nonstandard growth \begin{eqnarray*} u\mapsto\int_Ω(|Du|^p-f(x)u)\,dx+\int_{\mathbb{R}^N}\int_{\mathbb{R}^N}\frac{|u(x)-u(y)|^q}{|x-y|^{N+sq}}\,dxdy \end{eqnarray*} with $1<p\le sq$, $0<s<1$ and $Ω\subset\mathbb{R}^N$ being a bounded domain. We study, by means of expansion of positivity, local behaviour of the minimizers of such problems, i…
▽ More
We consider the mixed local and nonlocal functionals with nonstandard growth \begin{eqnarray*} u\mapsto\int_Ω(|Du|^p-f(x)u)\,dx+\int_{\mathbb{R}^N}\int_{\mathbb{R}^N}\frac{|u(x)-u(y)|^q}{|x-y|^{N+sq}}\,dxdy \end{eqnarray*} with $1<p\le sq$, $0<s<1$ and $Ω\subset\mathbb{R}^N$ being a bounded domain. We study, by means of expansion of positivity, local behaviour of the minimizers of such problems, involving local boundedness, local Hölder continuity and Harnack inequality. The results above can be seen as a natural extension of the results under the center condition that $p>sq$ in [De Filippis-Mingione, Math. Ann., https://doi.org/10.1007/s00208-022-02512-7].
△ Less
Submitted 3 April, 2023; v1 submitted 3 April, 2023;
originally announced April 2023.
-
Extrinsic Bayesian Optimizations on Manifolds
Authors:
Yihao Fang,
Mu Niu,
Pokman Cheung,
Lizhen Lin
Abstract:
We propose an extrinsic Bayesian optimization (eBO) framework for general optimization problems on manifolds. Bayesian optimization algorithms build a surrogate of the objective function by employing Gaussian processes and quantify the uncertainty in that surrogate by deriving an acquisition function. This acquisition function represents the probability of improvement based on the kernel of the Ga…
▽ More
We propose an extrinsic Bayesian optimization (eBO) framework for general optimization problems on manifolds. Bayesian optimization algorithms build a surrogate of the objective function by employing Gaussian processes and quantify the uncertainty in that surrogate by deriving an acquisition function. This acquisition function represents the probability of improvement based on the kernel of the Gaussian process, which guides the search in the optimization process. The critical challenge for designing Bayesian optimization algorithms on manifolds lies in the difficulty of constructing valid covariance kernels for Gaussian processes on general manifolds. Our approach is to employ extrinsic Gaussian processes by first embedding the manifold onto some higher dimensional Euclidean space via equivariant embeddings and then constructing a valid covariance kernel on the image manifold after the embedding. This leads to efficient and scalable algorithms for optimization over complex manifolds. Simulation study and real data analysis are carried out to demonstrate the utilities of our eBO framework by applying the eBO to various optimization problems over manifolds such as the sphere, the Grassmannian, and the manifold of positive definite matrices.
△ Less
Submitted 28 December, 2022; v1 submitted 21 December, 2022;
originally announced December 2022.
-
Critical Fubini-Study metrics over non-archimedean fields
Authors:
Yanbo Fang
Abstract:
Over a non-archimedean local place, the height of a projective variety with respect to a very ample line bundle equipped with a Fubini-Study metric is related to the naive height of its Chow form. Using a non-Archimedean Kempf-Ness criteria, we characterize Fubini-Study metrics that minimize the height under the special linear action in terms of their Monge-Ampère polytopes. This polytope can be c…
▽ More
Over a non-archimedean local place, the height of a projective variety with respect to a very ample line bundle equipped with a Fubini-Study metric is related to the naive height of its Chow form. Using a non-Archimedean Kempf-Ness criteria, we characterize Fubini-Study metrics that minimize the height under the special linear action in terms of their Monge-Ampère polytopes. This polytope can be constructed either as its non-Archimedean Bergman functional or as the weight polytope for the residual action on its Chow form; it is associated with a polymatroid.
△ Less
Submitted 5 December, 2022;
originally announced December 2022.
-
Fully Stochastic Trust-Region Sequential Quadratic Programming for Equality-Constrained Optimization Problems
Authors:
Yuchen Fang,
Sen Na,
Michael W. Mahoney,
Mladen Kolar
Abstract:
We propose a trust-region stochastic sequential quadratic programming algorithm (TR-StoSQP) to solve nonlinear optimization problems with stochastic objectives and deterministic equality constraints. We consider a fully stochastic setting, where at each step a single sample is generated to estimate the objective gradient. The algorithm adaptively selects the trust-region radius and, compared to th…
▽ More
We propose a trust-region stochastic sequential quadratic programming algorithm (TR-StoSQP) to solve nonlinear optimization problems with stochastic objectives and deterministic equality constraints. We consider a fully stochastic setting, where at each step a single sample is generated to estimate the objective gradient. The algorithm adaptively selects the trust-region radius and, compared to the existing line-search StoSQP schemes, allows us to utilize indefinite Hessian matrices (i.e., Hessians without modification) in SQP subproblems. As a trust-region method for constrained optimization, our algorithm must address an infeasibility issue -- the linearized equality constraints and trust-region constraints may lead to infeasible SQP subproblems. In this regard, we propose an adaptive relaxation technique to compute the trial step, consisting of a normal step and a tangential step. To control the lengths of these two steps while ensuring a scale-invariant property, we adaptively decompose the trust-region radius into two segments, based on the proportions of the rescaled feasibility and optimality residuals to the rescaled full KKT residual. The normal step has a closed form, while the tangential step is obtained by solving a trust-region subproblem, to which a solution ensuring the Cauchy reduction is sufficient for our study. We establish a global almost sure convergence guarantee for TR-StoSQP, and illustrate its empirical performance on both a subset of problems in the CUTEst test set and constrained logistic regression problems using data from the LIBSVM collection.
△ Less
Submitted 28 January, 2024; v1 submitted 29 November, 2022;
originally announced November 2022.
-
On the Reifenberg Plateau Problem in Hilbert space
Authors:
Yangqin Fang
Abstract:
In this paper, we will solve the Reifenberg Plateau Problem in Hilbert space.
In this paper, we will solve the Reifenberg Plateau Problem in Hilbert space.
△ Less
Submitted 30 October, 2022;
originally announced October 2022.
-
Two new families of fourth-order explicit exponential Runge--Kutta methods with four stages for first-order differential systems
Authors:
Xianfa Hu,
Yonglei Fang,
Bin Wang
Abstract:
In this paper, two new families of fourth-order explicit exponential Runge--Kutta (ERK) methods with four stages are studied for solving first-order differential systems $y'(t)+My(t)=f(y(t))$. By comparing the Taylor series of the exact solution, the order conditions of these ERK methods are derived, which are exactly identical to the order conditions of explicit Runge--Kutta methods, and these ER…
▽ More
In this paper, two new families of fourth-order explicit exponential Runge--Kutta (ERK) methods with four stages are studied for solving first-order differential systems $y'(t)+My(t)=f(y(t))$. By comparing the Taylor series of the exact solution, the order conditions of these ERK methods are derived, which are exactly identical to the order conditions of explicit Runge--Kutta methods, and these ERK methods reduce to classical Runge--Kutta methods once $M\rightarrow \mathbf{0}$. Moreover, we analyze the stability properties and the convergence of the new methods. Several numerical examples are implemented to illustrate the accuracy and efficiency of these ERK methods by comparison with standard exponential integrators.
△ Less
Submitted 18 June, 2024; v1 submitted 22 October, 2022;
originally announced October 2022.
-
Equivalence of weak and viscosity solutions for the nonhomogeneous double phase equation
Authors:
Yuzhou Fang,
Vicentiu D. Radulescu,
Chao Zhang
Abstract:
We establish the equivalence between weak and viscosity solutions to the nonhomogeneous double phase equation with lower-order term $$ -{\rm div}(|Du|^{p-2}Du+a(x)|Du|^{q-2}Du)=f(x,u,Du),\quad 1<p\le q<\infty, a(x)\ge0. $$ We find some appropriate hypotheses on the coefficient $a(x)$, the exponents $p, q$ and the nonlinear term $f$ to show that the viscosity solutions with {\em a priori} Lipschitz…
▽ More
We establish the equivalence between weak and viscosity solutions to the nonhomogeneous double phase equation with lower-order term $$ -{\rm div}(|Du|^{p-2}Du+a(x)|Du|^{q-2}Du)=f(x,u,Du),\quad 1<p\le q<\infty, a(x)\ge0. $$ We find some appropriate hypotheses on the coefficient $a(x)$, the exponents $p, q$ and the nonlinear term $f$ to show that the viscosity solutions with {\em a priori} Lipschitz continuity are weak solutions of such equation by virtue of the $\inf$($\sup$)-convolution techniques. The reverse implication can be concluded through comparison principles. Moreover, we verify that the bounded viscosity solutions are exactly Lipschitz continuous, which is also of independent interest.
△ Less
Submitted 6 October, 2022;
originally announced October 2022.
-
Solving the Batch Stochastic Bin Packing Problem in Cloud: A Chance-constrained Optimization Approach
Authors:
Jie Yan,
Yunlei Lu,
Liting Chen,
Si Qin,
Yixin Fang,
Qingwei Lin,
Thomas Moscibroda,
Saravan Rajmohan,
Dongmei Zhang
Abstract:
This paper investigates a critical resource allocation problem in the first party cloud: scheduling containers to machines. There are tens of services and each service runs a set of homogeneous containers with dynamic resource usage; containers of a service are scheduled daily in a batch fashion. This problem can be naturally formulated as Stochastic Bin Packing Problem (SBPP). However, traditiona…
▽ More
This paper investigates a critical resource allocation problem in the first party cloud: scheduling containers to machines. There are tens of services and each service runs a set of homogeneous containers with dynamic resource usage; containers of a service are scheduled daily in a batch fashion. This problem can be naturally formulated as Stochastic Bin Packing Problem (SBPP). However, traditional SBPP research often focuses on cases of empty machines, whose objective, i.e., to minimize the number of used machines, is not well-defined for the more common reality with nonempty machines. This paper aims to close this gap. First, we define a new objective metric, Used Capacity at Confidence (UCaC), which measures the maximum used resources at a probability and is proved to be consistent for both empty and nonempty machines, and reformulate the SBPP under chance constraints. Second, by modeling the container resource usage distribution in a generative approach, we reveal that UCaC can be approximated with Gaussian, which is verified by trace data of real-world applications. Third, we propose an exact solver by solving the equivalent cutting stock variant as well as two heuristics-based solvers -- UCaC best fit, bi-level heuristics. We experimentally evaluate these solvers on both synthetic datasets and real application traces, demonstrating our methodology's advantage over traditional SBPP optimal solver minimizing the number of used machines, with a low rate of resource violations.
△ Less
Submitted 20 July, 2022;
originally announced July 2022.
-
On the non-archimedean Monge-Ampère equation in mixed characteristic
Authors:
Yanbo Fang,
Walter Gubler,
Klaus Künnemann
Abstract:
Let X be a smooth projective variety over a complete discretely valued field of mixed characteristic. We solve non-archimedean Monge-Ampère equations on X assuming resolution and embedded resolution of singularities. We follow the variational approach of Boucksom, Favre, and Jonsson proving the continuity of the plurisubharmonic envelope of a continuous metric on an ample line bundle on X. We repl…
▽ More
Let X be a smooth projective variety over a complete discretely valued field of mixed characteristic. We solve non-archimedean Monge-Ampère equations on X assuming resolution and embedded resolution of singularities. We follow the variational approach of Boucksom, Favre, and Jonsson proving the continuity of the plurisubharmonic envelope of a continuous metric on an ample line bundle on X. We replace the use of multiplier ideals in equicharacteristic zero by the use of perturbation friendly test ideals introduced by Bhatt, Ma, Patakfalvi, Schwede, Tucker, Waldron, and Witaszek building upon previous constructions by Hacon, Lamarche, and Schwede.
△ Less
Submitted 28 February, 2024; v1 submitted 23 March, 2022;
originally announced March 2022.
-
Harnack inequality for the nonlocal equations with general growth
Authors:
Yuzhou Fang,
Chao Zhang
Abstract:
We consider a class of generalized nonlocal $p$-Laplacian equations. We find some proper structural conditions to establish a version of nonlocal Harnack inequalities of weak solutions to such nonlocal problems by using the expansion of positivity and energy estimates.
We consider a class of generalized nonlocal $p$-Laplacian equations. We find some proper structural conditions to establish a version of nonlocal Harnack inequalities of weak solutions to such nonlocal problems by using the expansion of positivity and energy estimates.
△ Less
Submitted 24 January, 2022;
originally announced January 2022.
-
Trudinger-Moser inequalities on a closed Riemann surface with a symmetric conical metric
Authors:
Yu Fang,
Yunyan Yang
Abstract:
This is a continuation of our previous work [13]. Let $(Σ,g)$ be a closed Riemann surface, where the metric $g$ has conical singularities at finite points. Suppose $\mathbf{G}$ is a group whose elements are isometries acting on $(Σ,g)$. Trudinger-Moser inequalities involving $\mathbf{G}$ are established via the method of blow-up analysis, and the corresponding extremals are also obtained. This ext…
▽ More
This is a continuation of our previous work [13]. Let $(Σ,g)$ be a closed Riemann surface, where the metric $g$ has conical singularities at finite points. Suppose $\mathbf{G}$ is a group whose elements are isometries acting on $(Σ,g)$. Trudinger-Moser inequalities involving $\mathbf{G}$ are established via the method of blow-up analysis, and the corresponding extremals are also obtained. This extends previous results of Chen [7], Iula-Manicini [21], and the authors [13].
△ Less
Submitted 29 December, 2021;
originally announced December 2021.
-
Volume comparison theorem with respect to sigma-2 curvature
Authors:
Jiaqi Chen,
Yi Fang,
Yan He,
Jingyang Zhong
Abstract:
In this paper, we investigate the volume comparison theorem related to $σ_2$-curvature. In particular, we show that volume comparison theorem with respect to $σ_2$-curvature holds for metrics close to strictly stable positive Einstein metrics. By applying similar techniques, we derive the local rigidity theorem for strictly stable Ricci flat manifolds with respect to $σ_2$-curvature, which shows i…
▽ More
In this paper, we investigate the volume comparison theorem related to $σ_2$-curvature. In particular, we show that volume comparison theorem with respect to $σ_2$-curvature holds for metrics close to strictly stable positive Einstein metrics. By applying similar techniques, we derive the local rigidity theorem for strictly stable Ricci flat manifolds with respect to $σ_2$-curvature, which shows it admits no metric with positive $σ_2$-curvature near strictly stable Ricci-flat metrics.
△ Less
Submitted 10 December, 2023; v1 submitted 18 November, 2021;
originally announced November 2021.
-
BFEMP: Interpenetration-Free MPM-FEM Coupling with Barrier Contact
Authors:
Xuan Li,
Yu Fang,
Minchen Li,
Chenfanfu Jiang
Abstract:
This paper introduces BFEMP, a new approach for monolithically coupling the Material Point Method (MPM) with the Finite Element Method (FEM) through barrier energy-based particle-mesh frictional contact using a variational time-stepping formulation. The fully implicit time integration of the coupled system is recast into a barrier-augmented unconstrained nonlinear optimization problem. A modified…
▽ More
This paper introduces BFEMP, a new approach for monolithically coupling the Material Point Method (MPM) with the Finite Element Method (FEM) through barrier energy-based particle-mesh frictional contact using a variational time-stepping formulation. The fully implicit time integration of the coupled system is recast into a barrier-augmented unconstrained nonlinear optimization problem. A modified line-search Newton's method is adopted to strictly prevent material points from penetrating the FEM domain, ensuring convergence and feasibility regardless of the time step size or the mesh resolutions. The proposed coupling scheme also reduces to a new approach for imposing separable frictional kinematic boundaries for MPM when all nodal displacements in the FEM domain are prescribed with Dirichlet boundary conditions. Compared to standard implicit time integration, the extra algorithmic components associated with the contact treatment only depend on simple point-segment (or point-triangle in 3D) geometric queries which robustly handle arbitrary FEM mesh boundaries represented with codimension-1 simplices. Experiments and analyses are performed to demonstrate the robustness and accuracy of the proposed method.
△ Less
Submitted 7 November, 2021; v1 submitted 6 August, 2021;
originally announced August 2021.
-
Perturbed primal-dual dynamics with damping and time scaling coefficients for affine constrained convex optimization problems
Authors:
Xin He,
Rong Hu,
Ya-Ping Fang
Abstract:
In Hilbert space, we propose a family of primal-dual dynamical system for affine constrained convex optimization problem. Several damping coefficients, time scaling coefficients, and perturbation terms are thus considered. By constructing the energy functions, we investigate the convergence rates with different choices of the damping coefficients and time scaling coefficients. Our results extend t…
▽ More
In Hilbert space, we propose a family of primal-dual dynamical system for affine constrained convex optimization problem. Several damping coefficients, time scaling coefficients, and perturbation terms are thus considered. By constructing the energy functions, we investigate the convergence rates with different choices of the damping coefficients and time scaling coefficients. Our results extend the inertial dynamical approaches for unconstrained convex optimization problems to affine constrained convex optimization problems.
△ Less
Submitted 25 June, 2021;
originally announced June 2021.
-
On weak and viscosity solutions of nonlocal double phase equations
Authors:
Yuzhou Fang,
Chao Zhang
Abstract:
We consider the nonlocal double phase equation \begin{align*} \mathrm{P.V.} &\int_{\mathbb{R}^n}|u(x)-u(y)|^{p-2}(u(x)-u(y))K_{sp}(x,y)\,dy\\ &+\mathrm{P.V.} \int_{\mathbb{R}^n} a(x,y)|u(x)-u(y)|^{q-2}(u(x)-u(y))K_{tq}(x,y)\,dy=0, \end{align*} where $1<p\leq q$ and the modulating coefficient $a(\cdot,\cdot)\geq0$. Under some suitable hypotheses, we first use the De Giorgi-Nash-Moser methods to der…
▽ More
We consider the nonlocal double phase equation \begin{align*} \mathrm{P.V.} &\int_{\mathbb{R}^n}|u(x)-u(y)|^{p-2}(u(x)-u(y))K_{sp}(x,y)\,dy\\ &+\mathrm{P.V.} \int_{\mathbb{R}^n} a(x,y)|u(x)-u(y)|^{q-2}(u(x)-u(y))K_{tq}(x,y)\,dy=0, \end{align*} where $1<p\leq q$ and the modulating coefficient $a(\cdot,\cdot)\geq0$. Under some suitable hypotheses, we first use the De Giorgi-Nash-Moser methods to derive the local Hölder continuity for bounded weak solutions, and then establish the relationship between weak solutions and viscosity solutions to such equations.
△ Less
Submitted 8 June, 2021;
originally announced June 2021.
-
Regularity for quasi-linear parabolic equations with nonhomogeneous degeneracy or singularity
Authors:
Yuzhou Fang,
Chao Zhang
Abstract:
We introduce a new class of quasi-linear parabolic equations involving nonhomogeneous degeneracy or/and singularity $$ \partial_t u=[|D u|^q+a(x,t)|D u|^s]\left(Δu+(p-2)\left\langle D^2 u\frac{D u}{|D u|},\frac{D u}{|D u|}\right\rangle\right), $$ where $1<p<\infty$, $-1<q\leq s<\infty$ and $a(x,t)\ge 0$. The motivation to investigate this model stems not only from the connections to tug-of-war lik…
▽ More
We introduce a new class of quasi-linear parabolic equations involving nonhomogeneous degeneracy or/and singularity $$ \partial_t u=[|D u|^q+a(x,t)|D u|^s]\left(Δu+(p-2)\left\langle D^2 u\frac{D u}{|D u|},\frac{D u}{|D u|}\right\rangle\right), $$ where $1<p<\infty$, $-1<q\leq s<\infty$ and $a(x,t)\ge 0$. The motivation to investigate this model stems not only from the connections to tug-of-war like stochastic games with noise, but also from the non-standard growth problems of double phase type. According to different values of $q,s$, such equations include nonhomogeneous degeneracy or singularity, and may involve these two features simultaneously. In particular, when $q=p-2$ and $q<s$, it will encompass the parabolic $p$-Laplacian both in divergence form and in non-divergence form. We aim to explore the from $L^\infty$ to $C^{1,α}$ regularity theory for the aforementioned problem. To be precise, under some proper assumptions, we use geometrical methods to establish the local Hölder regularity of spatial gradients of viscosity solutions.
△ Less
Submitted 10 May, 2021;
originally announced May 2021.
-
A mathematical analysis of Casimir interactions I: The scalar field
Authors:
Yan-Long Fang,
Alexander Strohmaier
Abstract:
Starting from the construction of the free quantum scalar field of mass $m\geq 0$ we give mathematically precise and rigorous versions of three different approaches to computing the Casimir forces between compact obstacles. We then prove that they are equivalent.
Starting from the construction of the free quantum scalar field of mass $m\geq 0$ we give mathematically precise and rigorous versions of three different approaches to computing the Casimir forces between compact obstacles. We then prove that they are equivalent.
△ Less
Submitted 7 March, 2022; v1 submitted 20 April, 2021;
originally announced April 2021.
-
Trace singularities in obstacle scattering and the Poisson relation for the relative trace
Authors:
Yan-Long Fang,
Alexander Strohmaier
Abstract:
We consider the case of scattering of several obstacles in $\mathbb{R}^d$ for $d \geq 2$ for the Laplace operator $Δ$ with Dirichlet boundary conditions imposed on the obstacles. In the case of two obstacles, we have the Laplace operators $Δ_1$ and $Δ_2$ obtained by imposing Dirichlet boundary conditions only on one of the objects. The relative trace operator $g(Δ) - g(Δ_1) - g(Δ_2) + g(Δ_0)$ was…
▽ More
We consider the case of scattering of several obstacles in $\mathbb{R}^d$ for $d \geq 2$ for the Laplace operator $Δ$ with Dirichlet boundary conditions imposed on the obstacles. In the case of two obstacles, we have the Laplace operators $Δ_1$ and $Δ_2$ obtained by imposing Dirichlet boundary conditions only on one of the objects. The relative trace operator $g(Δ) - g(Δ_1) - g(Δ_2) + g(Δ_0)$ was introduced in [18] and shown to be trace-class for a large class of functions $g$, including certrain functions of polynomial growth. When $g$ is sufficiently regular at zero and fast decaying at infinity then, by the Birman-Krein formula, this trace can be computed from the relative spectral shift function $ξ_{rel}(λ) = -\frac{1}π \Im(Ξ(λ))$, where $Ξ(λ)$ is holomorphic in the upper half-plane and fast decaying. In this paper we study the wave-trace contributions to the singularities of the Fourier transform of $ξ_{rel}$. In particular we prove that $\hatξ_{rel}$ is real-analytic near zero and we relate the decay of $Ξ(λ)$ along the imaginary axis to the first wave-trace invariant of the shortest bounding ball orbit between the obstacles. The function $Ξ(λ)$ is important in physics as it determines the Casimir interactions between the objects.
△ Less
Submitted 27 October, 2021; v1 submitted 2 April, 2021;
originally announced April 2021.
-
Regularity of solutions to degenerate fully nonlinear elliptic equations with variable exponent
Authors:
Yuzhou Fang,
Vicentiu D. Radulescu,
Chao Zhang
Abstract:
We consider the fully nonlinear equation with variable-exponent double phase type degeneracies $$ \big[|Du|^{p(x)}+a(x)|Du|^{q(x)}\big]F(D^2u)=f(x). $$ Under some appropriate assumptions, by making use of geometric tangential methods and combing a refined improvement-of-flatness approach with compactness and scaling techniques we obtain the sharp local $C^{1,α}$ regularity of viscosity solutions t…
▽ More
We consider the fully nonlinear equation with variable-exponent double phase type degeneracies $$ \big[|Du|^{p(x)}+a(x)|Du|^{q(x)}\big]F(D^2u)=f(x). $$ Under some appropriate assumptions, by making use of geometric tangential methods and combing a refined improvement-of-flatness approach with compactness and scaling techniques we obtain the sharp local $C^{1,α}$ regularity of viscosity solutions to such equations.
△ Less
Submitted 23 March, 2021;
originally announced March 2021.
-
Inertial primal-dual methods for linear equality constrained convex optimization problems
Authors:
Xin He,
Rong Hu,
Ya-Ping Fang
Abstract:
In this paper, we propose an inertial accelerated primal-dual method for the linear equality constrained convex optimization problem. When the objective function has a ``nonsmooth + smooth'' composite structure, we further propose an inexact inertial primal-dual method by linearizing the smooth individual function and solving the subproblem inexactly. Assuming merely convexity, we prove that the p…
▽ More
In this paper, we propose an inertial accelerated primal-dual method for the linear equality constrained convex optimization problem. When the objective function has a ``nonsmooth + smooth'' composite structure, we further propose an inexact inertial primal-dual method by linearizing the smooth individual function and solving the subproblem inexactly. Assuming merely convexity, we prove that the proposed methods enjoy $\mathcal{O}(1/k^2)$ convergence rate on the objective residual and the feasibility violation in the primal model. Numerical results are reported to demonstrate the validity of the proposed methods.
△ Less
Submitted 29 June, 2021; v1 submitted 23 March, 2021;
originally announced March 2021.
-
"Second-Order Primal'' + "First-Order Dual'' Dynamical Systems with Time Scaling for Linear Equality Constrained Convex Optimization Problems
Authors:
Xin He,
Rong Hu,
Ya-Ping Fang
Abstract:
Second-order dynamical systems are important tools for solving optimization problems, and most of existing works in this field have focused on unconstrained optimization problems. In this paper, we propose an inertial primal-dual dynamical system with constant viscous damping and time scaling for the linear equality constrained convex optimization problem, which consists of a second-order ODE for…
▽ More
Second-order dynamical systems are important tools for solving optimization problems, and most of existing works in this field have focused on unconstrained optimization problems. In this paper, we propose an inertial primal-dual dynamical system with constant viscous damping and time scaling for the linear equality constrained convex optimization problem, which consists of a second-order ODE for the primal variable and a first-order ODE for the dual variable. When the scaling satisfies certain conditions, we prove its convergence property without assuming strong convexity. Even the convergence rate can become exponential when the scaling grows exponentially. We also show that the obtained convergence property of the dynamical system is preserved under a small perturbation.
△ Less
Submitted 20 May, 2022; v1 submitted 23 March, 2021;
originally announced March 2021.
-
Fast primal-dual algorithm via dynamical system for a linearly constrained convex optimization problem
Authors:
Xin He,
Rong Hu,
Ya-Ping Fang
Abstract:
By time discretization of a second-order primal-dual dynamical system with damping $α/t$ where an inertial construction in the sense of Nesterov is needed only for the primal variable, we propose a fast primal-dual algorithm for a linear equality constrained convex optimization problem. Under a suitable scaling condition, we show that the proposed algorithm enjoys a fast convergence rate for the o…
▽ More
By time discretization of a second-order primal-dual dynamical system with damping $α/t$ where an inertial construction in the sense of Nesterov is needed only for the primal variable, we propose a fast primal-dual algorithm for a linear equality constrained convex optimization problem. Under a suitable scaling condition, we show that the proposed algorithm enjoys a fast convergence rate for the objective residual and the feasibility violation, and the decay rate can reach $\mathcal{O}(1/k^{α-1})$ at the most. We also study convergence properties of the corresponding primal-dual dynamical system to better understand the acceleration scheme. Finally, we report numerical experiments to demonstrate the effectiveness of the proposed algorithm.
△ Less
Submitted 3 June, 2022; v1 submitted 18 March, 2021;
originally announced March 2021.
-
Solvability of a Regular Polynomial Vector Optimization Problem without Convexity
Authors:
Danyang Liu,
Rong Hu,
Yaping Fang
Abstract:
In this paper we consider the solvability of a non-convex regular polynomial vector optimization problem on a nonempty closed set. We introduce regularity conditions for the polynomial vector optimization problem and study properties and characterizations of the regularity conditions. Under the regularity conditions, we study nonemptiness and boundedness of the solution sets of the problem. As a c…
▽ More
In this paper we consider the solvability of a non-convex regular polynomial vector optimization problem on a nonempty closed set. We introduce regularity conditions for the polynomial vector optimization problem and study properties and characterizations of the regularity conditions. Under the regularity conditions, we study nonemptiness and boundedness of the solution sets of the problem. As a consequence, we establish two Frank-Wolfe type theorems for the non-convex polynomial vector optimization problem. Finally, we investigate the solution stability of the non-convex regular polynomial vector optimization problem.
△ Less
Submitted 11 January, 2021;
originally announced January 2021.
-
Nonlinear Cooperative Control of Double Drone-Bar Transportation System
Authors:
Peng Zhang,
Yongchun Fang,
Xiao Liang,
He Lin,
Wei He
Abstract:
Due to the limitation of the drone's load capacity, various specific tasks need to be accomplished by multiple drones in collaboration. In some transportation tasks, two drones are required to lift the load together, which brings even more significant challenges to the control problem because the transportation system is underactuated and it contains very complex dynamic coupling. When transportin…
▽ More
Due to the limitation of the drone's load capacity, various specific tasks need to be accomplished by multiple drones in collaboration. In some transportation tasks, two drones are required to lift the load together, which brings even more significant challenges to the control problem because the transportation system is underactuated and it contains very complex dynamic coupling. When transporting bar-shaped objects, the load's attitude, the rope's swing motion, as well as the distance between the drones, should be carefully considered to ensure the security of the system. So far, few works have been implemented for double drone transportation systems to guarantee their transportation performance, especially in the aforementioned aspect. In this paper, a nonlinear cooperative control method is proposed, with both rigorous stability analysis and experimental results demonstrating its great performance. Without the need to distinguish the identities between the leader and the follower, the proposed method successfully realizes effective control for the two drones separately, mainly owning to the deep analysis for the system dynamics and the elaborate design for the control law. By utilizing Lyapunov techniques, the proposed controller achieves simultaneous positioning and mutual distance control of the drones, meanwhile, it efficiently eliminates the swing of the load. Flight experiments are presented to demonstrate the performance of the proposed nonlinear cooperative control strategy.
△ Less
Submitted 15 November, 2020;
originally announced November 2020.
-
Variance Reduced EXTRA and DIGing and Their Optimal Acceleration for Strongly Convex Decentralized Optimization
Authors:
Huan Li,
Zhouchen Lin,
Yongchun Fang
Abstract:
We study stochastic decentralized optimization for the problem of training machine learning models with large-scale distributed data. We extend the widely used EXTRA and DIGing methods with variance reduction (VR), and propose two methods: VR-EXTRA and VR-DIGing. The proposed VR-EXTRA requires the time of $O((κ_s+n)\log\frac{1}ε)$ stochastic gradient evaluations and $O((κ_b+κ_c)\log\frac{1}ε)$ com…
▽ More
We study stochastic decentralized optimization for the problem of training machine learning models with large-scale distributed data. We extend the widely used EXTRA and DIGing methods with variance reduction (VR), and propose two methods: VR-EXTRA and VR-DIGing. The proposed VR-EXTRA requires the time of $O((κ_s+n)\log\frac{1}ε)$ stochastic gradient evaluations and $O((κ_b+κ_c)\log\frac{1}ε)$ communication rounds to reach precision $ε$, which are the best complexities among the non-accelerated gradient-type methods, where $κ_s$ and $κ_b$ are the stochastic condition number and batch condition number for strongly convex and smooth problems, respectively, $κ_c$ is the condition number of the communication network, and $n$ is the sample size on each distributed node. The proposed VR-DIGing has a little higher communication cost of $O((κ_b+κ_c^2)\log\frac{1}ε)$. Our stochastic gradient computation complexities are the same as the ones of single-machine VR methods, such as SAG, SAGA, and SVRG, and our communication complexities keep the same as those of EXTRA and DIGing, respectively. To further speed up the convergence, we also propose the accelerated VR-EXTRA and VR-DIGing with both the optimal $O((\sqrt{nκ_s}+n)\log\frac{1}ε)$ stochastic gradient computation complexity and $O(\sqrt{κ_bκ_c}\log\frac{1}ε)$ communication complexity. Our stochastic gradient computation complexity is also the same as the ones of single-machine accelerated VR methods, such as Katyusha, and our communication complexity keeps the same as those of accelerated full batch decentralized methods, such as MSDA.
△ Less
Submitted 27 August, 2022; v1 submitted 9 September, 2020;
originally announced September 2020.
-
The weak convergence of varifolds generated by rectifiable flat G-chains
Authors:
Chunyan Liu,
Yangqin Fang,
Ning Zhang
Abstract:
In the present paper, we prove that the convergence of rectifiable chains in flat norm implies the weak convergence of associated rectifiable varifolds if the limit flat chain is rectifiable and the mass converges also to the mass of limit chain.
In the present paper, we prove that the convergence of rectifiable chains in flat norm implies the weak convergence of associated rectifiable varifolds if the limit flat chain is rectifiable and the mass converges also to the mass of limit chain.
△ Less
Submitted 21 May, 2021; v1 submitted 31 August, 2020;
originally announced August 2020.