-
Scalable & Noise-Robust Communication Advantage of Multipartite Quantum Entanglement
Authors:
Ananya Chakraborty,
Ram Krishna Patra,
Kunika Agarwal,
Samrat Sen,
Pratik Ghosal,
Sahil Gopalkrishna Naik,
Manik Banik
Abstract:
Distributed computing, involving multiple servers collaborating on designated computations, faces a critical challenge in optimizing inter-server communication -- an issue central to the study of communication complexity. Quantum resources offer advantages over classical methods in addressing this challenge. In this work, we investigate a distributed computing scenario with multiple senders and a…
▽ More
Distributed computing, involving multiple servers collaborating on designated computations, faces a critical challenge in optimizing inter-server communication -- an issue central to the study of communication complexity. Quantum resources offer advantages over classical methods in addressing this challenge. In this work, we investigate a distributed computing scenario with multiple senders and a single receiver, establishing a scalable advantage of multipartite quantum entanglement in mitigating communication complexity. Specifically, we demonstrate that when the receiver and the senders share a multi-qubit Greenberger-Horne-Zeilinger (GHZ) state -- a quintessential form of genuine multipartite entanglement -- certain global functions of the distributed inputs can be computed with only one bit of classical communication from each sender. In contrast, without entanglement, two bits of communication are required from all but one sender. Consequently, quantum entanglement reduces communication overhead by (n-1) bits for n senders, allowing for arbitrary scaling with an increasing number of senders. We also show that the entanglement-based protocol exhibits significant robustness under white noise, thereby establishing the potential for experimental realization of this novel quantum advantage.
△ Less
Submitted 24 September, 2024; v1 submitted 20 September, 2024;
originally announced September 2024.
-
Local-Data-Hiding and Causal Inseparability: Probing Indefinite Causal Structures with Cryptographic Primitives
Authors:
Sahil Gopalkrishna Naik,
Samrat Sen,
Ram Krishna Patra,
Ananya Chakraborty,
Mir Alimuddin,
Manik Banik,
Pratik Ghosal
Abstract:
Formulation of physical theories typically assumes a definite causal structure -- either static or dynamic -- among the set of physical events. Recent studies, however, suggest the possibility of indefiniteness in causal structure, which emerges as a novel information primitive offering advantages in various protocols. In this work, we explore utilities of this new primitive in cryptographic appli…
▽ More
Formulation of physical theories typically assumes a definite causal structure -- either static or dynamic -- among the set of physical events. Recent studies, however, suggest the possibility of indefiniteness in causal structure, which emerges as a novel information primitive offering advantages in various protocols. In this work, we explore utilities of this new primitive in cryptographic applications. To this aim, we propose a task called local-data-hiding, where a referee distributes encrypted messages among distant parties in such a way that the parties individually remain completely ignorant about the messages, and thus try to decrypt their respective messages through mutual collaboration. As we demonstrate, agents embedded in an indefinite causal structure can outperform their counterparts operating in a definite causal background. Considering the bipartite local-bit-hiding (LBH) task, we establish a strict duality between its optimal success probability and the optimal violation of a causal inequality obtained from the guess-your-neighbour's-input game. This, in turn, provides a way forward to obtain Tsirelson-type bounds for causal inequalities. Furthermore, similar to Peres's separability criterion, we derive a necessary criterion for quantum processes to be useful in the LBH task. We then report an intriguing super-activation phenomenon, where two quantum processes, each individually not useful for the LBH task, become useful when used together. We also analyze the utility of causal indefiniteness arising in classical setups and show its advantages in multipartite variants of the local-data-hiding task. Along with establishing new cryptographic applications our study illuminates various unexplored aspects of causal indefiniteness, and welcomes further studies on this new information primitive.
△ Less
Submitted 30 July, 2024;
originally announced July 2024.
-
Nonlocal Locking of Observable Quantities: A Faithful Signature of Nonclassical Correlations
Authors:
Mir Alimuddin,
Snehasish Roy Chowdhury,
Ram Krishna Patra,
Subhendu B. Ghosh,
Tommaso Tufarelli,
Gerardo Adesso,
Manik Banik
Abstract:
Nonclassicality in composite quantum systems depicts several puzzling manifestations, with Einstein-Podolsky-Rosen entanglement, Schrödinger steering, and Bell nonlocality being the most celebrated ones. In addition to those, an unentangled quantum state can also exhibit nonclassicality, as evidenced from notions such as quantum discord and work deficit. Here, we propose a general framework to inv…
▽ More
Nonclassicality in composite quantum systems depicts several puzzling manifestations, with Einstein-Podolsky-Rosen entanglement, Schrödinger steering, and Bell nonlocality being the most celebrated ones. In addition to those, an unentangled quantum state can also exhibit nonclassicality, as evidenced from notions such as quantum discord and work deficit. Here, we propose a general framework to investigate nonclassical correlations in multipartite quantum states. The distinct signatures left on observable quantities, depending on whether the sub-parts of a composite system are probed separately or jointly, provide an operational avenue to construct different quantifiers that faithfully capture signatures of nonclassicality in quantum states. Along the line we unveil an intriguing phenomenon referred to as `nonlocal locking of observable quantities', where the value of an observable quantity gets locked in the correlation of a nonclassical state. Our approach reduces the experimental demand for verification of nonclassicality in composite systems and can find applications for enhanced energy storage in quantum thermodynamical devices.
△ Less
Submitted 11 July, 2024;
originally announced July 2024.
-
Asymptotic Birkhoff-Violation in Operational Theories: Thermodynamic Implications and Information Processing
Authors:
Ananya Chakraborty,
Sahil Gopalkrishna Naik,
Samrat Sen,
Ram Krishna Patra,
Pratik Ghosal,
Mir Alimuddin,
Manik Banik
Abstract:
In accordance with the entropy principle of thermodynamics, under spontaneous evolutions, physical systems always evolve towards states with equal or greater randomness. But, where does this randomness originate? Renowned Birkhoff-von Neumann theorem, often referred to as Birkhoff theorem, identifies source of this randomness to be the stochastic application of reversible operations on the system…
▽ More
In accordance with the entropy principle of thermodynamics, under spontaneous evolutions, physical systems always evolve towards states with equal or greater randomness. But, where does this randomness originate? Renowned Birkhoff-von Neumann theorem, often referred to as Birkhoff theorem, identifies source of this randomness to be the stochastic application of reversible operations on the system under study, thereby ensuring its epistemic origin. Analogue of this theorem is known to fail in the quantum case. Here, we extend this investigation beyond quantum mechanics to a broader class of operational theories described within the framework of general probabilistic theories (GPTs). In this generalized framework, we establish Birkhoff-violation as the prevalent trait; in fact the asymptotic variant of the theorem gets violated. We then demonstrate that Birkhoff-violation in GPTs can lead to consequences that are atypical to quantum theory. For instance, we report manifestation of Birkhoff-violation in a communication task, which otherwise is not observed in quantum world. We also show that, unlike the quantum case, in other operational theories the state transformation criteria can be distinct under mixtures of reversible transformations and doubly stochastic evolutions, leading to different resource theories of purity. Despite these exotic implications, we analyze how to define a coherent notion of entropy in this generalized framework, while upholding alignment with von Neumann's thought experiment.
△ Less
Submitted 13 June, 2024;
originally announced June 2024.
-
A non-parametric approach for estimating consumer valuation distributions using second price auctions
Authors:
Sourav Mukherjee,
Rohit K Patra,
Kshitij Khare
Abstract:
We focus on online second price auctions, where bids are made sequentially, and the winning bidder pays the maximum of the second-highest bid and a seller specified reserve price. For many such auctions, the seller does not see all the bids or the total number of bidders accessing the auction, and only observes the current selling prices throughout the course of the auction. We develop a novel non…
▽ More
We focus on online second price auctions, where bids are made sequentially, and the winning bidder pays the maximum of the second-highest bid and a seller specified reserve price. For many such auctions, the seller does not see all the bids or the total number of bidders accessing the auction, and only observes the current selling prices throughout the course of the auction. We develop a novel non-parametric approach to estimate the underlying consumer valuation distribution based on this data. Previous non-parametric approaches in the literature only use the final selling price and assume knowledge of the total number of bidders. The resulting estimate, in particular, can be used by the seller to compute the optimal profit-maximizing price for the product. Our approach is free of tuning parameters, and we demonstrate its computational and statistical efficiency in a variety of simulation settings, and also on an Xbox 7-day auction dataset on eBay.
△ Less
Submitted 12 December, 2023;
originally announced December 2023.
-
Overcoming Traditional No-Go Theorems: Quantum Advantage in Multiple Access Channels
Authors:
Ananya Chakraborty,
Sahil Gopalkrishna Naik,
Edwin Peter Lobo,
Ram Krishna Patra,
Samrat Sen,
Mir Alimuddin,
Amit Mukherjee,
Manik Banik
Abstract:
Extension of point-to-point communication model to the realm of multi-node configurations finds a plethora of applications in internet and telecommunication networks. Here, we establish a novel advantage of quantum communication in a commonly encountered network configuration known as the Multiple Access Channel (MAC). A MAC consists of multiple distant senders aiming to send their respective mess…
▽ More
Extension of point-to-point communication model to the realm of multi-node configurations finds a plethora of applications in internet and telecommunication networks. Here, we establish a novel advantage of quantum communication in a commonly encountered network configuration known as the Multiple Access Channel (MAC). A MAC consists of multiple distant senders aiming to send their respective messages to a common receiver. Unlike the quantum superdense coding protocol, the advantage reported here is realized without invoking entanglement between the senders and the receiver. Notably, such an advantage is unattainable in traditional point-to-point communication involving one sender and one receiver, where the limitations imposed by the Holevo and Frankel Weiner no-go theorems come into play. Within the MAC setup, this distinctive advantage materializes through the receiver's unique ability to simultaneously decode the quantum systems received from multiple senders. Intriguingly, some of our MAC designs draw inspiration from various other constructs in quantum foundations, such as the Pusey-Barrett-Rudolph theorem and the concept of `nonlocality without entanglement', originally explored for entirely different purposes. Beyond its immediate applications in network communication, the presented quantum advantage hints at a profound connection with the concept of `quantum nonlocality without inputs' and holds the potential for semi-device-independent certification of entangled measurements.
△ Less
Submitted 29 May, 2024; v1 submitted 29 September, 2023;
originally announced September 2023.
-
Advantage of Hardy's Nonlocal Correlation in Reverse Zero-Error Channel Coding
Authors:
Mir Alimuddin,
Ananya Chakraborty,
Govind Lal Sidhardh,
Ram Krishna Patra,
Samrat Sen,
Snehasish Roy Chowdhury,
Sahil Gopalkrishna Naik,
Manik Banik
Abstract:
Hardy's argument constitutes an elegant proof of quantum nonlocality. In this work, we report an exotic application of Hardy's nonlocal correlations in two-party communication setup. We come up with a task, wherein a positive payoff can be through an $1$ bit of communication from the sender to the receiver if and only if the communication channel is assisted with a no-signaling correlation exhibit…
▽ More
Hardy's argument constitutes an elegant proof of quantum nonlocality. In this work, we report an exotic application of Hardy's nonlocal correlations in two-party communication setup. We come up with a task, wherein a positive payoff can be through an $1$ bit of communication from the sender to the receiver if and only if the communication channel is assisted with a no-signaling correlation exhibiting Hardy's nonlocality. This further prompts us to establish a counter-intuitive result in correlation assisted reverse zero-error channel coding scenario, where the aim is to simulate a higher input-output noisy classical channel by a lower input-output noiseless one in assistance with pre-shared correlations. We show that there exist such reverse zero-error channel simulation tasks where non-maximally entangled states are preferable over the assistance with a maximally entangled state, even when the former states carry an arbitrarily small amount of entanglement. Our work thus establishes that within the operational paradigm of local operations and limited classical communication the structure of entangled resources is even more complex to characterize.
△ Less
Submitted 2 November, 2023; v1 submitted 13 March, 2023;
originally announced March 2023.
-
Principle of information causality rationalizes quantum composition
Authors:
Ram Krishna Patra,
Sahil Gopalkrishna Naik,
Edwin Peter Lobo,
Samrat Sen,
Govind Lal Sidhardh,
Mir Alimuddin,
Manik Banik
Abstract:
Principle of information causality, proposed as a generalization of no signaling principle, has efficiently been applied to outcast beyond quantum correlations as unphysical. In this letter we show that this principle when utilized properly can provide physical rationale towards structural derivation of multipartite quantum systems. In accordance with no signaling condition state and effect spaces…
▽ More
Principle of information causality, proposed as a generalization of no signaling principle, has efficiently been applied to outcast beyond quantum correlations as unphysical. In this letter we show that this principle when utilized properly can provide physical rationale towards structural derivation of multipartite quantum systems. In accordance with no signaling condition state and effect spaces of a composite system can allow different possible mathematical descriptions even when description for the individual systems are assumed to be quantum. While in one extreme, namely the maximal tensor product composition, the state space becomes quite exotic and permits composite states that are not allowed in quantum theory, the other extreme -- minimal tensor product composition -- contains only separable states and the resulting theory allows only Bell local correlation. As we show, none of these compositions does commensurate with information causality, and hence get invalidated to be the bona-fide description of nature. Information causality, therefore, promises information theoretic derivation of self-duality of state and effect cones for composite quantum systems.
△ Less
Submitted 24 February, 2023; v1 submitted 30 August, 2022;
originally announced August 2022.
-
Timelike correlations and quantum tensor product structure
Authors:
Samrat Sen,
Edwin Peter Lobo,
Ram Krishna Patra,
Sahil Gopalkrishna Naik,
Anandamay Das Bhowmik,
Mir Alimuddin,
Manik Banik
Abstract:
The state space structure for a composite quantum system is postulated among several mathematically consistent possibilities that are compatible with local quantum description. For instance, unentangled Gleason's theorem allows a state space that includes density operators as a proper subset among all possible composite states. However, bipartite correlations obtained in Bell type experiments from…
▽ More
The state space structure for a composite quantum system is postulated among several mathematically consistent possibilities that are compatible with local quantum description. For instance, unentangled Gleason's theorem allows a state space that includes density operators as a proper subset among all possible composite states. However, bipartite correlations obtained in Bell type experiments from this broader state space are in-fact quantum simulable, and hence such spacelike correlations are no good to make distinction among different compositions. In this work we analyze communication utilities of these different composite models and show that they can lead to distinct utilities in a simple communication game involving two players. Our analysis, thus, establishes that beyond quantum composite structure can lead to beyond quantum correlations in timelike scenario and hence welcomes new principles to isolate the quantum correlations from the beyond quantum ones. We also prove a no-go that the classical information carrying capacity of different such compositions cannot be more than the corresponding quantum composite systems.
△ Less
Submitted 4 August, 2022;
originally announced August 2022.
-
Classical analogue of quantum superdense coding and communication advantage of a single quantum system
Authors:
Ram Krishna Patra,
Sahil Gopalkrishna Naik,
Edwin Peter Lobo,
Samrat Sen,
Tamal Guha,
Some Sankar Bhattacharya,
Mir Alimuddin,
Manik Banik
Abstract:
We analyze utility of communication channels in absence of any short of quantum or classical correlation shared between the sender and the receiver. To this aim, we propose a class of two-party communication games, and show that the games cannot be won given a noiseless $1$-bit classical channel from the sender to the receiver. Interestingly, the goal can be perfectly achieved if the channel is as…
▽ More
We analyze utility of communication channels in absence of any short of quantum or classical correlation shared between the sender and the receiver. To this aim, we propose a class of two-party communication games, and show that the games cannot be won given a noiseless $1$-bit classical channel from the sender to the receiver. Interestingly, the goal can be perfectly achieved if the channel is assisted with classical shared randomness. This resembles an advantage similar to the quantum superdense coding phenomenon where pre-shared entanglement can enhance the communication utility of a perfect quantum communication line. Quite surprisingly, we show that a qubit communication without any assistance of classical shared randomness can achieve the goal, and hence establishes a novel quantum advantage in the simplest communication scenario. In pursuit of a deeper origin of this advantage, we show that an advantageous quantum strategy must invoke quantum interference both at the encoding step by the sender and at the decoding step by the receiver. We also study communication utility of a class of non-classical toy systems described by symmetric polygonal state spaces. We come up with communication tasks that can be achieved neither with $1$-bit of classical communication nor by communicating a polygon system, whereas $1$-qubit communication yields a perfect strategy, establishing quantum advantage over them. To this end, we show that the quantum advantages are robust against imperfect encodings-decodings, making the protocols implementable with presently available quantum technologies.
△ Less
Submitted 4 April, 2024; v1 submitted 14 February, 2022;
originally announced February 2022.
-
Certifying beyond quantumness of locally quantum no-signalling theories through quantum input Bell test
Authors:
Edwin Peter Lobo,
Sahil Gopalkrishna Naik,
Samrat Sen,
Ram Krishna Patra,
Manik Banik,
Mir Alimuddin
Abstract:
Physical theories constrained with local quantum structure and satisfying the no-signalling principle can allow beyond-quantum global states. In a standard Bell experiment, correlations obtained from any such beyond-quantum bipartite state can always be reproduced by quantum states and measurements, suggesting local quantum structure and no-signalling to be the axioms to isolate quantum correlatio…
▽ More
Physical theories constrained with local quantum structure and satisfying the no-signalling principle can allow beyond-quantum global states. In a standard Bell experiment, correlations obtained from any such beyond-quantum bipartite state can always be reproduced by quantum states and measurements, suggesting local quantum structure and no-signalling to be the axioms to isolate quantum correlations. In this letter, however, we show that if the Bell experiment is generalized to allow local quantum inputs, then beyond-quantum correlations can be generated by every beyond-quantum state. This gives us a way to certify beyond-quantumness of locally quantum no-signalling theories and in turn suggests requirement of additional information principles along with local quantum structure and no-signalling principle to isolate quantum correlations. More importantly, our work establishes that the additional principle(s) must be sensitive to the quantum signature of local inputs. We also generalize our results to multipartite locally quantum no-signalling theories and further analyze some interesting implications.
△ Less
Submitted 27 September, 2022; v1 submitted 7 November, 2021;
originally announced November 2021.
-
Dimension reduction for integrative survival analysis
Authors:
Aaron J. Molstad,
Rohit K. Patra
Abstract:
We propose a constrained maximum partial likelihood estimator for dimension reduction in integrative (e.g., pan-cancer) survival analysis with high-dimensional covariates. We assume that for each population in the study, the hazard function follows a distinct Cox proportional hazards model. To borrow information across populations, we assume that all of the hazard functions depend only on a small…
▽ More
We propose a constrained maximum partial likelihood estimator for dimension reduction in integrative (e.g., pan-cancer) survival analysis with high-dimensional covariates. We assume that for each population in the study, the hazard function follows a distinct Cox proportional hazards model. To borrow information across populations, we assume that all of the hazard functions depend only on a small number of linear combinations of the predictors. We estimate these linear combinations using an algorithm based on "distance-to-set" penalties. This allows us to impose both low-rankness and sparsity. We derive asymptotic results which reveal that our regression coefficient estimator is more efficient than fitting a separate proportional hazards model for each population. Numerical experiments suggest that our method outperforms related competitors under various data generating models. We use our method to perform a pan-cancer survival analysis relating protein expression to survival across 18 distinct cancer types. Our approach identifies six linear combinations, depending on only 20 proteins, which explain survival across the cancer types. Finally, we validate our fitted model on four external datasets and show that our estimated coefficients can lead to better prediction than popular competitors.
△ Less
Submitted 26 April, 2023; v1 submitted 4 August, 2021;
originally announced August 2021.
-
Local Quantum State Marking
Authors:
Samrat Sen,
Edwin Peter Lobo,
Sahil Gopalkrishna Naik,
Ram Krishna Patra,
Tathagata Gupta,
Subhendu B. Ghosh,
Sutapa Saha,
Mir Alimuddin,
Tamal Guha,
Some Sankar Bhattacharya,
Manik Banik
Abstract:
We propose the task of local state marking (LSM), where some multipartite quantum states chosen randomly from a known set of states are distributed among spatially separated parties without revealing the identities of the individual states. The collaborative aim of the parties is to correctly mark the identities of states under the restriction that they can perform only local quantum operations (L…
▽ More
We propose the task of local state marking (LSM), where some multipartite quantum states chosen randomly from a known set of states are distributed among spatially separated parties without revealing the identities of the individual states. The collaborative aim of the parties is to correctly mark the identities of states under the restriction that they can perform only local quantum operations (LO) on their respective subsystems and can communicate with each other classically (CC) -- popularly known as the operational paradigm of LOCC. While mutually orthogonal states can always be marked exactly under global operations, this is in general not the case under LOCC. We show that the LSM task is distinct from the vastly explored task of local state distinguishability (LSD) -- perfect LSD always implies perfect LSM, whereas we establish that the converse does not hold in general. We also explore entanglement assisted marking of states that are otherwise locally unmarkable and report intriguing entanglement assisted catalytic LSM phenomenon.
△ Less
Submitted 7 March, 2022; v1 submitted 26 July, 2021;
originally announced July 2021.
-
Mutually Unbiased Balanced Functions & Generalized Random Access Codes
Authors:
Vaisakh M,
Ram krishna Patra,
Mukta Janpandit,
Samrat Sen,
Anubhav Chaturvedi,
Manik Banik
Abstract:
Quantum resources and protocols are known to outperform their classical counterparts in variety of communication and information processing tasks. Random Access Codes (RACs) are one such cryptographically significant family of bipartite communication tasks, wherein, the sender encodes a data set (typically a string of input bits) onto a physical system of bounded dimension and transmits it to the…
▽ More
Quantum resources and protocols are known to outperform their classical counterparts in variety of communication and information processing tasks. Random Access Codes (RACs) are one such cryptographically significant family of bipartite communication tasks, wherein, the sender encodes a data set (typically a string of input bits) onto a physical system of bounded dimension and transmits it to the receiver, who then attempts to guess a randomly chosen part of the sender's data set (typically one of the sender's input bits). In this work, we introduce a generalization of this task wherein the receiver, in addition to the individual input bits, aims to retrieve randomly chosen functions of sender's input string. Specifically, we employ sets of mutually unbiased balanced functions (MUBS), such that perfect knowledge of any one of the constituent functions yields no knowledge about the others. We investigate and bound the performance of (i.) classical, (ii.) quantum prepare and measure, and (iii.) entanglement assisted classical communication (EACC) protocols for the resultant generalized RACs (GRACs). Finally, we detail the case of GRACs with three input bits, find maximal success probabilities for classical, quantum and EACC protocols, along with the effect of noisy quantum channels on the performance of quantum protocols. Moreover, with the help of this case study, we reveal several characteristic properties of the GRACs which deviate from the standard RACs.
△ Less
Submitted 9 May, 2021;
originally announced May 2021.
-
A semi-parametric model for target localization in distributed systems
Authors:
Rohit K. Patra,
Moulinath Banerjee,
George Michailidis
Abstract:
Distributed systems serve as a key technological infrastructure for monitoring diverse systems across space and time. Examples of their widespread applications include: precision agriculture, surveillance, ecosystem and physical infrastructure monitoring, animal behavior and tracking, disaster response and recovery to name a few. Such systems comprise of a large number of sensor devices at fixed l…
▽ More
Distributed systems serve as a key technological infrastructure for monitoring diverse systems across space and time. Examples of their widespread applications include: precision agriculture, surveillance, ecosystem and physical infrastructure monitoring, animal behavior and tracking, disaster response and recovery to name a few. Such systems comprise of a large number of sensor devices at fixed locations, wherein each individual sensor obtains measurements that are subsequently fused and processed at a central processing node. A key problem for such systems is to detect targets and identify their locations, for which a large body of literature has been developed focusing primarily on employing parametric models for signal attenuation from target to device. In this paper, we adopt a nonparametric approach that only assumes that the signal is nonincreasing as function of the distance between the sensor and the target. We propose a simple tuning parameter free estimator for the target location, namely, the simple score estimator (SSCE). We show that the SSCE is $\sqrt{n}$ consistent and has a Gaussian limit distribution which can be used to construct asymptotic confidence regions for the location of the target. We study the performance of the SSCE through extensive simulations, and finally demonstrate an application to target detection in a video surveillance data set.
△ Less
Submitted 3 December, 2020;
originally announced December 2020.
-
Least Squares Estimation of a Quasiconvex Regression Function
Authors:
Somabha Mukherjee,
Rohit K. Patra,
Andrew L. Johnson,
Hiroshi Morita
Abstract:
We develop a new approach for the estimation of a multivariate function based on the economic axioms of quasiconvexity (and monotonicity). On the computational side, we prove the existence of the quasiconvex constrained least squares estimator (LSE) and provide a characterization of the function space to compute the LSE via a mixed integer quadratic programme. On the theoretical side, we provide f…
▽ More
We develop a new approach for the estimation of a multivariate function based on the economic axioms of quasiconvexity (and monotonicity). On the computational side, we prove the existence of the quasiconvex constrained least squares estimator (LSE) and provide a characterization of the function space to compute the LSE via a mixed integer quadratic programme. On the theoretical side, we provide finite sample risk bounds for the LSE via a sharp oracle inequality. Our results allow for errors to depend on the covariates and to have only two finite moments. We illustrate the superior performance of the LSE against some competing estimators via simulation. Finally, we use the LSE to estimate the production function for the Japanese plywood industry and the cost function for hospitals across the US.
△ Less
Submitted 22 October, 2023; v1 submitted 9 March, 2020;
originally announced March 2020.
-
On Least Squares Estimation under Heteroscedastic and Heavy-Tailed Errors
Authors:
Arun K. Kuchibhotla,
Rohit K. Patra
Abstract:
We consider least squares estimation in a general nonparametric regression model. The rate of convergence of the least squares estimator (LSE) for the unknown regression function is well studied when the errors are sub-Gaussian. We find upper bounds on the rates of convergence of the LSE when the errors have uniformly bounded conditional variance and have only finitely many moments. We show that t…
▽ More
We consider least squares estimation in a general nonparametric regression model. The rate of convergence of the least squares estimator (LSE) for the unknown regression function is well studied when the errors are sub-Gaussian. We find upper bounds on the rates of convergence of the LSE when the errors have uniformly bounded conditional variance and have only finitely many moments. We show that the interplay between the moment assumptions on the error, the metric entropy of the class of functions involved, and the "local" structure of the function class around the truth drives the rate of convergence of the LSE. We find sufficient conditions on the errors under which the rate of the LSE matches the rate of the LSE under sub-Gaussian error. Our results are finite sample and allow for heteroscedastic and heavy-tailed errors.
△ Less
Submitted 8 April, 2021; v1 submitted 4 September, 2019;
originally announced September 2019.
-
A machine--vision method for automatic classification of stellar halo substructure
Authors:
David Hendel,
Kathryn V. Johnston,
Rohit K. Patra,
Bodhisattva Sen
Abstract:
Tidal debris structures formed from disrupted satellites contain important clues about the assembly histories of galaxies. To date, studies of these structures have been hampered by reliance on by-eye identification and morphological classification which leaves their interpretation significantly uncertain. In this work we present a new machine-vision technique based on the Subspace-Constrained Mea…
▽ More
Tidal debris structures formed from disrupted satellites contain important clues about the assembly histories of galaxies. To date, studies of these structures have been hampered by reliance on by-eye identification and morphological classification which leaves their interpretation significantly uncertain. In this work we present a new machine-vision technique based on the Subspace-Constrained Mean Shift (SCMS) algorithm which can perform these tasks automatically. SCMS finds the location of the high-density `ridges' that define substructure morphology. After identification, the coefficients of an orthogonal series density estimator are used to classify points on the ridges as part of a continuum between shell-like or stream-like debris, from which a global morphological classification can be determined. We dub this procedure Subspace Constrained Unsupervised Detection of Structure (SCUDS). By applying this tool to controlled N--body simulations of minor mergers we demonstrate that the extracted classifications correspond to the well--understood underlying physics of phase mixing. The application of SCUDS to resolved stellar population data from near-future surveys will inform our understanding of the buildup of galaxies stellar halos.
△ Less
Submitted 26 November, 2018;
originally announced November 2018.
-
Semiparametric Efficiency in Convexity Constrained Single Index Model
Authors:
Arun K. Kuchibhotla,
Rohit K. Patra,
Bodhisattva Sen
Abstract:
We consider estimation and inference in a single index regression model with an unknown convex link function. We introduce a convex and Lipschitz constrained least squares estimator (CLSE) for both the parametric and the nonparametric components given independent and identically distributed observations. We prove the consistency and find the rates of convergence of the CLSE when the errors are ass…
▽ More
We consider estimation and inference in a single index regression model with an unknown convex link function. We introduce a convex and Lipschitz constrained least squares estimator (CLSE) for both the parametric and the nonparametric components given independent and identically distributed observations. We prove the consistency and find the rates of convergence of the CLSE when the errors are assumed to have only $q \ge 2$ moments and are allowed to depend on the covariates. When $q\ge 5$, we establish $n^{-1/2}$-rate of convergence and asymptotic normality of the estimator of the parametric component. Moreover, the CLSE is proved to be semiparametrically efficient if the errors happen to be homoscedastic. {We develop and implement a numerically stable and computationally fast algorithm to compute our proposed estimator in the R package~\texttt{simest}}. We illustrate our methodology through extensive simulations and data analysis. Finally, our proof of efficiency is geometric and provides a general framework that can be used to prove efficiency of estimators in a wide variety of semiparametric models even when they do not satisfy the efficient score equation directly.
△ Less
Submitted 13 January, 2021; v1 submitted 31 July, 2017;
originally announced August 2017.
-
Efficient Estimation in Single Index Models through Smoothing splines
Authors:
Arun Kumar Kuchibhotla,
Rohit Kumar Patra
Abstract:
We consider estimation and inference in a single index regression model with an unknown but smooth link function. In contrast to the standard approach of using kernels or regression splines, we use smoothing splines to estimate the smooth link function. We develop a method to compute the penalized least squares estimators (PLSEs) of the parametric and the nonparametric components given independent…
▽ More
We consider estimation and inference in a single index regression model with an unknown but smooth link function. In contrast to the standard approach of using kernels or regression splines, we use smoothing splines to estimate the smooth link function. We develop a method to compute the penalized least squares estimators (PLSEs) of the parametric and the nonparametric components given independent and identically distributed (i.i.d.)~data. We prove the consistency and find the rates of convergence of the estimators. We establish asymptotic normality under under mild assumption and prove asymptotic efficiency of the parametric component under homoscedastic errors. A finite sample simulation corroborates our asymptotic theory. We also analyze a car mileage data set and a Ozone concentration data set. The identifiability and existence of the PLSEs are also investigated.
△ Less
Submitted 25 May, 2019; v1 submitted 30 November, 2016;
originally announced December 2016.
-
On a Nonparametric Notion of Residual and its Applications
Authors:
Rohit Kumar Patra,
Bodhisattva Sen,
Gabor Szekely
Abstract:
Let $(X, \mathbf{Z})$ be a continuous random vector in $\mathbb{R} \times \mathbb{R}^d$, $d \ge 1$. In this paper, we define the notion of a nonparametric residual of $X$ on $\mathbf{Z}$ that is always independent of the predictor $\mathbf{Z}$. We study its properties and show that the proposed notion of residual matches with the usual residual (error) in a multivariate normal regression model. Gi…
▽ More
Let $(X, \mathbf{Z})$ be a continuous random vector in $\mathbb{R} \times \mathbb{R}^d$, $d \ge 1$. In this paper, we define the notion of a nonparametric residual of $X$ on $\mathbf{Z}$ that is always independent of the predictor $\mathbf{Z}$. We study its properties and show that the proposed notion of residual matches with the usual residual (error) in a multivariate normal regression model. Given a random vector $(X, Y, \mathbf{Z})$ in $\mathbb{R} \times \mathbb{R} \times \mathbb{R}^d$, we use this notion of residual to show that the conditional independence between $X$ and $Y$, given $\mathbf{Z}$, is equivalent to the mutual independence of the residuals (of $X$ on $\mathbf{Z}$ and $Y$ on $\mathbf{Z}$) and $\mathbf{Z}$. This result is used to develop a test for conditional independence. We propose a bootstrap scheme to approximate the critical value of this test. We compare the proposed test, which is easily implementable, with some of the existing procedures through a simulation study.
△ Less
Submitted 30 September, 2015; v1 submitted 12 September, 2014;
originally announced September 2014.
-
Estimation of a Two-component Mixture Model with Applications to Multiple Testing
Authors:
Rohit Kumar Patra,
Bodhisattva Sen
Abstract:
We consider a two-component mixture model with one known component. We develop methods for estimating the mixing proportion and the unknown distribution nonparametrically, given i.i.d.~data from the mixture model, using ideas from shape restricted function estimation. We establish the consistency of our estimators. We find the rate of convergence and asymptotic limit of the estimator for the mixin…
▽ More
We consider a two-component mixture model with one known component. We develop methods for estimating the mixing proportion and the unknown distribution nonparametrically, given i.i.d.~data from the mixture model, using ideas from shape restricted function estimation. We establish the consistency of our estimators. We find the rate of convergence and asymptotic limit of the estimator for the mixing proportion. Completely automated distribution-free honest finite sample lower confidence bounds are developed for the mixing proportion. Connection to the problem of multiple testing is discussed. The identifiability of the model, and the estimation of the density of the unknown distribution are also addressed. We compare the proposed estimators, which are easily implementable, with some of the existing procedures through simulation studies and analyse two data sets, one arising from an application in astronomy and the other from a microarray experiment.
△ Less
Submitted 8 November, 2015; v1 submitted 24 April, 2012;
originally announced April 2012.
-
A Consistent Bootstrap Procedure for the Maximum Score Estimator
Authors:
Rohit Kumar Patra,
Emilio Seijo,
Bodhisattva Sen
Abstract:
In this paper we study the applicability of the bootstrap to do inference on Manski's maximum score estimator under the full generality of the model. We propose three new, model-based bootstrap procedures for this problem and show their consistency. Simulation experiments are carried out to evaluate their performance and to compare them with subsampling methods. Additionally, we prove a uniform co…
▽ More
In this paper we study the applicability of the bootstrap to do inference on Manski's maximum score estimator under the full generality of the model. We propose three new, model-based bootstrap procedures for this problem and show their consistency. Simulation experiments are carried out to evaluate their performance and to compare them with subsampling methods. Additionally, we prove a uniform convergence theorem for triangular arrays of random variables coming from binary choice models, which may be of independent interest.
△ Less
Submitted 17 December, 2015; v1 submitted 10 May, 2011;
originally announced May 2011.
