-
A Flexible-Frame-Rate Vision-Aided Inertial Object Tracking System for Mobile Devices
Authors:
Yo-Chung Lau,
Kuan-Wei Tseng,
I-Ju Hsieh,
Hsiao-Ching Tseng,
Yi-Ping Hung
Abstract:
Real-time object pose estimation and tracking is challenging but essential for emerging augmented reality (AR) applications. In general, state-of-the-art methods address this problem using deep neural networks which indeed yield satisfactory results. Nevertheless, the high computational cost of these methods makes them unsuitable for mobile devices where real-world applications usually take place.…
▽ More
Real-time object pose estimation and tracking is challenging but essential for emerging augmented reality (AR) applications. In general, state-of-the-art methods address this problem using deep neural networks which indeed yield satisfactory results. Nevertheless, the high computational cost of these methods makes them unsuitable for mobile devices where real-world applications usually take place. In addition, head-mounted displays such as AR glasses require at least 90~FPS to avoid motion sickness, which further complicates the problem. We propose a flexible-frame-rate object pose estimation and tracking system for mobile devices. It is a monocular visual-inertial-based system with a client-server architecture. Inertial measurement unit (IMU) pose propagation is performed on the client side for high speed tracking, and RGB image-based 3D pose estimation is performed on the server side to obtain accurate poses, after which the pose is sent to the client side for visual-inertial fusion, where we propose a bias self-correction mechanism to reduce drift. We also propose a pose inspection algorithm to detect tracking failures and incorrect pose estimation. Connected by high-speed networking, our system supports flexible frame rates up to 120 FPS and guarantees high precision and real-time tracking on low-end devices. Both simulations and real world experiments show that our method achieves accurate and robust object tracking.
△ Less
Submitted 22 October, 2022;
originally announced October 2022.
-
NetFense: Adversarial Defenses against Privacy Attacks on Neural Networks for Graph Data
Authors:
I-Chung Hsieh,
Cheng-Te Li
Abstract:
Recent advances in protecting node privacy on graph data and attacking graph neural networks (GNNs) gain much attention. The eye does not bring these two essential tasks together yet. Imagine an adversary can utilize the powerful GNNs to infer users' private labels in a social network. How can we adversarially defend against such privacy attacks while maintaining the utility of perturbed graphs? I…
▽ More
Recent advances in protecting node privacy on graph data and attacking graph neural networks (GNNs) gain much attention. The eye does not bring these two essential tasks together yet. Imagine an adversary can utilize the powerful GNNs to infer users' private labels in a social network. How can we adversarially defend against such privacy attacks while maintaining the utility of perturbed graphs? In this work, we propose a novel research task, adversarial defenses against GNN-based privacy attacks, and present a graph perturbation-based approach, NetFense, to achieve the goal. NetFense can simultaneously keep graph data unnoticeability (i.e., having limited changes on the graph structure), maintain the prediction confidence of targeted label classification (i.e., preserving data utility), and reduce the prediction confidence of private label classification (i.e., protecting the privacy of nodes). Experiments conducted on single- and multiple-target perturbations using three real graph data exhibit that the perturbed graphs by NetFense can effectively maintain data utility (i.e., model unnoticeability) on targeted label classification and significantly decrease the prediction confidence of private label classification (i.e., privacy protection). Extensive studies also bring several insights, such as the flexibility of NetFense, preserving local neighborhoods in data unnoticeability, and better privacy protection for high-degree nodes.
△ Less
Submitted 22 June, 2021;
originally announced June 2021.
-
CoANE: Modeling Context Co-occurrence for Attributed Network Embedding
Authors:
I-Chung Hsieh,
Cheng-Te Li
Abstract:
Attributed network embedding (ANE) is to learn low-dimensional vectors so that not only the network structure but also node attributes can be preserved in the embedding space. Existing ANE models do not consider the specific combination between graph structure and attributes. While each node has its structural characteristics, such as highly-interconnected neighbors along with their certain patter…
▽ More
Attributed network embedding (ANE) is to learn low-dimensional vectors so that not only the network structure but also node attributes can be preserved in the embedding space. Existing ANE models do not consider the specific combination between graph structure and attributes. While each node has its structural characteristics, such as highly-interconnected neighbors along with their certain patterns of attribute distribution, each node's neighborhood should be not only depicted by multi-hop nodes, but consider certain clusters or social circles. To model such information, in this paper, we propose a novel ANE model, Context Co-occurrence-aware Attributed Network Embedding (CoANE). The basic idea of CoANE is to model the context attributes that each node's involved diverse patterns, and apply the convolutional mechanism to encode positional information by treating each attribute as a channel. The learning of context co-occurrence can capture the latent social circles of each node. To better encode structural and semantic knowledge of nodes, we devise a three-way objective function, consisting of positive graph likelihood, contextual negative sampling, and attribute reconstruction. We conduct experiments on five real datasets in the tasks of link prediction, node label classification, and node clustering. The results exhibit that CoANE can significantly outperform state-of-the-art ANE models.
△ Less
Submitted 17 June, 2021;
originally announced June 2021.
-
ALMA View of the Infalling Envelope around a Massive Protostar in S255IR SMA1
Authors:
Sheng-Yuan Liu,
Yu-Nung Su,
Igor Zinchenko,
Kuo-Song Wang,
Dominique M. -A. Meyer,
Yuan Wang,
I-Ta Hsieh
Abstract:
The massive young stellar object S255IR NIRS3 embedded in the star forming core SMA1 has been recently observed with a luminosity burst, which is conjectured as a disc-mediated variable accretion event. In this context, it is imperative to characterize the gas properties around the massive young stellar object. With this in mind, we carried out high angular resolution observations with the Atacama…
▽ More
The massive young stellar object S255IR NIRS3 embedded in the star forming core SMA1 has been recently observed with a luminosity burst, which is conjectured as a disc-mediated variable accretion event. In this context, it is imperative to characterize the gas properties around the massive young stellar object. With this in mind, we carried out high angular resolution observations with the Atacama Large Millimeter and submillimeter Array and imaged the 900 $μm$ dust continuum and the CH$_3$CN $J$=19$-$18 $K$=0$-$10 transitions of S255IR SMA1. The integrated CH$_3$CN emission exhibits an elongated feature with an extent of 1800 au in the northwest-southeast direction at a position angle of 165 degree, which is nearly perpendicular to the bipolar outflow. We confirm the presence of dense (a few $\times 10^{9}$ cm$^{-3}$) and hot ($\sim$ 400 K) gas immediately surrounding the central protostar. The CH$_3$CN emission features a velocity gradient along the elongated ridge and by modelling the gas kinematics based on features in the position-velocity diagram, we infer that the gas is best described by a flattened rotating infalling envelope (or pseudo-disc). A mass infall rate of a few $\times$ 10$^{-4}$ solar-mass per year is derived. If there exists a putative Keplerian disc directly involved in the mass accretion onto the star and jet/outflow launching, it is likely smaller than 125 au and unresolved by our observations. We show qualitative resemblances between the gas properties (such as density and kinematics) in 255IR SMA1 inferred from our observations and those in a numerical simulation particularly tailored for studying the burst mode of massive star formation.
△ Less
Submitted 19 October, 2020;
originally announced October 2020.
-
The Infall Motion in the Low-Mass Protostellar Binary NGC 1333 IRAS 4A1/4A2
Authors:
Yu-Nung Su,
Sheng-Yuan Liu,
Zhi-Yun Li,
Chin-Fei Lee,
Naomi Hirano,
Shigehisa Takakuwa,
I-Ta Hsieh
Abstract:
We report ALMA observations of NGC 1333 IRAS 4A, a young low-mass protostellar binary, referred as 4A1 and 4A2. With multiple H$_2$CO transitions and HNC (4$-$3) observed at a resolution of 0.25" ($\sim$70 au), we investigate the gas kinematics of 4A1 and 4A2. Our results show that, on the large angular scale ($\sim$10"), 4A1 and 4A2 each display a well-collimated outflow along the N-S direction,…
▽ More
We report ALMA observations of NGC 1333 IRAS 4A, a young low-mass protostellar binary, referred as 4A1 and 4A2. With multiple H$_2$CO transitions and HNC (4$-$3) observed at a resolution of 0.25" ($\sim$70 au), we investigate the gas kinematics of 4A1 and 4A2. Our results show that, on the large angular scale ($\sim$10"), 4A1 and 4A2 each display a well-collimated outflow along the N-S direction, and an S-shaped morphology is discerned in the outflow powered by 4A2. On the small scale ($\sim$0.3"), 4A1 and 4A2 exhibit distinct spectral features toward the continuum centroid, with 4A1 showing simple symmetric profiles predominantly in absorption and 4A2 demonstrating rather complicated profiles in emission as well as in absorption. Based on radiative transfer modeling exercises, we find that the physical parameters inferred from earlier low-resolution observations cannot be directly extrapolated down to the 4A1 inner region. Possible reasons for the discrepancies between the observed and modelled profiles are discussed. We constrain the mass infall rate in 4A1 to be at most around 3$\times$10$^{-5}$ M$_{\odot}$ year$^{-1}$ at the layer of 75 au. For the kinematics of the 4A2 inner envelope, the absorbing dips in the H$_2$CO spectra are skewed toward the redshifted side and likely signatures of inward motion. These absorbing dips are relatively narrow. This is, like the case for 4A1, significantly slower than the anticipated inflow speed. We estimate a mass infall rate of 3.1$-$6.2 $\times$ 10$^{-5}$ M$_\odot$ year$^{-1}$ at the layer of 100 au in 4A2.
△ Less
Submitted 26 September, 2019;
originally announced September 2019.
-
JCMT POL-2 and ALMA polarimetric observations of 6000-100 au scales in the protostar B335: linking magnetic field and gas kinematics in observations and MHD simulations
Authors:
Hsi-Wei Yen,
Bo Zhao,
I-Ta Hsieh,
Patrick Koch,
Ruben Krasnopolsky,
Chin-Fei Lee,
Zhi-Yun Li,
Sheng-Yuan Liu,
Nagayoshi Ohashi,
Shigehisa Takakuwa,
Ya-Wen Tang
Abstract:
We present our analysis of the magnetic field structures from 6000 au to 100 au scales in the Class 0 protostar B335 inferred from our JCMT POL-2 observations and the ALMA archival polarimetric data. To interpret the observational results, we perform a series of (non-)ideal MHD simulations of the collapse of a rotating non-turbulent dense core, whose initial conditions are adopted to be the same a…
▽ More
We present our analysis of the magnetic field structures from 6000 au to 100 au scales in the Class 0 protostar B335 inferred from our JCMT POL-2 observations and the ALMA archival polarimetric data. To interpret the observational results, we perform a series of (non-)ideal MHD simulations of the collapse of a rotating non-turbulent dense core, whose initial conditions are adopted to be the same as observed in B335, and generate synthetic polarization maps. The comparison of our JCMT and simulation results suggests that the magnetic field on a 6000 au scale in B335 is pinched and well aligned with the bipolar outflow along the east-west direction. Among all our simulations, the ALMA polarimetric results are best explained with weak magnetic field models having an initial mass-to-flux ratio of 9.6. However, we find that with the weak magnetic field, the rotational velocity on a 100 au scale and the disk size in our simulations are larger than the observational estimates by a factor of several. An independent comparison of our simulations and the gas kinematics in B335 observed with the SMA and ALMA favors strong magnetic field models with an initial mass-to-flux ratio smaller than 4.8. We discuss two possibilities resulting in the different magnetic field strengths inferred from the polarimetric and molecular-line observations, (1) overestimated rotational-to-gravitational energy in B335 and (2) additional contributions in the polarized intensity due to scattering on a 100 au scale.
△ Less
Submitted 1 January, 2019;
originally announced January 2019.
-
Tracing magnetic field morphology using the Velocity Gradient Technique in the presence of CO self-absorption
Authors:
Cheng-Han Hsieh,
Yue Hu,
Shih-Ping Lai,
Ka Ho Yuen,
Sheng-Yuan Liu,
I-Ta Hsieh,
Ka Wai Ho,
Alex Lazarian
Abstract:
Probing magnetic fields in self-gravitating molecular clouds are generally difficult even with the use of the polarimetry. Based on the properties of magneto-hydrodynamic (MHD) turbulence and turbulent reconnection, Velocity Gradient Technique (VGT) provides a new way in tracing magnetic field orientation and strength based on the spectroscopic data. Our study tests the applicability of VGT in var…
▽ More
Probing magnetic fields in self-gravitating molecular clouds are generally difficult even with the use of the polarimetry. Based on the properties of magneto-hydrodynamic (MHD) turbulence and turbulent reconnection, Velocity Gradient Technique (VGT) provides a new way in tracing magnetic field orientation and strength based on the spectroscopic data. Our study tests the applicability of VGT in various molecular tracers, e.g. 12CO, 13CO, and C18O. By inspecting synthetic molecular line maps of CO isotopologue generated through radiative transfer calculations, we show that the VGT method can be successfully applied in probing the magnetic field direction in the diffuse interstellar medium as well as in self-gravitating molecular clouds.
△ Less
Submitted 30 January, 2019; v1 submitted 26 September, 2018;
originally announced September 2018.
-
A vehicle with a two-wheel steering system mobile in shallow dense granular media
Authors:
Po-Yi Lee,
Meng-Chi Tsai,
I-Ta Hsieh,
Pin-Ju Tseng,
Guo-Jie Jason Gao
Abstract:
We design a vehicle with a steering system made of two independently rotatable wheels on the front. We quantify the effectiveness of the steering system in the mobility and maneuverability of the vehicle running in a box containing a layer ping-pong balls with a packing density 0.8, below the random close packing value 0.84 in 2D. The steering system can reduce the resistance exerted by the jammed…
▽ More
We design a vehicle with a steering system made of two independently rotatable wheels on the front. We quantify the effectiveness of the steering system in the mobility and maneuverability of the vehicle running in a box containing a layer ping-pong balls with a packing density 0.8, below the random close packing value 0.84 in 2D. The steering system can reduce the resistance exerted by the jammed balls formed ahead of the fast-moving vehicle. Moreover, if only one of the two steering wheels rotates, the vehicle can turn into the direction opposite to the rotating wheel. The steering system performs more efficiently if the wheels engage the ping-pong balls better by increasing the contact area between the wheels and the balls. We advocate applying our design to machines moving in granular materials with a moderate packing density.
△ Less
Submitted 27 July, 2017;
originally announced July 2017.
-
The large-scale nebular pattern of a superwind binary in an eccentric orbit
Authors:
Hyosun Kim,
Alfonso Trejo,
Sheng-Yuan Liu,
Raghvendra Sahai,
Ronald E. Taam,
Mark R. Morris,
Naomi Hirano,
I-Ta Hsieh
Abstract:
Preplanetary nebulae and planetary nebulae are evolved, mass-losing stellar objects that show a wide variety of morphologies. Many of these nebulae consist of outer structures that are nearly spherical (spiral/shell/arc/halo) and inner structures that are highly asymmetric (bipolar/multipolar). The coexistence of such geometrically distinct structures is enigmatic because it hints at the simultane…
▽ More
Preplanetary nebulae and planetary nebulae are evolved, mass-losing stellar objects that show a wide variety of morphologies. Many of these nebulae consist of outer structures that are nearly spherical (spiral/shell/arc/halo) and inner structures that are highly asymmetric (bipolar/multipolar). The coexistence of such geometrically distinct structures is enigmatic because it hints at the simultaneous presence of both wide and close binary interactions, a phenomenon that has been attributed to stellar binary systems with eccentric orbits. Here we report new high-resolution molecular-line observations of the circumstellar spiral-shell pattern of AFGL 3068, an asymptotic giant branch star transitioning to the preplanetary nebula phase. The observations clearly reveal that the dynamics of the mass loss is influenced by the presence of an eccentric-orbit binary. This quintessential object opens a new window on the nature of deeply embedded binary stars through the circumstellar spiral-shell patterns that reside at distances of several thousand Astronomical Units from the stars.
△ Less
Submitted 3 April, 2017;
originally announced April 2017.
-
Evidence of a Binary-Induced Spiral from an Incomplete Ring Pattern of CIT 6
Authors:
Hyosun Kim,
I-Ta Hsieh,
Sheng-Yuan Liu,
Ronald E. Taam
Abstract:
With the advent of high-resolution high-sensitivity observations, spiral patterns have been revealed around several asymptotic giant branch (AGB) stars. Such patterns can provide possible evidence for the existence of central binary stars embedded in outflowing circumstellar envelopes. Here, we suggest the viability of explaining the previously observed incomplete ring-like patterns with the spira…
▽ More
With the advent of high-resolution high-sensitivity observations, spiral patterns have been revealed around several asymptotic giant branch (AGB) stars. Such patterns can provide possible evidence for the existence of central binary stars embedded in outflowing circumstellar envelopes. Here, we suggest the viability of explaining the previously observed incomplete ring-like patterns with the spiral-shell structure due to the motion of (unknown) binary components viewed at an inclination with respect to the orbital plane. We describe a method of extracting such spiral-shells from an incomplete ring-like pattern to place constraints on the characteristics of the central binary stars. The use of gas kinematics is essential in facilitating a detailed modeling for the three-dimensional structure of the circumstellar pattern. We show that a hydrodynamic radiative transfer model can reproduce the structure of the HC3N molecular line emission of the extreme carbon star, CIT 6. This method can be applied to other sources in the AGB phase and to the outer ring-like patterns of pre-planetary nebulae for probing the existence of embedded binary stars, which are highly anticipated with future observations using the Atacama Large Millimeter/submillimeter Array.
△ Less
Submitted 19 August, 2013;
originally announced August 2013.
