-
Gait Patterns as Biomarkers: A Video-Based Approach for Classifying Scoliosis
Authors:
Zirui Zhou,
Junhao Liang,
Zizhao Peng,
Chao Fan,
Fengwei An,
Shiqi Yu
Abstract:
Scoliosis presents significant diagnostic challenges, particularly in adolescents, where early detection is crucial for effective treatment. Traditional diagnostic and follow-up methods, which rely on physical examinations and radiography, face limitations due to the need for clinical expertise and the risk of radiation exposure, thus restricting their use for widespread early screening. In respon…
▽ More
Scoliosis presents significant diagnostic challenges, particularly in adolescents, where early detection is crucial for effective treatment. Traditional diagnostic and follow-up methods, which rely on physical examinations and radiography, face limitations due to the need for clinical expertise and the risk of radiation exposure, thus restricting their use for widespread early screening. In response, we introduce a novel video-based, non-invasive method for scoliosis classification using gait analysis, effectively circumventing these limitations. This study presents Scoliosis1K, the first large-scale dataset specifically designed for video-based scoliosis classification, encompassing over one thousand adolescents. Leveraging this dataset, we developed ScoNet, an initial model that faced challenges in handling the complexities of real-world data. This led to the development of ScoNet-MT, an enhanced model incorporating multi-task learning, which demonstrates promising diagnostic accuracy for practical applications. Our findings demonstrate that gait can serve as a non-invasive biomarker for scoliosis, revolutionizing screening practices through deep learning and setting a precedent for non-invasive diagnostic methodologies. The dataset and code are publicly available at https://zhouzi180.github.io/Scoliosis1K/.
△ Less
Submitted 23 August, 2024; v1 submitted 8 July, 2024;
originally announced July 2024.
-
Genetic Quantization-Aware Approximation for Non-Linear Operations in Transformers
Authors:
Pingcheng Dong,
Yonghao Tan,
Dong Zhang,
Tianwei Ni,
Xuejiao Liu,
Yu Liu,
Peng Luo,
Luhong Liang,
Shih-Yang Liu,
Xijie Huang,
Huaiyu Zhu,
Yun Pan,
Fengwei An,
Kwang-Ting Cheng
Abstract:
Non-linear functions are prevalent in Transformers and their lightweight variants, incurring substantial and frequently underestimated hardware costs. Previous state-of-the-art works optimize these operations by piece-wise linear approximation and store the parameters in look-up tables (LUT), but most of them require unfriendly high-precision arithmetics such as FP/INT 32 and lack consideration of…
▽ More
Non-linear functions are prevalent in Transformers and their lightweight variants, incurring substantial and frequently underestimated hardware costs. Previous state-of-the-art works optimize these operations by piece-wise linear approximation and store the parameters in look-up tables (LUT), but most of them require unfriendly high-precision arithmetics such as FP/INT 32 and lack consideration of integer-only INT quantization. This paper proposed a genetic LUT-Approximation algorithm namely GQA-LUT that can automatically determine the parameters with quantization awareness. The results demonstrate that GQA-LUT achieves negligible degradation on the challenging semantic segmentation task for both vanilla and linear Transformer models. Besides, proposed GQA-LUT enables the employment of INT8-based LUT-Approximation that achieves an area savings of 81.3~81.7% and a power reduction of 79.3~80.2% compared to the high-precision FP/INT 32 alternatives. Code is available at https:// github.com/PingchengDong/GQA-LUT.
△ Less
Submitted 29 March, 2024; v1 submitted 28 March, 2024;
originally announced March 2024.
-
BESA: Pruning Large Language Models with Blockwise Parameter-Efficient Sparsity Allocation
Authors:
Peng Xu,
Wenqi Shao,
Mengzhao Chen,
Shitao Tang,
Kaipeng Zhang,
Peng Gao,
Fengwei An,
Yu Qiao,
Ping Luo
Abstract:
Large language models (LLMs) have demonstrated outstanding performance in various tasks, such as text summarization, text question-answering, and etc. While their performance is impressive, the computational footprint due to their vast number of parameters can be prohibitive. Existing solutions such as SparseGPT and Wanda attempt to alleviate this issue through weight pruning. However, their layer…
▽ More
Large language models (LLMs) have demonstrated outstanding performance in various tasks, such as text summarization, text question-answering, and etc. While their performance is impressive, the computational footprint due to their vast number of parameters can be prohibitive. Existing solutions such as SparseGPT and Wanda attempt to alleviate this issue through weight pruning. However, their layer-wise approach results in significant perturbation to the model's output and requires meticulous hyperparameter tuning, such as the pruning rate, which can adversely affect overall model performance. To address this, this paper introduces a novel LLM pruning technique dubbed blockwise parameter-efficient sparsity allocation (BESA) by applying a blockwise reconstruction loss. In contrast to the typical layer-wise pruning techniques, BESA is characterized by two distinctive attributes: i) it targets the overall pruning error with respect to individual transformer blocks, and ii) it allocates layer-specific sparsity in a differentiable manner, both of which ensure reduced performance degradation after pruning. Our experiments show that BESA achieves state-of-the-art performance, efficiently pruning LLMs like LLaMA1, and LLaMA2 with 7B to 70B parameters on a single A100 GPU in just five hours. Code is available at https://github.com/OpenGVLab/LLMPrune-BESA.
△ Less
Submitted 19 April, 2024; v1 submitted 18 February, 2024;
originally announced February 2024.
-
Optical Bar Code for Internet Access Application based on Optical camera communication and Bluetooth Control
Authors:
Shangsheng Wen,
Manxi Liu,
Yanyi Chen,
Yirong Chen,
Futong An,
Yingcong Chen,
Weipeng Guan
Abstract:
We demonstrate an internet access application based on optical camera communication and bluetooth. The app will access the website while the camera in the phone receives the optical signal. \c{opyright} 2022 The Author(s)
We demonstrate an internet access application based on optical camera communication and bluetooth. The app will access the website while the camera in the phone receives the optical signal. \c{opyright} 2022 The Author(s)
△ Less
Submitted 31 October, 2022;
originally announced December 2022.
-
A Cooperative Positioning Flamework for Robot and Smart Phone Based on Visible Light Communication
Authors:
Junye Chen,
Fangdi Li,
Futong An,
Chen Yang,
Hongzhan Song,
Shangsheng Wen,
Weipeng Guan
Abstract:
A cooperative positioning flamework of human and robots based on visible light communication (VLC) is proposed. Based on the experiment system, we demonstrated it is feasible and has high-accuracy and real-time performance.
A cooperative positioning flamework of human and robots based on visible light communication (VLC) is proposed. Based on the experiment system, we demonstrated it is feasible and has high-accuracy and real-time performance.
△ Less
Submitted 20 October, 2022; v1 submitted 11 August, 2022;
originally announced August 2022.
-
An Improved Event-Independent Network for Polyphonic Sound Event Localization and Detection
Authors:
Yin Cao,
Turab Iqbal,
Qiuqiang Kong,
Fengyan An,
Wenwu Wang,
Mark D. Plumbley
Abstract:
Polyphonic sound event localization and detection (SELD), which jointly performs sound event detection (SED) and direction-of-arrival (DoA) estimation, detects the type and occurrence time of sound events as well as their corresponding DoA angles simultaneously. We study the SELD task from a multi-task learning perspective. Two open problems are addressed in this paper. Firstly, to detect overlapp…
▽ More
Polyphonic sound event localization and detection (SELD), which jointly performs sound event detection (SED) and direction-of-arrival (DoA) estimation, detects the type and occurrence time of sound events as well as their corresponding DoA angles simultaneously. We study the SELD task from a multi-task learning perspective. Two open problems are addressed in this paper. Firstly, to detect overlapping sound events of the same type but with different DoAs, we propose to use a trackwise output format and solve the accompanying track permutation problem with permutation-invariant training. Multi-head self-attention is further used to separate tracks. Secondly, a previous finding is that, by using hard parameter-sharing, SELD suffers from a performance loss compared with learning the subtasks separately. This is solved by a soft parameter-sharing scheme. We term the proposed method as Event Independent Network V2 (EINV2), which is an improved version of our previously-proposed method and an end-to-end network for SELD. We show that our proposed EINV2 for joint SED and DoA estimation outperforms previous methods by a large margin, and has comparable performance to state-of-the-art ensemble models.
△ Less
Submitted 10 February, 2021; v1 submitted 25 October, 2020;
originally announced October 2020.
-
Polyphonic Sound Event Detection and Localization using a Two-Stage Strategy
Authors:
Yin Cao,
Qiuqiang Kong,
Turab Iqbal,
Fengyan An,
Wenwu Wang,
Mark D. Plumbley
Abstract:
Sound event detection (SED) and localization refer to recognizing sound events and estimating their spatial and temporal locations. Using neural networks has become the prevailing method for SED. In the area of sound localization, which is usually performed by estimating the direction of arrival (DOA), learning-based methods have recently been developed. In this paper, it is experimentally shown t…
▽ More
Sound event detection (SED) and localization refer to recognizing sound events and estimating their spatial and temporal locations. Using neural networks has become the prevailing method for SED. In the area of sound localization, which is usually performed by estimating the direction of arrival (DOA), learning-based methods have recently been developed. In this paper, it is experimentally shown that the trained SED model is able to contribute to the direction of arrival estimation (DOAE). However, joint training of SED and DOAE degrades the performance of both. Based on these results, a two-stage polyphonic sound event detection and localization method is proposed. The method learns SED first, after which the learned feature layers are transferred for DOAE. It then uses the SED ground truth as a mask to train DOAE. The proposed method is evaluated on the DCASE 2019 Task 3 dataset, which contains different overlapping sound events in different environments. Experimental results show that the proposed method is able to improve the performance of both SED and DOAE, and also performs significantly better than the baseline method.
△ Less
Submitted 5 November, 2019; v1 submitted 1 May, 2019;
originally announced May 2019.
-
Mobile-service based Max-Min Fairness Resource Scheduling for Heterogeneous Vehicular Networks
Authors:
Yu Zhang,
Ke Xiong,
Fengping An,
Xiaofei DI,
Jingtao SU
Abstract:
This paper investigates the resource scheduling for heterogeneous vehicular networks, where some moving vehicles are selected and scheduled as helping relays to assist information transmission between the roadside infrastructure and other moving vehicles. For such a system, we propose a mobile-service based max-min fairness resource scheduling scheme, where service amount which is more suitable fo…
▽ More
This paper investigates the resource scheduling for heterogeneous vehicular networks, where some moving vehicles are selected and scheduled as helping relays to assist information transmission between the roadside infrastructure and other moving vehicles. For such a system, we propose a mobile-service based max-min fairness resource scheduling scheme, where service amount which is more suitable for high mobility scenarios is adopted to characterize the information transmission capacity of the links and the max-min criteria is adopted to meet the fairness requirement of the moving vehicles. Simulation results demonstrate the effectiveness of our proposed scheme. It is shown that our proposed scheme archives higher throughput and better fairness compared with random scheduling scheme and non relaying scheme.
△ Less
Submitted 11 March, 2016;
originally announced March 2016.
-
A New Dynamic Bandwidth Allocation Protocol with Quality of Service in Ethernet-based Passive Optical Networks
Authors:
Fu-Tai An,
Yu-Li Hsueh,
Kyeong Soo Kim,
Ian M. White,
Leonid G. Kazovsky
Abstract:
Ethernet-based Passive optical network (E-PON) is the key for next generation access networks. It must have the property of high efficiency, low cost, and support quality of service (QoS). We present a novel media access control (MAC) protocol that maximizes network efficiency by using dynamic bandwidth allocation (DBA) algorithm suitable for E-PON. This protocol minimizes packet delay and delay v…
▽ More
Ethernet-based Passive optical network (E-PON) is the key for next generation access networks. It must have the property of high efficiency, low cost, and support quality of service (QoS). We present a novel media access control (MAC) protocol that maximizes network efficiency by using dynamic bandwidth allocation (DBA) algorithm suitable for E-PON. This protocol minimizes packet delay and delay variation for high priority traffic to ensure QoS. Simulation results show excellent network throughput. Simulation results also show low packet delay and packet delay variation for high priority traffic compare with traditional MAC protocol of E-PON. When the network performs ranging, this protocol ensures zero interruption of high priority traffic, such as audio or video applications.
△ Less
Submitted 9 April, 2014;
originally announced April 2014.
