-
Retrieval Instead of Fine-tuning: A Retrieval-based Parameter Ensemble for Zero-shot Learning
Authors:
Pengfei Jin,
Peng Shu,
Sekeun Kim,
Qing Xiao,
Sifan Song,
Cheng Chen,
Tianming Liu,
Xiang Li,
Quanzheng Li
Abstract:
Foundation models have become a cornerstone in deep learning, with techniques like Low-Rank Adaptation (LoRA) offering efficient fine-tuning of large models. Similarly, methods such as Retrieval-Augmented Generation (RAG), which leverage vectorized databases, have further improved model performance by grounding outputs in external information. While these approaches have demonstrated notable succe…
▽ More
Foundation models have become a cornerstone in deep learning, with techniques like Low-Rank Adaptation (LoRA) offering efficient fine-tuning of large models. Similarly, methods such as Retrieval-Augmented Generation (RAG), which leverage vectorized databases, have further improved model performance by grounding outputs in external information. While these approaches have demonstrated notable success, they often require extensive training or labeled data, which can limit their adaptability in resource-constrained environments. To address these challenges, we introduce Retrieval-based Parameter Ensemble (RPE), a new method that creates a vectorized database of LoRAs, enabling efficient retrieval and application of model adaptations to new tasks. RPE minimizes the need for extensive training and eliminates the requirement for labeled data, making it particularly effective for zero-shot learning. Additionally, RPE is well-suited for privacy-sensitive domains like healthcare, as it modifies model parameters without accessing raw data. When applied to tasks such as medical report generation and image segmentation, RPE not only proved effective but also surpassed supervised fine-tuning methods in certain cases, highlighting its potential to enhance both computational efficiency and privacy in deep learning applications.
△ Less
Submitted 13 October, 2024;
originally announced October 2024.
-
EG-SpikeFormer: Eye-Gaze Guided Transformer on Spiking Neural Networks for Medical Image Analysis
Authors:
Yi Pan,
Hanqi Jiang,
Junhao Chen,
Yiwei Li,
Huaqin Zhao,
Yifan Zhou,
Peng Shu,
Zihao Wu,
Zhengliang Liu,
Dajiang Zhu,
Xiang Li,
Yohannes Abate,
Tianming Liu
Abstract:
Neuromorphic computing has emerged as a promising energy-efficient alternative to traditional artificial intelligence, predominantly utilizing spiking neural networks (SNNs) implemented on neuromorphic hardware. Significant advancements have been made in SNN-based convolutional neural networks (CNNs) and Transformer architectures. However, their applications in the medical imaging domain remain un…
▽ More
Neuromorphic computing has emerged as a promising energy-efficient alternative to traditional artificial intelligence, predominantly utilizing spiking neural networks (SNNs) implemented on neuromorphic hardware. Significant advancements have been made in SNN-based convolutional neural networks (CNNs) and Transformer architectures. However, their applications in the medical imaging domain remain underexplored. In this study, we introduce EG-SpikeFormer, an SNN architecture designed for clinical tasks that integrates eye-gaze data to guide the model's focus on diagnostically relevant regions in medical images. This approach effectively addresses shortcut learning issues commonly observed in conventional models, especially in scenarios with limited clinical data and high demands for model reliability, generalizability, and transparency. Our EG-SpikeFormer not only demonstrates superior energy efficiency and performance in medical image classification tasks but also enhances clinical relevance. By incorporating eye-gaze data, the model improves interpretability and generalization, opening new directions for the application of neuromorphic computing in healthcare.
△ Less
Submitted 12 October, 2024;
originally announced October 2024.
-
Mixture of Multicenter Experts in Multimodal Generative AI for Advanced Radiotherapy Target Delineation
Authors:
Yujin Oh,
Sangjoon Park,
Xiang Li,
Wang Yi,
Jonathan Paly,
Jason Efstathiou,
Annie Chan,
Jun Won Kim,
Hwa Kyung Byun,
Ik Jae Lee,
Jaeho Cho,
Chan Woo Wee,
Peng Shu,
Peilong Wang,
Nathan Yu,
Jason Holmes,
Jong Chul Ye,
Quanzheng Li,
Wei Liu,
Woong Sub Koom,
Jin Sung Kim,
Kyungsang Kim
Abstract:
Clinical experts employ diverse philosophies and strategies in patient care, influenced by regional patient populations. However, existing medical artificial intelligence (AI) models are often trained on data distributions that disproportionately reflect highly prevalent patterns, reinforcing biases and overlooking the diverse expertise of clinicians. To overcome this limitation, we introduce the…
▽ More
Clinical experts employ diverse philosophies and strategies in patient care, influenced by regional patient populations. However, existing medical artificial intelligence (AI) models are often trained on data distributions that disproportionately reflect highly prevalent patterns, reinforcing biases and overlooking the diverse expertise of clinicians. To overcome this limitation, we introduce the Mixture of Multicenter Experts (MoME) approach. This method strategically integrates specialized expertise from diverse clinical strategies, enhancing the AI model's ability to generalize and adapt across multiple medical centers. The MoME-based multimodal target volume delineation model, trained with few-shot samples including images and clinical notes from each medical center, outperformed baseline methods in prostate cancer radiotherapy target delineation. The advantages of MoME were most pronounced when data characteristics varied across centers or when data availability was limited, demonstrating its potential for broader clinical applications.Therefore, the MoME framework enables the deployment of AI-based target volume delineation models in resource-constrained medical facilities by adapting to specific preferences of each medical center only using a few sample data, without the need for data sharing between institutions. Expanding the number of multicenter experts within the MoME framework will significantly enhance the generalizability, while also improving the usability and adaptability of clinical AI applications in the field of precision radiation oncology.
△ Less
Submitted 27 September, 2024;
originally announced October 2024.
-
Evaluation of OpenAI o1: Opportunities and Challenges of AGI
Authors:
Tianyang Zhong,
Zhengliang Liu,
Yi Pan,
Yutong Zhang,
Yifan Zhou,
Shizhe Liang,
Zihao Wu,
Yanjun Lyu,
Peng Shu,
Xiaowei Yu,
Chao Cao,
Hanqi Jiang,
Hanxu Chen,
Yiwei Li,
Junhao Chen,
Huawen Hu,
Yihen Liu,
Huaqin Zhao,
Shaochen Xu,
Haixing Dai,
Lin Zhao,
Ruidong Zhang,
Wei Zhao,
Zhenyuan Yang,
Jingyuan Chen
, et al. (53 additional authors not shown)
Abstract:
This comprehensive study evaluates the performance of OpenAI's o1-preview large language model across a diverse array of complex reasoning tasks, spanning multiple domains, including computer science, mathematics, natural sciences, medicine, linguistics, and social sciences. Through rigorous testing, o1-preview demonstrated remarkable capabilities, often achieving human-level or superior performan…
▽ More
This comprehensive study evaluates the performance of OpenAI's o1-preview large language model across a diverse array of complex reasoning tasks, spanning multiple domains, including computer science, mathematics, natural sciences, medicine, linguistics, and social sciences. Through rigorous testing, o1-preview demonstrated remarkable capabilities, often achieving human-level or superior performance in areas ranging from coding challenges to scientific reasoning and from language processing to creative problem-solving. Key findings include:
-83.3% success rate in solving complex competitive programming problems, surpassing many human experts.
-Superior ability in generating coherent and accurate radiology reports, outperforming other evaluated models.
-100% accuracy in high school-level mathematical reasoning tasks, providing detailed step-by-step solutions.
-Advanced natural language inference capabilities across general and specialized domains like medicine.
-Impressive performance in chip design tasks, outperforming specialized models in areas such as EDA script generation and bug analysis.
-Remarkable proficiency in anthropology and geology, demonstrating deep understanding and reasoning in these specialized fields.
-Strong capabilities in quantitative investing. O1 has comprehensive financial knowledge and statistical modeling skills.
-Effective performance in social media analysis, including sentiment analysis and emotion recognition.
The model excelled particularly in tasks requiring intricate reasoning and knowledge integration across various fields. While some limitations were observed, including occasional errors on simpler problems and challenges with certain highly specialized concepts, the overall results indicate significant progress towards artificial general intelligence.
△ Less
Submitted 27 September, 2024;
originally announced September 2024.
-
Examining the Commitments and Difficulties Inherent in Multimodal Foundation Models for Street View Imagery
Authors:
Zhenyuan Yang,
Xuhui Lin,
Qinyi He,
Ziye Huang,
Zhengliang Liu,
Hanqi Jiang,
Peng Shu,
Zihao Wu,
Yiwei Li,
Stephen Law,
Gengchen Mai,
Tianming Liu,
Tao Yang
Abstract:
The emergence of Large Language Models (LLMs) and multimodal foundation models (FMs) has generated heightened interest in their applications that integrate vision and language. This paper investigates the capabilities of ChatGPT-4V and Gemini Pro for Street View Imagery, Built Environment, and Interior by evaluating their performance across various tasks. The assessments include street furniture i…
▽ More
The emergence of Large Language Models (LLMs) and multimodal foundation models (FMs) has generated heightened interest in their applications that integrate vision and language. This paper investigates the capabilities of ChatGPT-4V and Gemini Pro for Street View Imagery, Built Environment, and Interior by evaluating their performance across various tasks. The assessments include street furniture identification, pedestrian and car counts, and road width measurement in Street View Imagery; building function classification, building age analysis, building height analysis, and building structure classification in the Built Environment; and interior room classification, interior design style analysis, interior furniture counts, and interior length measurement in Interior. The results reveal proficiency in length measurement, style analysis, question answering, and basic image understanding, but highlight limitations in detailed recognition and counting tasks. While zero-shot learning shows potential, performance varies depending on the problem domains and image complexities. This study provides new insights into the strengths and weaknesses of multimodal foundation models for practical challenges in Street View Imagery, Built Environment, and Interior. Overall, the findings demonstrate foundational multimodal intelligence, emphasizing the potential of FMs to drive forward interdisciplinary applications at the intersection of computer vision and language.
△ Less
Submitted 22 August, 2024;
originally announced August 2024.
-
MGH Radiology Llama: A Llama 3 70B Model for Radiology
Authors:
Yucheng Shi,
Peng Shu,
Zhengliang Liu,
Zihao Wu,
Quanzheng Li,
Xiang Li
Abstract:
In recent years, the field of radiology has increasingly harnessed the power of artificial intelligence (AI) to enhance diagnostic accuracy, streamline workflows, and improve patient care. Large language models (LLMs) have emerged as particularly promising tools, offering significant potential in assisting radiologists with report generation, clinical decision support, and patient communication. T…
▽ More
In recent years, the field of radiology has increasingly harnessed the power of artificial intelligence (AI) to enhance diagnostic accuracy, streamline workflows, and improve patient care. Large language models (LLMs) have emerged as particularly promising tools, offering significant potential in assisting radiologists with report generation, clinical decision support, and patient communication. This paper presents an advanced radiology-focused large language model: MGH Radiology Llama. It is developed using the Llama 3 70B model, building upon previous domain-specific models like Radiology-GPT and Radiology-Llama2. Leveraging a unique and comprehensive dataset from Massachusetts General Hospital, comprising over 6.5 million de-identified medical reports across various imaging modalities, the model demonstrates significant improvements in generating accurate and clinically relevant radiology impressions given the corresponding findings. Our evaluation, incorporating both traditional metrics and a GPT-4-based assessment, highlights the enhanced performance of this work over general-purpose LLMs.
△ Less
Submitted 12 August, 2024;
originally announced August 2024.
-
Machine Learning-Based Identification of Contaminated Images in Light Curves Data Preprocessing
Authors:
Hui Li,
Rong-Wang Li,
Peng Shu,
Yu-Qiang Li
Abstract:
Attitude is one of the crucial parameters for space objects and plays a vital role in collision prediction and debris removal. Analyzing light curves to determine attitude is the most commonly used method. In photometric observations, outliers may exist in the obtained light curves due to various reasons. Therefore, preprocessing is required to remove these outliers to obtain high quality light cu…
▽ More
Attitude is one of the crucial parameters for space objects and plays a vital role in collision prediction and debris removal. Analyzing light curves to determine attitude is the most commonly used method. In photometric observations, outliers may exist in the obtained light curves due to various reasons. Therefore, preprocessing is required to remove these outliers to obtain high quality light curves. Through statistical analysis, the reasons leading to outliers can be categorized into two main types: first, the brightness of the object significantly increases due to the passage of a star nearby, referred to as "stellar contamination," and second, the brightness markedly decreases due to cloudy cover, referred to as "cloudy contamination." Traditional approach of manually inspecting images for contamination is time-consuming and labor-intensive. However, We propose the utilization of machine learning methods as a substitute. Convolutional Neural Networks (CNN) and Support Vector Machines (SVM) are employed to identify cases of stellar contamination and cloudy contamination, achieving F1 scores of 1.00 and 0.98 on test set, respectively. We also explored other machine learning methods such as Residual Network-18 (ResNet-18) and Light Gradient Boosting Machine (lightGBM), then conducted comparative analyses of the results.
△ Less
Submitted 2 April, 2024;
originally announced April 2024.
-
ALDM-Grasping: Diffusion-aided Zero-Shot Sim-to-Real Transfer for Robot Grasping
Authors:
Yiwei Li,
Zihao Wu,
Huaqin Zhao,
Tianze Yang,
Zhengliang Liu,
Peng Shu,
Jin Sun,
Ramviyas Parasuraman,
Tianming Liu
Abstract:
To tackle the "reality gap" encountered in Sim-to-Real transfer, this study proposes a diffusion-based framework that minimizes inconsistencies in grasping actions between the simulation settings and realistic environments. The process begins by training an adversarial supervision layout-to-image diffusion model(ALDM). Then, leverage the ALDM approach to enhance the simulation environment, renderi…
▽ More
To tackle the "reality gap" encountered in Sim-to-Real transfer, this study proposes a diffusion-based framework that minimizes inconsistencies in grasping actions between the simulation settings and realistic environments. The process begins by training an adversarial supervision layout-to-image diffusion model(ALDM). Then, leverage the ALDM approach to enhance the simulation environment, rendering it with photorealistic fidelity, thereby optimizing robotic grasp task training. Experimental results indicate this framework outperforms existing models in both success rates and adaptability to new environments through improvements in the accuracy and reliability of visual grasping actions under a variety of conditions. Specifically, it achieves a 75\% success rate in grasping tasks under plain backgrounds and maintains a 65\% success rate in more complex scenarios. This performance demonstrates this framework excels at generating controlled image content based on text descriptions, identifying object grasp points, and demonstrating zero-shot learning in complex, unseen scenarios.
△ Less
Submitted 18 March, 2024;
originally announced March 2024.
-
Reasoning before Comparison: LLM-Enhanced Semantic Similarity Metrics for Domain Specialized Text Analysis
Authors:
Shaochen Xu,
Zihao Wu,
Huaqin Zhao,
Peng Shu,
Zhengliang Liu,
Wenxiong Liao,
Sheng Li,
Andrea Sikora,
Tianming Liu,
Xiang Li
Abstract:
In this study, we leverage LLM to enhance the semantic analysis and develop similarity metrics for texts, addressing the limitations of traditional unsupervised NLP metrics like ROUGE and BLEU. We develop a framework where LLMs such as GPT-4 are employed for zero-shot text identification and label generation for radiology reports, where the labels are then used as measurements for text similarity.…
▽ More
In this study, we leverage LLM to enhance the semantic analysis and develop similarity metrics for texts, addressing the limitations of traditional unsupervised NLP metrics like ROUGE and BLEU. We develop a framework where LLMs such as GPT-4 are employed for zero-shot text identification and label generation for radiology reports, where the labels are then used as measurements for text similarity. By testing the proposed framework on the MIMIC data, we find that GPT-4 generated labels can significantly improve the semantic similarity assessment, with scores more closely aligned with clinical ground truth than traditional NLP metrics. Our work demonstrates the possibility of conducting semantic analysis of the text data using semi-quantitative reasoning results by the LLMs for highly specialized domains. While the framework is implemented for radiology report similarity analysis, its concept can be extended to other specialized domains as well.
△ Less
Submitted 20 February, 2024; v1 submitted 17 February, 2024;
originally announced February 2024.
-
LLMs for Coding and Robotics Education
Authors:
Peng Shu,
Huaqin Zhao,
Hanqi Jiang,
Yiwei Li,
Shaochen Xu,
Yi Pan,
Zihao Wu,
Zhengliang Liu,
Guoyu Lu,
Le Guan,
Gong Chen,
Xianqiao Wang Tianming Liu
Abstract:
Large language models and multimodal large language models have revolutionized artificial intelligence recently. An increasing number of regions are now embracing these advanced technologies. Within this context, robot coding education is garnering increasing attention. To teach young children how to code and compete in robot challenges, large language models are being utilized for robot code expl…
▽ More
Large language models and multimodal large language models have revolutionized artificial intelligence recently. An increasing number of regions are now embracing these advanced technologies. Within this context, robot coding education is garnering increasing attention. To teach young children how to code and compete in robot challenges, large language models are being utilized for robot code explanation, generation, and modification. In this paper, we highlight an important trend in robot coding education. We test several mainstream large language models on both traditional coding tasks and the more challenging task of robot code generation, which includes block diagrams. Our results show that GPT-4V outperforms other models in all of our tests but struggles with generating block diagram images.
△ Less
Submitted 8 February, 2024;
originally announced February 2024.
-
Assessing Large Language Models in Mechanical Engineering Education: A Study on Mechanics-Focused Conceptual Understanding
Authors:
Jie Tian,
Jixin Hou,
Zihao Wu,
Peng Shu,
Zhengliang Liu,
Yujie Xiang,
Beikang Gu,
Nicholas Filla,
Yiwei Li,
Ning Liu,
Xianyan Chen,
Keke Tang,
Tianming Liu,
Xianqiao Wang
Abstract:
This study is a pioneering endeavor to investigate the capabilities of Large Language Models (LLMs) in addressing conceptual questions within the domain of mechanical engineering with a focus on mechanics. Our examination involves a manually crafted exam encompassing 126 multiple-choice questions, spanning various aspects of mechanics courses, including Fluid Mechanics, Mechanical Vibration, Engin…
▽ More
This study is a pioneering endeavor to investigate the capabilities of Large Language Models (LLMs) in addressing conceptual questions within the domain of mechanical engineering with a focus on mechanics. Our examination involves a manually crafted exam encompassing 126 multiple-choice questions, spanning various aspects of mechanics courses, including Fluid Mechanics, Mechanical Vibration, Engineering Statics and Dynamics, Mechanics of Materials, Theory of Elasticity, and Continuum Mechanics. Three LLMs, including ChatGPT (GPT-3.5), ChatGPT (GPT-4), and Claude (Claude-2.1), were subjected to evaluation against engineering faculties and students with or without mechanical engineering background. The findings reveal GPT-4's superior performance over the other two LLMs and human cohorts in answering questions across various mechanics topics, except for Continuum Mechanics. This signals the potential future improvements for GPT models in handling symbolic calculations and tensor analyses. The performances of LLMs were all significantly improved with explanations prompted prior to direct responses, underscoring the crucial role of prompt engineering. Interestingly, GPT-3.5 demonstrates improved performance with prompts covering a broader domain, while GPT-4 excels with prompts focusing on specific subjects. Finally, GPT-4 exhibits notable advancements in mitigating input bias, as evidenced by guessing preferences for humans. This study unveils the substantial potential of LLMs as highly knowledgeable assistants in both mechanical pedagogy and scientific research.
△ Less
Submitted 13 January, 2024;
originally announced January 2024.
-
Revolutionizing Finance with LLMs: An Overview of Applications and Insights
Authors:
Huaqin Zhao,
Zhengliang Liu,
Zihao Wu,
Yiwei Li,
Tianze Yang,
Peng Shu,
Shaochen Xu,
Haixing Dai,
Lin Zhao,
Gengchen Mai,
Ninghao Liu,
Tianming Liu
Abstract:
In recent years, Large Language Models (LLMs) like ChatGPT have seen considerable advancements and have been applied in diverse fields. Built on the Transformer architecture, these models are trained on extensive datasets, enabling them to understand and generate human language effectively. In the financial domain, the deployment of LLMs is gaining momentum. These models are being utilized for aut…
▽ More
In recent years, Large Language Models (LLMs) like ChatGPT have seen considerable advancements and have been applied in diverse fields. Built on the Transformer architecture, these models are trained on extensive datasets, enabling them to understand and generate human language effectively. In the financial domain, the deployment of LLMs is gaining momentum. These models are being utilized for automating financial report generation, forecasting market trends, analyzing investor sentiment, and offering personalized financial advice. Leveraging their natural language processing capabilities, LLMs can distill key insights from vast financial data, aiding institutions in making informed investment choices and enhancing both operational efficiency and customer satisfaction. In this study, we provide a comprehensive overview of the emerging integration of LLMs into various financial tasks. Additionally, we conducted holistic tests on multiple financial tasks through the combination of natural language instructions. Our findings show that GPT-4 effectively follow prompt instructions across various financial tasks. This survey and evaluation of LLMs in the financial domain aim to deepen the understanding of LLMs' current role in finance for both financial practitioners and LLM researchers, identify new research and application prospects, and highlight how these technologies can be leveraged to solve practical challenges in the finance industry.
△ Less
Submitted 21 January, 2024;
originally announced January 2024.
-
Large Language Models for Robotics: Opportunities, Challenges, and Perspectives
Authors:
Jiaqi Wang,
Zihao Wu,
Yiwei Li,
Hanqi Jiang,
Peng Shu,
Enze Shi,
Huawen Hu,
Chong Ma,
Yiheng Liu,
Xuhui Wang,
Yincheng Yao,
Xuan Liu,
Huaqin Zhao,
Zhengliang Liu,
Haixing Dai,
Lin Zhao,
Bao Ge,
Xiang Li,
Tianming Liu,
Shu Zhang
Abstract:
Large language models (LLMs) have undergone significant expansion and have been increasingly integrated across various domains. Notably, in the realm of robot task planning, LLMs harness their advanced reasoning and language comprehension capabilities to formulate precise and efficient action plans based on natural language instructions. However, for embodied tasks, where robots interact with comp…
▽ More
Large language models (LLMs) have undergone significant expansion and have been increasingly integrated across various domains. Notably, in the realm of robot task planning, LLMs harness their advanced reasoning and language comprehension capabilities to formulate precise and efficient action plans based on natural language instructions. However, for embodied tasks, where robots interact with complex environments, text-only LLMs often face challenges due to a lack of compatibility with robotic visual perception. This study provides a comprehensive overview of the emerging integration of LLMs and multimodal LLMs into various robotic tasks. Additionally, we propose a framework that utilizes multimodal GPT-4V to enhance embodied task planning through the combination of natural language instructions and robot visual perceptions. Our results, based on diverse datasets, indicate that GPT-4V effectively enhances robot performance in embodied tasks. This extensive survey and evaluation of LLMs and multimodal LLMs across a variety of robotic tasks enriches the understanding of LLM-centric embodied intelligence and provides forward-looking insights toward bridging the gap in Human-Robot-Environment interaction.
△ Less
Submitted 8 January, 2024;
originally announced January 2024.
-
Holistic Evaluation of GPT-4V for Biomedical Imaging
Authors:
Zhengliang Liu,
Hanqi Jiang,
Tianyang Zhong,
Zihao Wu,
Chong Ma,
Yiwei Li,
Xiaowei Yu,
Yutong Zhang,
Yi Pan,
Peng Shu,
Yanjun Lyu,
Lu Zhang,
Junjie Yao,
Peixin Dong,
Chao Cao,
Zhenxiang Xiao,
Jiaqi Wang,
Huan Zhao,
Shaochen Xu,
Yaonai Wei,
Jingyuan Chen,
Haixing Dai,
Peilong Wang,
Hao He,
Zewei Wang
, et al. (25 additional authors not shown)
Abstract:
In this paper, we present a large-scale evaluation probing GPT-4V's capabilities and limitations for biomedical image analysis. GPT-4V represents a breakthrough in artificial general intelligence (AGI) for computer vision, with applications in the biomedical domain. We assess GPT-4V's performance across 16 medical imaging categories, including radiology, oncology, ophthalmology, pathology, and mor…
▽ More
In this paper, we present a large-scale evaluation probing GPT-4V's capabilities and limitations for biomedical image analysis. GPT-4V represents a breakthrough in artificial general intelligence (AGI) for computer vision, with applications in the biomedical domain. We assess GPT-4V's performance across 16 medical imaging categories, including radiology, oncology, ophthalmology, pathology, and more. Tasks include modality recognition, anatomy localization, disease diagnosis, report generation, and lesion detection. The extensive experiments provide insights into GPT-4V's strengths and weaknesses. Results show GPT-4V's proficiency in modality and anatomy recognition but difficulty with disease diagnosis and localization. GPT-4V excels at diagnostic report generation, indicating strong image captioning skills. While promising for biomedical imaging AI, GPT-4V requires further enhancement and validation before clinical deployment. We emphasize responsible development and testing for trustworthy integration of biomedical AGI. This rigorous evaluation of GPT-4V on diverse medical images advances understanding of multimodal large language models (LLMs) and guides future work toward impactful healthcare applications.
△ Less
Submitted 10 November, 2023;
originally announced December 2023.
-
RadOnc-GPT: A Large Language Model for Radiation Oncology
Authors:
Zhengliang Liu,
Peilong Wang,
Yiwei Li,
Jason Holmes,
Peng Shu,
Lian Zhang,
Chenbin Liu,
Ninghao Liu,
Dajiang Zhu,
Xiang Li,
Quanzheng Li,
Samir H. Patel,
Terence T. Sio,
Tianming Liu,
Wei Liu
Abstract:
This paper presents RadOnc-GPT, a large language model specialized for radiation oncology through advanced tuning methods. RadOnc-GPT was finetuned on a large dataset of radiation oncology patient records from the Mayo Clinic in Arizona. The model employs instruction tuning on three key tasks - generating radiotherapy treatment regimens, determining optimal radiation modalities, and providing diag…
▽ More
This paper presents RadOnc-GPT, a large language model specialized for radiation oncology through advanced tuning methods. RadOnc-GPT was finetuned on a large dataset of radiation oncology patient records from the Mayo Clinic in Arizona. The model employs instruction tuning on three key tasks - generating radiotherapy treatment regimens, determining optimal radiation modalities, and providing diagnostic descriptions/ICD codes based on patient diagnostic details. Evaluations conducted by comparing RadOnc-GPT outputs to general large language model outputs showed higher ROUGE scores in these three tasks. The study demonstrated the potential of using large language models fine-tuned using domain-specific knowledge like RadOnc-GPT to achieve transformational capabilities in highly specialized healthcare fields such as radiation oncology. However, our model's clinical relevance requires confirmation, and it specializes in only the aforementioned three specific tasks and lacks broader applicability. Furthermore, its evaluation through ROUGE scores might not reflect the true semantic and clinical accuracy - challenges we intend to address in future research.
△ Less
Submitted 5 November, 2023; v1 submitted 18 September, 2023;
originally announced September 2023.
-
Radiology-Llama2: Best-in-Class Large Language Model for Radiology
Authors:
Zhengliang Liu,
Yiwei Li,
Peng Shu,
Aoxiao Zhong,
Longtao Yang,
Chao Ju,
Zihao Wu,
Chong Ma,
Jie Luo,
Cheng Chen,
Sekeun Kim,
Jiang Hu,
Haixing Dai,
Lin Zhao,
Dajiang Zhu,
Jun Liu,
Wei Liu,
Dinggang Shen,
Tianming Liu,
Quanzheng Li,
Xiang Li
Abstract:
This paper introduces Radiology-Llama2, a large language model specialized for radiology through a process known as instruction tuning. Radiology-Llama2 is based on the Llama2 architecture and further trained on a large dataset of radiology reports to generate coherent and clinically useful impressions from radiological findings. Quantitative evaluations using ROUGE metrics on the MIMIC-CXR and Op…
▽ More
This paper introduces Radiology-Llama2, a large language model specialized for radiology through a process known as instruction tuning. Radiology-Llama2 is based on the Llama2 architecture and further trained on a large dataset of radiology reports to generate coherent and clinically useful impressions from radiological findings. Quantitative evaluations using ROUGE metrics on the MIMIC-CXR and OpenI datasets demonstrate that Radiology-Llama2 achieves state-of-the-art performance compared to other generative language models, with a Rouge-1 score of 0.4834 on MIMIC-CXR and 0.4185 on OpenI. Additional assessments by radiology experts highlight the model's strengths in understandability, coherence, relevance, conciseness, and clinical utility. The work illustrates the potential of localized language models designed and tuned for specialized domains like radiology. When properly evaluated and deployed, such models can transform fields like radiology by automating rote tasks and enhancing human expertise.
△ Less
Submitted 29 August, 2023;
originally announced September 2023.
-
Artificial General Intelligence for Radiation Oncology
Authors:
Chenbin Liu,
Zhengliang Liu,
Jason Holmes,
Lu Zhang,
Lian Zhang,
Yuzhen Ding,
Peng Shu,
Zihao Wu,
Haixing Dai,
Yiwei Li,
Dinggang Shen,
Ninghao Liu,
Quanzheng Li,
Xiang Li,
Dajiang Zhu,
Tianming Liu,
Wei Liu
Abstract:
The emergence of artificial general intelligence (AGI) is transforming radiation oncology. As prominent vanguards of AGI, large language models (LLMs) such as GPT-4 and PaLM 2 can process extensive texts and large vision models (LVMs) such as the Segment Anything Model (SAM) can process extensive imaging data to enhance the efficiency and precision of radiation therapy. This paper explores full-sp…
▽ More
The emergence of artificial general intelligence (AGI) is transforming radiation oncology. As prominent vanguards of AGI, large language models (LLMs) such as GPT-4 and PaLM 2 can process extensive texts and large vision models (LVMs) such as the Segment Anything Model (SAM) can process extensive imaging data to enhance the efficiency and precision of radiation therapy. This paper explores full-spectrum applications of AGI across radiation oncology including initial consultation, simulation, treatment planning, treatment delivery, treatment verification, and patient follow-up. The fusion of vision data with LLMs also creates powerful multimodal models that elucidate nuanced clinical patterns. Together, AGI promises to catalyze a shift towards data-driven, personalized radiation therapy. However, these models should complement human expertise and care. This paper provides an overview of how AGI can transform radiation oncology to elevate the standard of patient care in radiation oncology, with the key insight being AGI's ability to exploit multimodal clinical data at scale.
△ Less
Submitted 5 September, 2023;
originally announced September 2023.
-
Evaluating Large Language Models for Radiology Natural Language Processing
Authors:
Zhengliang Liu,
Tianyang Zhong,
Yiwei Li,
Yutong Zhang,
Yi Pan,
Zihao Zhao,
Peixin Dong,
Chao Cao,
Yuxiao Liu,
Peng Shu,
Yaonai Wei,
Zihao Wu,
Chong Ma,
Jiaqi Wang,
Sheng Wang,
Mengyue Zhou,
Zuowei Jiang,
Chunlin Li,
Jason Holmes,
Shaochen Xu,
Lu Zhang,
Haixing Dai,
Kai Zhang,
Lin Zhao,
Yuanhao Chen
, et al. (20 additional authors not shown)
Abstract:
The rise of large language models (LLMs) has marked a pivotal shift in the field of natural language processing (NLP). LLMs have revolutionized a multitude of domains, and they have made a significant impact in the medical field. Large language models are now more abundant than ever, and many of these models exhibit bilingual capabilities, proficient in both English and Chinese. However, a compreh…
▽ More
The rise of large language models (LLMs) has marked a pivotal shift in the field of natural language processing (NLP). LLMs have revolutionized a multitude of domains, and they have made a significant impact in the medical field. Large language models are now more abundant than ever, and many of these models exhibit bilingual capabilities, proficient in both English and Chinese. However, a comprehensive evaluation of these models remains to be conducted. This lack of assessment is especially apparent within the context of radiology NLP. This study seeks to bridge this gap by critically evaluating thirty two LLMs in interpreting radiology reports, a crucial component of radiology NLP. Specifically, the ability to derive impressions from radiologic findings is assessed. The outcomes of this evaluation provide key insights into the performance, strengths, and weaknesses of these LLMs, informing their practical applications within the medical domain.
△ Less
Submitted 27 July, 2023; v1 submitted 25 July, 2023;
originally announced July 2023.
-
SAMAug: Point Prompt Augmentation for Segment Anything Model
Authors:
Haixing Dai,
Chong Ma,
Zhiling Yan,
Zhengliang Liu,
Enze Shi,
Yiwei Li,
Peng Shu,
Xiaozheng Wei,
Lin Zhao,
Zihao Wu,
Fang Zeng,
Dajiang Zhu,
Wei Liu,
Quanzheng Li,
Lichao Sun,
Shu Zhang Tianming Liu,
Xiang Li
Abstract:
This paper introduces SAMAug, a novel visual point augmentation method for the Segment Anything Model (SAM) that enhances interactive image segmentation performance. SAMAug generates augmented point prompts to provide more information about the user's intention to SAM. Starting with an initial point prompt, SAM produces an initial mask, which is then fed into our proposed SAMAug to generate augmen…
▽ More
This paper introduces SAMAug, a novel visual point augmentation method for the Segment Anything Model (SAM) that enhances interactive image segmentation performance. SAMAug generates augmented point prompts to provide more information about the user's intention to SAM. Starting with an initial point prompt, SAM produces an initial mask, which is then fed into our proposed SAMAug to generate augmented point prompts. By incorporating these extra points, SAM can generate augmented segmentation masks based on both the augmented point prompts and the initial prompt, resulting in improved segmentation performance. We conducted evaluations using four different point augmentation strategies: random sampling, sampling based on maximum difference entropy, maximum distance, and saliency. Experiment results on the COCO, Fundus, COVID QUEx, and ISIC2018 datasets show that SAMAug can boost SAM's segmentation results, especially using the maximum distance and saliency. SAMAug demonstrates the potential of visual prompt augmentation for computer vision. Codes of SAMAug are available at github.com/yhydhx/SAMAug
△ Less
Submitted 19 March, 2024; v1 submitted 3 July, 2023;
originally announced July 2023.
-
Radiology-GPT: A Large Language Model for Radiology
Authors:
Zhengliang Liu,
Aoxiao Zhong,
Yiwei Li,
Longtao Yang,
Chao Ju,
Zihao Wu,
Chong Ma,
Peng Shu,
Cheng Chen,
Sekeun Kim,
Haixing Dai,
Lin Zhao,
Lichao Sun,
Dajiang Zhu,
Jun Liu,
Wei Liu,
Dinggang Shen,
Xiang Li,
Quanzheng Li,
Tianming Liu
Abstract:
We introduce Radiology-GPT, a large language model for radiology. Using an instruction tuning approach on an extensive dataset of radiology domain knowledge, Radiology-GPT demonstrates superior performance compared to general language models such as StableLM, Dolly and LLaMA. It exhibits significant versatility in radiological diagnosis, research, and communication. This work serves as a catalyst…
▽ More
We introduce Radiology-GPT, a large language model for radiology. Using an instruction tuning approach on an extensive dataset of radiology domain knowledge, Radiology-GPT demonstrates superior performance compared to general language models such as StableLM, Dolly and LLaMA. It exhibits significant versatility in radiological diagnosis, research, and communication. This work serves as a catalyst for future developments in clinical NLP. The successful implementation of Radiology-GPT is indicative of the potential of localizing generative large language models, specifically tailored for distinctive medical specialties, while ensuring adherence to privacy standards such as HIPAA. The prospect of developing individualized, large-scale language models that cater to specific needs of various hospitals presents a promising direction. The fusion of conversational competence and domain-specific knowledge in these models is set to foster future development in healthcare AI. A demo of Radiology-GPT is available at https://huggingface.co/spaces/allen-eric/radiology-gpt.
△ Less
Submitted 19 March, 2024; v1 submitted 14 June, 2023;
originally announced June 2023.
-
DeID-GPT: Zero-shot Medical Text De-Identification by GPT-4
Authors:
Zhengliang Liu,
Yue Huang,
Xiaowei Yu,
Lu Zhang,
Zihao Wu,
Chao Cao,
Haixing Dai,
Lin Zhao,
Yiwei Li,
Peng Shu,
Fang Zeng,
Lichao Sun,
Wei Liu,
Dinggang Shen,
Quanzheng Li,
Tianming Liu,
Dajiang Zhu,
Xiang Li
Abstract:
The digitization of healthcare has facilitated the sharing and re-using of medical data but has also raised concerns about confidentiality and privacy. HIPAA (Health Insurance Portability and Accountability Act) mandates removing re-identifying information before the dissemination of medical records. Thus, effective and efficient solutions for de-identifying medical data, especially those in free-…
▽ More
The digitization of healthcare has facilitated the sharing and re-using of medical data but has also raised concerns about confidentiality and privacy. HIPAA (Health Insurance Portability and Accountability Act) mandates removing re-identifying information before the dissemination of medical records. Thus, effective and efficient solutions for de-identifying medical data, especially those in free-text forms, are highly needed. While various computer-assisted de-identification methods, including both rule-based and learning-based, have been developed and used in prior practice, such solutions still lack generalizability or need to be fine-tuned according to different scenarios, significantly imposing restrictions in wider use. The advancement of large language models (LLM), such as ChatGPT and GPT-4, have shown great potential in processing text data in the medical domain with zero-shot in-context learning, especially in the task of privacy protection, as these models can identify confidential information by their powerful named entity recognition (NER) capability. In this work, we developed a novel GPT4-enabled de-identification framework (``DeID-GPT") to automatically identify and remove the identifying information. Compared to existing commonly used medical text data de-identification methods, our developed DeID-GPT showed the highest accuracy and remarkable reliability in masking private information from the unstructured medical text while preserving the original structure and meaning of the text. This study is one of the earliest to utilize ChatGPT and GPT-4 for medical text data processing and de-identification, which provides insights for further research and solution development on the use of LLMs such as ChatGPT/GPT-4 in healthcare. Codes and benchmarking data information are available at https://github.com/yhydhx/ChatGPT-API.
△ Less
Submitted 21 December, 2023; v1 submitted 20 March, 2023;
originally announced March 2023.
-
Domain-Constrained Advertising Keyword Generation
Authors:
Hao Zhou,
Minlie Huang,
Yishun Mao,
Changlei Zhu,
Peng Shu,
Xiaoyan Zhu
Abstract:
Advertising (ad for short) keyword suggestion is important for sponsored search to improve online advertising and increase search revenue. There are two common challenges in this task. First, the keyword bidding problem: hot ad keywords are very expensive for most of the advertisers because more advertisers are bidding on more popular keywords, while unpopular keywords are difficult to discover. A…
▽ More
Advertising (ad for short) keyword suggestion is important for sponsored search to improve online advertising and increase search revenue. There are two common challenges in this task. First, the keyword bidding problem: hot ad keywords are very expensive for most of the advertisers because more advertisers are bidding on more popular keywords, while unpopular keywords are difficult to discover. As a result, most ads have few chances to be presented to the users. Second, the inefficient ad impression issue: a large proportion of search queries, which are unpopular yet relevant to many ad keywords, have no ads presented on their search result pages. Existing retrieval-based or matching-based methods either deteriorate the bidding competition or are unable to suggest novel keywords to cover more queries, which leads to inefficient ad impressions. To address the above issues, this work investigates to use generative neural networks for keyword generation in sponsored search. Given a purchased keyword (a word sequence) as input, our model can generate a set of keywords that are not only relevant to the input but also satisfy the domain constraint which enforces that the domain category of a generated keyword is as expected. Furthermore, a reinforcement learning algorithm is proposed to adaptively utilize domain-specific information in keyword generation. Offline evaluation shows that the proposed model can generate keywords that are diverse, novel, relevant to the source keyword, and accordant with the domain constraint. Online evaluation shows that generative models can improve coverage (COV), click-through rate (CTR), and revenue per mille (RPM) substantially in sponsored search.
△ Less
Submitted 27 February, 2019;
originally announced February 2019.
-
Promoting information spreading by using contact memory
Authors:
Lei Gao,
Wei Wang,
Panpan Shu,
Hui Gao,
Lidia A. Braunstein
Abstract:
Promoting information spreading is a booming research topic in network science community. However, the exiting studies about promoting information spreading seldom took into account the human memory, which plays an important role in the spreading dynamics. In this paper we propose a non-Markovian information spreading model on complex networks, in which every informed node contacts a neighbor by u…
▽ More
Promoting information spreading is a booming research topic in network science community. However, the exiting studies about promoting information spreading seldom took into account the human memory, which plays an important role in the spreading dynamics. In this paper we propose a non-Markovian information spreading model on complex networks, in which every informed node contacts a neighbor by using the memory of neighbor's accumulated contact numbers in the past. We systematically study the information spreading dynamics on uncorrelated configuration networks and a group of $22$ real-world networks, and find an effective contact strategy of promoting information spreading, i.e., the informed nodes preferentially contact neighbors with small number of accumulated contacts. According to the effective contact strategy, the high degree nodes are more likely to be chosen as the contacted neighbors in the early stage of the spreading, while in the late stage of the dynamics, the nodes with small degrees are preferentially contacted. We also propose a mean-field theory to describe our model, which qualitatively agrees well with the stochastic simulations on both artificial and real-world networks.
△ Less
Submitted 19 March, 2017;
originally announced March 2017.
-
Comprehensive routing strategy on multilayer networks
Authors:
Lei Gao,
Panpan Shu,
Ming Tang,
Wei Wang,
Hui Gao
Abstract:
Designing an efficient routing strategy is of great importance to alleviate traffic congestion in multilayer networks. In this work, we design an effective routing strategy for multilayer networks by comprehensively considering the roles of nodes' local structures in micro-level, as well as the macro-level differences in transmission speeds between different layers. Both numerical and analytical r…
▽ More
Designing an efficient routing strategy is of great importance to alleviate traffic congestion in multilayer networks. In this work, we design an effective routing strategy for multilayer networks by comprehensively considering the roles of nodes' local structures in micro-level, as well as the macro-level differences in transmission speeds between different layers. Both numerical and analytical results indicate that our proposed routing strategy can reasonably redistribute the traffic load of the low speed layer to the high speed layer, and thus the traffic capacity of multilayer networks are significantly enhanced compared with the monolayer low speed networks. There is an optimal combination of macro- and micro-level control parameters at which can remarkably alleviate the congestion and thus maximize the traffic capacity for a given multilayer network. Moreover, we find that increasing the size and the average degree of the high speed layer can enhance the traffic capacity of multilayer networks more effectively. We finally verify that real-world network topology does not invalidate the results. The theoretical predictions agree well with the numerical simulations.
△ Less
Submitted 19 January, 2017;
originally announced January 2017.
-
Skipping Word: A Character-Sequential Representation based Framework for Question Answering
Authors:
Lingxun Meng,
Yan Li,
Mengyi Liu,
Peng Shu
Abstract:
Recent works using artificial neural networks based on word distributed representation greatly boost the performance of various natural language learning tasks, especially question answering. Though, they also carry along with some attendant problems, such as corpus selection for embedding learning, dictionary transformation for different learning tasks, etc. In this paper, we propose to straightf…
▽ More
Recent works using artificial neural networks based on word distributed representation greatly boost the performance of various natural language learning tasks, especially question answering. Though, they also carry along with some attendant problems, such as corpus selection for embedding learning, dictionary transformation for different learning tasks, etc. In this paper, we propose to straightforwardly model sentences by means of character sequences, and then utilize convolutional neural networks to integrate character embedding learning together with point-wise answer selection training. Compared with deep models pre-trained on word embedding (WE) strategy, our character-sequential representation (CSR) based method shows a much simpler procedure and more stable performance across different benchmarks. Extensive experiments on two benchmark answer selection datasets exhibit the competitive performance compared with the state-of-the-art methods.
△ Less
Submitted 2 September, 2016;
originally announced September 2016.
-
Recovery rate affects the effective epidemic threshold with synchronous updating
Authors:
Panpan Shu,
Wei Wang,
Ming Tang,
Pengcheng Zhao,
Yi-Cheng Zhang
Abstract:
Accurate identification of effective epidemic threshold is essential for understanding epidemic dynamics on complex networks. The existing studies on the effective epidemic threshold of the susceptible-infected-removed (SIR) model generally assume that all infected nodes immediately recover after the infection process, which more or less does not conform to the realistic situation of disease. In t…
▽ More
Accurate identification of effective epidemic threshold is essential for understanding epidemic dynamics on complex networks. The existing studies on the effective epidemic threshold of the susceptible-infected-removed (SIR) model generally assume that all infected nodes immediately recover after the infection process, which more or less does not conform to the realistic situation of disease. In this paper, we systematically study the effect of arbitrary recovery rate on the SIR spreading dynamics on complex networks. We derive the theoretical effective epidemic threshold and final outbreak size based on the edge-based compartmental theory. To validate the proposed theoretical predictions, extensive numerical experiments are implemented by using asynchronous and synchronous updating methods. When asynchronous updating method is used in simulations, recovery rate does not affect the final state of spreading dynamics. But with synchronous updating, we find that the effective epidemic threshold decreases with recovery rate, and final outbreak size increases with recovery rate. A good agreement between the theoretical predictions and numerical results are observed on both synthetic and real-world networks. Our results extend the existing theoretical studies, and help us to understand the phase transition with arbitrary recovery rate.
△ Less
Submitted 5 February, 2016;
originally announced February 2016.
-
Dynamics of social contagions with heterogeneous adoption thresholds: Crossover phenomena in phase transition
Authors:
Wei Wang,
Ming Tang,
Panpan Shu,
Zhen Wang
Abstract:
Heterogeneous adoption thresholds exist widely in social contagions, but were always neglected in previous studies. We first propose a non-Markovian spreading threshold model with general adoption threshold distribution. In order to understand the effects of heterogeneous adoption thresholds quantitatively, an edge-based compartmental theory is developed for the proposed model. We use a binary spr…
▽ More
Heterogeneous adoption thresholds exist widely in social contagions, but were always neglected in previous studies. We first propose a non-Markovian spreading threshold model with general adoption threshold distribution. In order to understand the effects of heterogeneous adoption thresholds quantitatively, an edge-based compartmental theory is developed for the proposed model. We use a binary spreading threshold model as a specific example, in which some individuals have a low adoption threshold (i.e., activists) while the remaining ones hold a relatively high adoption threshold (i.e., bigots), to demonstrate that heterogeneous adoption thresholds markedly affect the final adoption size and phase transition. Interestingly, the first-order, second-order and hybrid phase transitions can be found in the system. More importantly, there are two different kinds of crossover phenomena in phase transition for distinct values of bigots' adoption threshold: a change from first-order or hybrid phase transition to the second-order phase transition. The theoretical predictions based on the suggested theory agree very well with the results of numerical simulations.
△ Less
Submitted 10 September, 2015;
originally announced September 2015.
-
Dynamics of social contagions with limited contact capacity
Authors:
Wei Wang,
Panpan Shu,
Yu-Xiao Zhu,
Ming Tang,
Yi-Cheng Zhang
Abstract:
Individuals are always limited by some inelastic resources, such as time and energy, which restrict them to dedicate to social interaction and limit their contact capacity. Contact capacity plays an important role in dynamics of social contagions, which so far has eluded theoretical analysis. In this paper, we first propose a non-Markovian model to understand the effects of contact capacity on soc…
▽ More
Individuals are always limited by some inelastic resources, such as time and energy, which restrict them to dedicate to social interaction and limit their contact capacity. Contact capacity plays an important role in dynamics of social contagions, which so far has eluded theoretical analysis. In this paper, we first propose a non-Markovian model to understand the effects of contact capacity on social contagions, in which each individual can only contact and transmit the information to a finite number of neighbors. We then develop a heterogeneous edge-based compartmental theory for this model, and a remarkable agreement with simulations is obtained. Through theory and simulations, we find that enlarging the contact capacity makes the network more fragile to behavior spreading. Interestingly, we find that both the continuous and discontinuous dependence of the final adoption size on the information transmission probability can arise. And there is a crossover phenomenon between the two types of dependence. More specifically, the crossover phenomenon can be induced by enlarging the contact capacity only when the degree exponent is above a critical degree exponent, while the the final behavior adoption size always grows continuously for any contact capacity when degree exponent is below the critical degree exponent.
△ Less
Submitted 27 July, 2015; v1 submitted 15 May, 2015;
originally announced May 2015.
-
Preferential imitation of vaccinating behavior can invalidate the targeted subsidy on complex network
Authors:
Hai-Feng Zhang,
Pan-Pan Shu,
Ming Tang,
Michael Small
Abstract:
We consider the effect of inducement to vaccinate during the spread of an infectious disease on complex networks. Suppose that public resources are finite and that only a small proportion of individuals can be vaccinated freely (complete subsidy), for the remainder of the population vaccination is a voluntary behavior --- and each vaccinated individual carries a perceived cost. We ask whether the…
▽ More
We consider the effect of inducement to vaccinate during the spread of an infectious disease on complex networks. Suppose that public resources are finite and that only a small proportion of individuals can be vaccinated freely (complete subsidy), for the remainder of the population vaccination is a voluntary behavior --- and each vaccinated individual carries a perceived cost. We ask whether the classical targeted subsidy strategy is definitely better than the random strategy: does targeting subsidy at individuals perceived to be with the greatest risk actually help? With these questions, we propose a model to investigate the \emph{interaction effects} of the subsidy policies and individuals responses when facing subsidy policies on the epidemic dynamics on complex networks. In the model, a small proportion of individuals are freely vaccinated according to either the targeted or random subsidy policy, the remainder choose to vaccinate (or not) based on voluntary principle and update their vaccination decision via an imitation rule. Our findings show that the targeted strategy is only advantageous when individuals prefer to imitate the subsidized individuals' strategy. Otherwise, the effect of the targeted policy is worse than the random immunization, since individuals preferentially select non-subsidized individuals as the imitation objects. More importantly, we find that under the targeted subsidy policy, increasing the proportion of subsidized individuals may increase the final epidemic size. We further define social cost as the sum of the costs of vaccination and infection, and study how each of the two policies affect the social cost. Our result shows that there exist some optimal intermediate regions leading to the minimal social cost.
△ Less
Submitted 27 March, 2015;
originally announced March 2015.
-
Simulated identification of epidemic threshold on finite-size networks
Authors:
Panpan Shu,
Wei Wang,
Ming Tang,
Younghae Do
Abstract:
Epidemic threshold is one of the most important features of the epidemic dynamics. Through a lot of numerical simulations in classic Susceptible-Infected-Recovered (SIR) and Susceptible-Infected-Susceptible (SIS) models on various types of networks, we study the simulated identification of epidemic thresholds on finite-size networks. We confirm that the susceptibility measure goes awry for the SIR…
▽ More
Epidemic threshold is one of the most important features of the epidemic dynamics. Through a lot of numerical simulations in classic Susceptible-Infected-Recovered (SIR) and Susceptible-Infected-Susceptible (SIS) models on various types of networks, we study the simulated identification of epidemic thresholds on finite-size networks. We confirm that the susceptibility measure goes awry for the SIR model due to the bimodal distribution of outbreak sizes near the critical point, while the simulated thresholds of the SIS and SIR models can be accurately determined by analyzing the peak of the epidemic variability. We further verify the accuracy of theoretical predictions derived by the heterogeneous mean-field theory (HMF) and the quenched mean-field theory (QMF), by comparing them with the simulated threshold of the SIR model obtained from the variability measure. The results show that the HMF prediction agrees very well with the simulated threshold, except the case that the networks are disassortive, in which the QMF prediction is more close to the simulated threshold.
△ Less
Submitted 15 October, 2014; v1 submitted 2 October, 2014;
originally announced October 2014.
-
Effects of Weak Ties on Epidemic Predictability in Community Networks
Authors:
Panpan Shu,
Ming Tang,
Kai Gong,
Ying Liu
Abstract:
Weak ties play a significant role in the structures and the dynamics of community networks. Based on the susceptible-infected model in contact process, we study numerically how weak ties influence the predictability of epidemic dynamics. We first investigate the effects of different kinds of weak ties on the variabilities of both the arrival time and the prevalence of disease, and find that the br…
▽ More
Weak ties play a significant role in the structures and the dynamics of community networks. Based on the susceptible-infected model in contact process, we study numerically how weak ties influence the predictability of epidemic dynamics. We first investigate the effects of different kinds of weak ties on the variabilities of both the arrival time and the prevalence of disease, and find that the bridgeness with small degree can enhance the predictability of epidemic spreading. Once weak ties are settled, compared with the variability of arrival time, the variability of prevalence displays a diametrically opposed changing trend with both the distance of the initial seed to the bridgeness and the degree of the initial seed. More specifically, the further distance and the larger degree of the initial seed can induce the better predictability of arrival time and the worse predictability of prevalence. Moreover, we discuss the effects of weak tie number on the epidemic variability. As community strength becomes very strong, which is caused by the decrease of weak tie number, the epidemic variability will change dramatically. Compared with the case of hub seed and random seed, the bridgenss seed can result in the worst predictability of arrival time and the best predictability of prevalence. These results show that the variability of arrival time always marks a complete reversal trend of that of prevalence, which implies it is impossible to predict epidemic spreading in the early stage of outbreaks accurately.
△ Less
Submitted 4 July, 2012;
originally announced July 2012.
-
Feedback control on geometric phase in dissipative two-level systems
Authors:
H. Y. Sun,
P. L. Shu,
C. Li,
X. X. Yi
Abstract:
The effect of feedback on a two-level dissipative system is studied in this paper. The results show that it is possible to control the phase in the open system even if its state can not be manipulated from an arbitrary initial one to an arbitrary final one. The dependence of the geometric phase on the control parameters is calculated and discussed.
The effect of feedback on a two-level dissipative system is studied in this paper. The results show that it is possible to control the phase in the open system even if its state can not be manipulated from an arbitrary initial one to an arbitrary final one. The dependence of the geometric phase on the control parameters is calculated and discussed.
△ Less
Submitted 30 December, 2008;
originally announced December 2008.