-
Exploring Crowdworkers' Perceptions, Current Practices, and Desired Practices Regarding Using Non-Workstation Devices for Crowdwork
Authors:
Senjuti Dutta,
Scott Ruoti,
Rhema Linder,
Alex C. Williams,
Anastasia Kuzminykh
Abstract:
Despite a plethora of research dedicated to designing HITs for non-workstations, there is a lack of research looking specifically into workers' perceptions of the suitability of these devices for managing and completing work. In this work, we fill this research gap by conducting an online survey of 148 workers on Amazon Mechanical Turk to explore 1. how crowdworkers currently use their non-worksta…
▽ More
Despite a plethora of research dedicated to designing HITs for non-workstations, there is a lack of research looking specifically into workers' perceptions of the suitability of these devices for managing and completing work. In this work, we fill this research gap by conducting an online survey of 148 workers on Amazon Mechanical Turk to explore 1. how crowdworkers currently use their non-workstation devices to complete and manage crowdwork, 2. what challenges they face using those devices, and 3. to what extent they wish they could use those devices if their concerns were addressed. Our results show that workers unanimously favor using a desktop to complete and manage crowdwork. While workers occasionally use smartphones or tablets, they find their suitability marginal at best and have little interest in smart speakers and smartwatches, viewing them as unsuitable for crowdwork. When investigating the reason for these views, we find that the key issue is that non workstation devices lack the tooling necessary to automatically find and accept HITs, tooling that workers view as essential in their efforts to compete with bots in accepting high paying work. To address this problem, we propose a new paradigm for finding, accepting, and completing crowdwork that puts crowdworkers on equal footing with bots in these tasks. We also describe future research directions for tailoring HITs to non workstation devices and definitely answering whether smart speakers and smartwatches have a place in crowdwork.
△ Less
Submitted 6 September, 2024;
originally announced September 2024.
-
Unveiling the Inter-Related Preferences of Crowdworkers: Implications for Personalized and Flexible Platform Design
Authors:
Senjuti Dutta,
Rhema Linder,
Alex C. Williams,
Anastasia Kuzminykh,
Scott Ruoti
Abstract:
Crowdsourcing platforms have traditionally been designed with a focus on workstation interfaces, restricting the flexibility that crowdworkers need. Recognizing this limitation and the need for more adaptable platforms, prior research has highlighted the diverse work processes of crowdworkers, influenced by factors such as device type and work stage. However, these variables have largely been stud…
▽ More
Crowdsourcing platforms have traditionally been designed with a focus on workstation interfaces, restricting the flexibility that crowdworkers need. Recognizing this limitation and the need for more adaptable platforms, prior research has highlighted the diverse work processes of crowdworkers, influenced by factors such as device type and work stage. However, these variables have largely been studied in isolation. Our study is the first to explore the interconnected variabilities among these factors within the crowdwork community. Through a survey involving 150 Amazon Mechanical Turk crowdworkers, we uncovered three distinct groups characterized by their interrelated variabilities in key work aspects. The largest group exhibits a reliance on traditional devices, showing limited interest in integrating smartphones and tablets into their work routines. The second-largest group also primarily uses traditional devices but expresses a desire for supportive tools and scripts that enhance productivity across all devices, particularly smartphones and tablets. The smallest group actively uses and strongly prefers non-workstation devices, especially smartphones and tablets, for their crowdworking activities. We translate our findings into design insights for platform developers, discussing the implications for creating more personalized, flexible, and efficient crowdsourcing environments. Additionally, we highlight the unique work practices of these crowdworker clusters, offering a contrast to those of more traditional and established worker groups.
△ Less
Submitted 6 September, 2024;
originally announced September 2024.
-
Prompting AI Art: An Investigation into the Creative Skill of Prompt Engineering
Authors:
Jonas Oppenlaender,
Rhema Linder,
Johanna Silvennoinen
Abstract:
We are witnessing a novel era of creativity where anyone can create digital content via prompt-based learning (known as prompt engineering). This paper investigates prompt engineering as a novel creative skill for creating AI art with text-to-image generation. In three consecutive studies, we explore whether crowdsourced participants can 1) discern prompt quality, 2) write prompts, and 3) refine p…
▽ More
We are witnessing a novel era of creativity where anyone can create digital content via prompt-based learning (known as prompt engineering). This paper investigates prompt engineering as a novel creative skill for creating AI art with text-to-image generation. In three consecutive studies, we explore whether crowdsourced participants can 1) discern prompt quality, 2) write prompts, and 3) refine prompts. We find that participants could evaluate prompt quality and crafted descriptive prompts, but they lacked style-specific vocabulary necessary for effective prompting. This is in line with our hypothesis that prompt engineering is a new type of skill that is non-intuitive and must first be acquired (e.g., through means of practice and learning) before it can be used. Our studies deepen our understanding of prompt engineering and chart future research directions. We conclude by envisioning four potential futures for prompt engineering.
△ Less
Submitted 4 July, 2024; v1 submitted 13 March, 2023;
originally announced March 2023.
-
Text-to-Image Generation: Perceptions and Realities
Authors:
Jonas Oppenlaender,
Aku Visuri,
Ville Paananen,
Rhema Linder,
Johanna Silvennoinen
Abstract:
Generative AI is an emerging technology that will have a profound impact on society and individuals. Only a decade ago, it was thought that creative work would be among the last to be automated - yet today, we see AI encroaching on creative domains. In this paper, we present the key findings of a survey study on people's perceptions of text-to-image generation. We touch on participants' technical…
▽ More
Generative AI is an emerging technology that will have a profound impact on society and individuals. Only a decade ago, it was thought that creative work would be among the last to be automated - yet today, we see AI encroaching on creative domains. In this paper, we present the key findings of a survey study on people's perceptions of text-to-image generation. We touch on participants' technical understanding of the emerging technology, their ideas for potential application areas, as well as concerns, risks, and dangers of text-to-image generation to society and the individual. The study found that participants were aware of the risks and dangers associated with the technology, but only few participants considered the technology to be a risk to themselves. Additionally, those who had tried the technology rated its future importance lower than those who had not.
△ Less
Submitted 2 May, 2023; v1 submitted 10 March, 2023;
originally announced March 2023.
-
Optical Time-Series Photometry of the Symbiotic Nova V1835 Aquilae
Authors:
Robert V. Caddy,
Andrew C. Layden,
Daniel E. Reichart,
Joshua B. Haislip,
Vladimir V. Kouprianov,
Kevin M. Ivarsen,
Justin P. Moore,
Aaron P. LaCluyze,
Tyler R. Linder,
Melissa C. Nysewander
Abstract:
We present time-series CCD photometry in the $BVRI$ passbands of the recently identified symbiotic nova V1835 Aquilae (NSV 11749) over an interval of 5.1 years with 7-14 day cadence, observed during its quiescence. We find slow light variations with a range of $\sim$0.9 mag in $V$ and $\sim$0.3 mag in $I$. Analysis of these data show strong periodicity at $419 \pm 10$ days, which we interpret to b…
▽ More
We present time-series CCD photometry in the $BVRI$ passbands of the recently identified symbiotic nova V1835 Aquilae (NSV 11749) over an interval of 5.1 years with 7-14 day cadence, observed during its quiescence. We find slow light variations with a range of $\sim$0.9 mag in $V$ and $\sim$0.3 mag in $I$. Analysis of these data show strong periodicity at $419 \pm 10$ days, which we interpret to be the system's orbital period. A dip in the otherwise-sinusoidal phased light curve suggests a weak ellipsoidal effect due to tidal distortion of the giant star, which in turn opens the possibility that V1835 Aql transfers some of its mass to the hot component via Roche lobe overflow rather than via a stellar wind. We also find evidence that V1835 Aql is an S-type symbiotic star, relatively free of circumstellar dust, and include it among the nuclear burning group of symbiotics. Finally, we provide photometry, periods, and light curve classifications for 22 variable stars in the field around V1835 Aql, about half of which are newly identified.
△ Less
Submitted 22 September, 2022;
originally announced September 2022.
-
A Neophyte With AutoML: Evaluating the Promises of Automatic Machine Learning Tools
Authors:
Oleg Bezrukavnikov,
Rhema Linder
Abstract:
This paper discusses modern Auto Machine Learning (AutoML) tools from the perspective of a person with little prior experience in Machine Learning (ML). There are many AutoML tools both ready-to-use and under development, which are created to simplify and democratize usage of ML technologies in everyday life. Our position is that ML should be easy to use and available to a greater number of people…
▽ More
This paper discusses modern Auto Machine Learning (AutoML) tools from the perspective of a person with little prior experience in Machine Learning (ML). There are many AutoML tools both ready-to-use and under development, which are created to simplify and democratize usage of ML technologies in everyday life. Our position is that ML should be easy to use and available to a greater number of people. Prior research has identified the need for intuitive AutoML tools. This work seeks to understand how well AutoML tools have achieved that goal in practice. We evaluate three AutoML Tools to evaluate the end-user experience and system performance. We evaluate the tools by having them create models from a competition dataset on banking data. We report on their performance and the details of our experience. This process provides a unique understanding of the state of the art of AutoML tools. Finally, we use these experiences to inform a discussion on how future AutoML tools can improve the user experience for neophytes of Machine Learning.
△ Less
Submitted 14 January, 2021;
originally announced January 2021.
-
XFake: Explainable Fake News Detector with Visualizations
Authors:
Fan Yang,
Shiva K. Pentyala,
Sina Mohseni,
Mengnan Du,
Hao Yuan,
Rhema Linder,
Eric D. Ragan,
Shuiwang Ji,
Xia Hu
Abstract:
In this demo paper, we present the XFake system, an explainable fake news detector that assists end-users to identify news credibility. To effectively detect and interpret the fakeness of news items, we jointly consider both attributes (e.g., speaker) and statements. Specifically, MIMIC, ATTN and PERT frameworks are designed, where MIMIC is built for attribute analysis, ATTN is for statement seman…
▽ More
In this demo paper, we present the XFake system, an explainable fake news detector that assists end-users to identify news credibility. To effectively detect and interpret the fakeness of news items, we jointly consider both attributes (e.g., speaker) and statements. Specifically, MIMIC, ATTN and PERT frameworks are designed, where MIMIC is built for attribute analysis, ATTN is for statement semantic analysis and PERT is for statement linguistic analysis. Beyond the explanations extracted from the designed frameworks, relevant supporting examples as well as visualization are further provided to facilitate the interpretation. Our implemented system is demonstrated on a real-world dataset crawled from PolitiFact, where thousands of verified political news have been collected.
△ Less
Submitted 8 July, 2019;
originally announced July 2019.
-
Physical Characterization of Active Asteroid (6478) Gault
Authors:
Juan A. Sanchez,
Vishnu Reddy,
Audrey Thirouin,
Edward L. Wright,
Tyler R. Linder,
Theodore Kareta,
Benjamin Sharkey
Abstract:
Main belt asteroid (6478) Gault has been dynamically linked with two overlapping asteroid families: Phocaea, dominated by S-type asteroids, and Tamara, dominated by low-albedo C-types. This object has recently become an interesting case for study, after images obtained in late 2018 revealed that it was active and displaying a comet-like tail. Previous authors have proposed that the most likely sce…
▽ More
Main belt asteroid (6478) Gault has been dynamically linked with two overlapping asteroid families: Phocaea, dominated by S-type asteroids, and Tamara, dominated by low-albedo C-types. This object has recently become an interesting case for study, after images obtained in late 2018 revealed that it was active and displaying a comet-like tail. Previous authors have proposed that the most likely scenarios to explain the observed activity on Gault were rotational excitation or merger of near-contact binaries. Here we use new photometric and spectroscopic data of Gault to determine its physical and compositional properties. Lightcurves derived from the photometric data showed little variation over three nights of observations, which prevented us from determining the rotation period of the asteroid. Using WISE observations of Gault and the near-Earth Asteroid Thermal Model (NEATM) we determined that this asteroid has a diameter $<$6 km. NIR spectroscopic data obtained with the Infrared Telescope Facility (IRTF) showed a spectrum similar to that of S-complex asteroids, and a surface composition consistent with H chondrite meteorites. These results favor a compositional affinity between Gault and asteroid (25) Phocaea, and rules out a compositional link with the Tamara family. From the spectroscopic data we found no evidence of fresh material that could have been exposed during the outburst episodes.
△ Less
Submitted 15 July, 2019;
originally announced July 2019.
-
Analytic Provenance Datasets: A Data Repository of Human Analysis Activity and Interaction Logs
Authors:
Sina Mohseni,
Andrew Pachuilo,
Ehsanul Haque Nirjhar,
Rhema Linder,
Alyssa Pena,
Eric D. Ragan
Abstract:
We present an analytic provenance data repository that can be used to study human analysis activity, thought processes, and software interaction with visual analysis tools during exploratory data analysis. We conducted a series of user studies involving exploratory data analysis scenario with textual and cyber security data. Interactions logs, think-alouds, videos and all coded data in this study…
▽ More
We present an analytic provenance data repository that can be used to study human analysis activity, thought processes, and software interaction with visual analysis tools during exploratory data analysis. We conducted a series of user studies involving exploratory data analysis scenario with textual and cyber security data. Interactions logs, think-alouds, videos and all coded data in this study are available online for research purposes. Analysis sessions are segmented in multiple sub-task steps based on user think-alouds, video and audios captured during the studies. These analytic provenance datasets can be used for research involving tools and techniques for analyzing interaction logs and analysis history. By providing high-quality coded data along with interaction logs, it is possible to compare algorithmic data processing techniques to the ground-truth records of analysis history.
△ Less
Submitted 15 January, 2018;
originally announced January 2018.
-
New Pulse Timing Measurements of the sdBV Star CS 1246
Authors:
Zackary L. Hutchens,
Brad N. Barlow,
Alan Vasquez Soto,
Dan E. Reichart,
Josh B. Haislip,
Vladimir V. Kouprianov,
Tyler R. Linder,
Justin P. Moore
Abstract:
CS 1246 is a hot subdwarf B star discovered in 2009 to exhibit a single, large-amplitude radial pulsation. An O-C diagram constructed from this mode revealed reflex motion due to the presence of a low-mass M dwarf, as well as a long-term trend consistent with a decrease in the pulsational period. The orbital reflex motion was later confirmed with radial velocity measurements. Using eight years of…
▽ More
CS 1246 is a hot subdwarf B star discovered in 2009 to exhibit a single, large-amplitude radial pulsation. An O-C diagram constructed from this mode revealed reflex motion due to the presence of a low-mass M dwarf, as well as a long-term trend consistent with a decrease in the pulsational period. The orbital reflex motion was later confirmed with radial velocity measurements. Using eight years of data collected with the Skynet Robotic Telescope Network, we show that the pulsation amplitude of CS 1246 is decaying nonlinearly. We also present an updated O-C diagram, which might now indicate a positive $\dot P$ and a new $2.09 \pm 0.05$ yr oscillation consistent with orbital reflex motion of the entire inner sdB+dM binary, possibly due to the gravitational influence of a circumbinary planet with minimum mass $m\sin i = 3.3 \, \pm \, ^{2.1}_{1.2}$ $M_{\rm Jup}$. However, unlike the presence of the M dwarf, we hesitate to claim this object as a definitive detection since intrinsic variability of the pulsation phase could theoretically produce a similar effect.
△ Less
Submitted 6 December, 2017;
originally announced December 2017.
-
A search for rapidly pulsating hot subdwarf stars in the GALEX survey
Authors:
Emily M. Boudreaux,
Brad N. Barlow,
Scott W. Fleming,
Alan Vasquez Soto,
Chase Million,
Dan E. Reichart,
Josh B. Haislip,
Tyler R. Linder,
Justin P. Moore
Abstract:
NASA's Galaxy Evolution Explorer (GALEX) provided near- and far-UV observations for approximately 77 percent of the sky over a ten-year period; however, the data reduction pipeline initially only released single NUV and FUV images to the community. The recently released Python module gPhoton changes this, allowing calibrated time-series aperture photometry to be extracted easily from the raw GAL…
▽ More
NASA's Galaxy Evolution Explorer (GALEX) provided near- and far-UV observations for approximately 77 percent of the sky over a ten-year period; however, the data reduction pipeline initially only released single NUV and FUV images to the community. The recently released Python module gPhoton changes this, allowing calibrated time-series aperture photometry to be extracted easily from the raw GALEX data set. Here we use gPhoton to generate light curves for all hot subdwarf B (sdB) stars that were observed by GALEX, with the intention of identifying short-period, p-mode pulsations. We find that the spacecraft's short visit durations, uneven gaps between visits, and dither pattern make the detection of hot subdwarf pulsations difficult. Nonetheless, we detect UV variations in four previously known pulsating targets and report their UV pulsation amplitudes and frequencies. Additionally, we find that several other sdB targets not previously known to vary show promising signals in their periodograms. Using optical follow-up photometry with the Skynet Robotic Telescope Network, we confirm p-mode pulsations in one of these targets, LAMOST J082517.99+113106.3, and report it as the most recent addition to the sdBVr class of variable stars.
△ Less
Submitted 2 August, 2017;
originally announced August 2017.
-
Interpretation of Mössbauer spectra in the energy and time domain with neural networks
Authors:
H. Paulsen,
R. Linder,
F. Wagner,
H. Winkler,
S. J. Pöppl,
A. X. Trautwein
Abstract:
An artificial neural network for extracting reasonable and fast estimates of hyperfine parameters from Mössbauer spectra in the energy or time domain is outlined. First promising results for determining the asymmetry of the electric field gradient at the nucleus of a diamagnetic iron center as derived with different types of neural networks are reported.
An artificial neural network for extracting reasonable and fast estimates of hyperfine parameters from Mössbauer spectra in the energy or time domain is outlined. First promising results for determining the asymmetry of the electric field gradient at the nucleus of a diamagnetic iron center as derived with different types of neural networks are reported.
△ Less
Submitted 18 June, 2012;
originally announced June 2012.
