skip to main content
research-article

Less is Not More: Improving Findability and Actionability of Privacy Controls for Online Behavioral Advertising

Published: 19 April 2023 Publication History

Abstract

Tech companies that rely on ads for business argue that users have control over their data via ad privacy settings. However, these ad settings are often hidden. This work aims to inform the design of findable ad controls and study their impact on users’ behavior and sentiment. We iteratively designed ad control interfaces that varied in the setting’s (1) entry point (within ads, at the feed’s top) and (2) level of actionability, with high actionability directly surfacing links to specific advertisement settings, and low actionability pointing to general settings pages (which is reminiscent of companies’ current approach to ad controls). We built a Chrome extension that augments Facebook with our experimental ad control interfaces and conducted a between-subjects online experiment with 110 participants. Results showed that entry points within ads or at the feed’s top, and high actionability interfaces, both increased Facebook ad settings’ findability and discoverability, as well as participants’ perceived usability of them. High actionability also reduced users’ effort in finding ad settings. Participants perceived high and low actionability as equally usable, which shows it is possible to design more actionable ad controls without overwhelming users. We conclude by emphasizing the importance of regulation to provide specific and research-informed requirements to companies on how to design usable ad controls.

Supplementary Material

Supplemental Materials (3544548.3580773-supplemental-materials.zip)
MP4 File (3544548.3580773-talk-video.mp4)
Pre-recorded Video Presentation

References

[1]
Alessandro Acquisti, Idris Adjerid, Rebecca Balebako, Laura Brandimarte, Lorrie Faith Cranor, Saranga Komanduri, Pedro Giovanni Leon, Norman Sadeh, Florian Schaub, Manya Sleeper, 2017. Nudges for privacy and security: Understanding and assisting users’ choices online. ACM Computing Surveys (CSUR) 50, 3 (2017), 1–41.
[2]
Muhammad Ali, Angelica Goetzen, Piotr Sapiezynski, Elissa Redmiles, and Alan Mislove. 2022. All Things Unequal: Measuring Disparity of Potentially Harmful Ads on Facebook. In Proceedings of the Workshop on Technology and Consumer Protection (ConPro’22). San Francisco, CA, USA.
[3]
Digital Advertising Alliance. 2022. YourAdChoices. https://optout.aboutads.info.
[4]
Athanasios Andreou, Giridhari Venkatadri, Oana Goga, Krishna Gummadi, Patrick Loiseau, and Alan Mislove. 2018. Investigating ad transparency mechanisms in social media: A case study of Facebook’s explanations. In NDSS 2018-Network and Distributed System Security Symposium. 1–15.
[5]
Joshua Asplund, Motahhare Eslami, Hari Sundaram, Christian Sandvig, and Karrie Karahalios. 2020. Auditing race and gender discrimination in online housing markets. In Proceedings of the International AAAI Conference on Web and Social Media, Vol. 14. 24–35.
[6]
Brooke Auxier, Lee Rainie, Monica Anderson, Andrew Perrin, Madhu Kumar, and Erica Turner. 2019. Americans and privacy: Concerned, confused and feeling lack of control over their personal information. (2019).
[7]
Nikola Banovic, Fanny Chevalier, Tovi Grossman, and George Fitzmaurice. 2012. Triggering Triggers and Burying Barriers to Customizing Software. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Austin, Texas, USA) (CHI ’12). Association for Computing Machinery, New York, NY, USA, 2717–2726. https://doi.org/10.1145/2207676.2208666
[8]
Natã M Barbosa, Gang Wang, Blase Ur, and Yang Wang. 2021. Who Am I? A Design Probe Exploring Real-Time Transparency about Online and Offline User Profiling Underlying Targeted Ads. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 5, 3 (2021), 1–32.
[9]
Md Momen Bhuiyan, Michael Horning, Sang Won Lee, and Tanushree Mitra. 2021. NudgeCred: Supporting News Credibility Assessment on Social Media Through Nudges. Proc. ACM Hum.-Comput. Interact. 5, CSCW2, Article 427 (oct 2021), 30 pages. https://doi.org/10.1145/3479571
[10]
John Brooke. 1995. SUS: A quick and dirty usability scale. Usability Eval. Ind. 189 (11 1995).
[11]
Shea Brown, Jovana Davidovic, and Ali Hasan. 2021. The algorithm audit: Scoring the algorithms that score us. Big Data & Society 8, 1 (2021), 2053951720983865.
[12]
Fred H Cate. 2006. The failure of fair information practice principles. Consumer protection in the age of the information economy (2006).
[13]
Facebook Help Center. 2022. How Ads Work on Facebook. https://www.facebook.com/help/516147308587266/?helpref=hc_fnav.
[14]
Patrali Chatterjee. 2008. Are Unclicked Ads Wasted? Enduring Effects of Banner and Pop-Up Ad Exposures on Brand Memory and Attitudes.Journal of electronic commerce Research 9, 1 (2008).
[15]
Jessica Colnago, Lorrie Faith Cranor, Alessandro Acquisti, and Kate Hazel Jain. 2022. Is it a concern or a preference? An investigation into the ability of privacy scales to capture and distinguish granular privacy constructs. In Eighteenth Symposium on Usable Privacy and Security (SOUPS 2022). 331–346.
[16]
Kovila PL Coopamootoo, Maryam Mehrnezhad, and Ehsan Toreini. 2022. " I feel invaded, annoyed, anxious and I may protect myself": Individuals’ Feelings about Online Tracking and their Protective Behaviour across Gender and Country. arXiv preprint arXiv:2202.04682(2022).
[17]
Claire Dolin, Ben Weinshel, Shawn Shan, Chang Min Hahn, Euirim Choi, Michelle L Mazurek, and Blase Ur. 2018. Unpacking perceptions of data-driven inferences underlying online targeting and personalization. In Proceedings of the 2018 CHI conference on human factors in computing systems. 1–12.
[18]
Lisa A Elkin, Matthew Kay, James J Higgins, and Jacob O Wobbrock. 2021. An aligned rank transform procedure for multifactor contrast tests. In The 34th Annual ACM Symposium on User Interface Software and Technology. 754–768.
[19]
Nel Escher and Nikola Banovic. 2020. Exposing Error in Poverty Management Technology: A Method for Auditing Government Benefits Screening Tools. Proceedings of the ACM on Human-Computer Interaction 4, CSCW1(2020), 1–20.
[20]
Motahhare Eslami, Sneha R Krishna Kumaran, Christian Sandvig, and Karrie Karahalios. 2018. Communicating algorithmic process in online behavioral advertising. In Proceedings of the 2018 CHI conference on human factors in computing systems. 1–13.
[21]
Florian M Farke, David G Balash, Maximilian Golla, Markus Dürmuth, and Adam J Aviv. 2021. Are Privacy Dashboards Good for End Users? Evaluating User Perceptions and Reactions to Google’s My Activity. In 30th USENIX Security Symposium (USENIX Security 21). 483–500.
[22]
Lisa Farman, Maria Leonora Comello, and Jeffrey R Edwards. 2020. Are consumers put off by retargeted ads on social media? Evidence for perceptions of marketing surveillance and decreased ad effectiveness. Journal of Broadcasting & Electronic Media 64, 2 (2020), 298–319.
[23]
Yuanyuan Feng, Yaxing Yao, and Norman Sadeh. 2021. A design space for privacy choices: Towards meaningful privacy control in the internet of things. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems. 1–16.
[24]
Sheera Frenkel and Cecilia Kang. 2021. An ugly truth: Inside Facebook’s battle for domination. Hachette UK.
[25]
Colin M Gray, Cristiana Santos, Nataliia Bielova, Michael Toth, and Damian Clifford. 2021. Dark patterns and the legal requirements of consent banners: An interaction criticism perspective. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems. 1–18.
[26]
Gabriel Grill. 2021. Future protest made risky: Examining social media based civil unrest prediction research and products. Computer Supported Cooperative Work (CSCW) 30, 5 (2021), 811–839.
[27]
Dorota Głowacka and Karolina Iwańska. 2021. Algorithms of trauma: new case study shows that Facebook doesn’t give users real control over disturbing surveillance ads. Retrieved December 9, 2022 from https://en.panoptykon.org/algorithms-of-trauma
[28]
Hana Habib and Lorrie Faith Cranor. 2022. Evaluating the usability of privacy choice mechanisms. In Eighteenth Symposium on Usable Privacy and Security (SOUPS 2022). 273–289.
[29]
Hana Habib, Sarah Pearman, Ellie Young, Ishika Saxena, Robert Zhang, and Lorrie FaIth Cranor. 2022. Identifying User Needs for Advertising Controls on Facebook. Proc. ACM Hum.-Comput. Interact. 6, CSCW1, Article 59 (apr 2022), 42 pages. https://doi.org/10.1145/3512906
[30]
Hana Habib, Yixin Zou, Aditi Jannu, Neha Sridhar, Chelse Swoopes, Alessandro Acquisti, Lorrie Faith Cranor, Norman Sadeh, and Florian Schaub. 2019. An Empirical Analysis of Data Deletion and {Opt-Out} Choices on 150 Websites. In Fifteenth Symposium on Usable Privacy and Security (SOUPS 2019). 387–406.
[31]
Hana Habib, Yixin Zou, Yaxing Yao, Alessandro Acquisti, Lorrie Cranor, Joel Reidenberg, Norman Sadeh, and Florian Schaub. 2021. Toggles, dollar signs, and triangles: How to (in) effectively convey privacy choices with icons and link texts. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems. 1–25.
[32]
Brittan Heller and Avi Bar-Zeev. 2021. The problems with immersive advertising: in AR/VR, nobody knows you are an ad. Journal of Online Trust and Safety 1, 1 (2021).
[33]
Anne Helmond, David B Nieborg, and Fernando N van der Vlist. 2017. The political economy of social data: a historical analysis of platform-industry partnerships. In Proceedings of the 8th international conference on social media & society. 1–5.
[34]
Henning Hohnhold, Deirdre O’Brien, and Diane Tang. 2015. Focusing on the long-term: It’s good for users and business. In Proceedings of the 21th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. 1849–1858.
[35]
Silas Hsu, Kristen Vaccaro, Yin Yue, Aimee Rickman, and Karrie Karahalios. 2020. Awareness, navigation, and use of feed control settings online. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. 1–13.
[36]
Jane Im, Jill Dimond, Melody Berton, Una Lee, Katherine Mustelier, Mark S. Ackerman, and Eric Gilbert. 2021. Yes: Affirmative Consent as a Theoretical Framework for Understanding and Imagining Social Platforms. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems (Yokohama, Japan) (CHI ’21). Association for Computing Machinery, New York, NY, USA, Article 403, 18 pages. https://doi.org/10.1145/3411764.3445778
[37]
Jane Im, Sonali Tandon, Eshwar Chandrasekharan, Taylor Denby, and Eric Gilbert. 2020. Synthesized Social Signals: Computationally-Derived Social Signals from Account Histories. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (Honolulu, HI, USA) (CHI ’20). Association for Computing Machinery, New York, NY, USA, 1–12. https://doi.org/10.1145/3313831.3376383
[38]
Network Advertising Initiative. 2022. NAI Consumer Opt Out. https://optout.networkadvertising.org/.
[39]
Yucheng Jin, Karsten Seipp, Erik Duval, and Katrien Verbert. 2016. Go with the flow: effects of transparency and user control on targeted advertising using flow charts. In Proceedings of the international working conference on advanced visual interfaces. 68–75.
[40]
Michael Kretschmer, Jan Pennekamp, and Klaus Wehrle. 2021. Cookie banners and privacy policies: Measuring the impact of the GDPR on the web. ACM Transactions on the Web (TWEB) 15, 4 (2021), 1–42.
[41]
Yabing Liu, Krishna P. Gummadi, Balachander Krishnamurthy, and Alan Mislove. 2011. Analyzing Facebook Privacy Settings: User Expectations vs. Reality. In Proceedings of the 2011 ACM SIGCOMM Conference on Internet Measurement Conference (Berlin, Germany) (IMC ’11). Association for Computing Machinery, New York, NY, USA, 61–70. https://doi.org/10.1145/2068816.2068823
[42]
Natasha Lomas. 2021. UK privacy watchdog warns adtech the end of tracking is nigh. https://techcrunch.com/2021/11/25/ico-adtech-reform-opinion/
[43]
Natasha Lomas. 2022. Give users genuine control over ad targeting, MEPs urged. https://techcrunch.com/2022/01/13/joint-statement-surveillance-ads-inferred-data/
[44]
Mary Madden, Michele Gilman, Karen Levy, and Alice Marwick. 2017. Privacy, poverty, and big data: A matrix of vulnerabilities for poor Americans. Wash. UL Rev. 95(2017), 53.
[45]
Miguel Malheiros, Charlene Jennett, Snehalee Patel, Sacha Brostoff, and Martina Angela Sasse. 2012. Too Close for Comfort: A Study of the Effectiveness and Acceptability of Rich-Media Personalized Advertising. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Austin, Texas, USA) (CHI ’12). Association for Computing Machinery, New York, NY, USA, 579–588. https://doi.org/10.1145/2207676.2207758
[46]
Aleecia McDonald and Lorrie Faith Cranor. 2010. Beliefs and behaviors: Internet users’ understanding of behavioral advertising. Tprc.
[47]
Aleecia M McDonald and Lorrie Faith Cranor. 2008. The cost of reading privacy policies. Isjlp 4(2008), 543.
[48]
Jakob Nielsen. 1995. How to conduct a heuristic evaluation. Nielsen Norman Group 1, 1 (1995), 8.
[49]
Helen Nissenbaum. 2011. A contextual approach to privacy online. Daedalus 140, 4 (2011), 32–48.
[50]
Midas Nouwens, Ilaria Liccardi, Michael Veale, David Karger, and Lalana Kagal. 2020. Dark patterns after the GDPR: Scraping consent pop-ups and demonstrating their influence. In Proceedings of the 2020 CHI conference on human factors in computing systems. 1–13.
[51]
Jonathan A Obar and Anne Oeldorf-Hirsch. 2020. The biggest lie on the internet: Ignoring the privacy policies and terms of service policies of social networking services. Information, Communication & Society 23, 1 (2020), 128–147.
[52]
Eugenia Politou, Efthimios Alepis, and Constantinos Patsakis. 2018. Forgetting personal data and revoking consent under the GDPR: Challenges and proposed solutions. Journal of Cybersecurity 4, 1 (2018), tyy001.
[53]
Emilee Rader. 2014. Awareness of behavioral tracking and information privacy concern in facebook and google. In 10th Symposium On Usable Privacy and Security (SOUPS 2014). 51–67.
[54]
Joel R Reidenberg, Travis Breaux, Lorrie Faith Cranor, Brian French, Amanda Grannis, James T Graves, Fei Liu, Aleecia McDonald, Thomas B Norton, and Rohan Ramanath. 2015. Disagreeable privacy policies: Mismatches between meaning and users’ understanding. Berkeley Tech. LJ 30(2015), 39.
[55]
Florian Schaub, Rebecca Balebako, and Lorrie Faith Cranor. 2017. Designing effective privacy notices and controls. IEEE Internet Computing 21, 3 (2017), 70–77.
[56]
Florian Schaub, Rebecca Balebako, Adam L Durity, and Lorrie Faith Cranor. 2015. A design space for effective privacy notices. In Eleventh symposium on usable privacy and security (SOUPS 2015). 1–17.
[57]
Florian Schaub and Lorrie Cranor. 2020. Usable and Useful Privacy Interfaces. IAPP.
[58]
Paul M Schwartz. 1999. Internet privacy and the state. Conn. L. Rev. 32(1999), 815.
[59]
Daniel J Solove. 2012. Introduction: Privacy self-management and the consent dilemma. Harv. L. Rev. 126(2012), 1880.
[60]
Michael Carl Tschantz, Serge Egelman, Jaeyoung Choi, Nicholas Weaver, and Gerald Friedland. 2018. The accuracy of the demographic inferences shown on Google’s Ad Settings. In Proceedings of the 2018 Workshop on Privacy in the Electronic Society. 33–41.
[61]
Blase Ur, Pedro Giovanni Leon, Lorrie Faith Cranor, Richard Shay, and Yang Wang. 2012. Smart, useful, scary, creepy: perceptions of online behavioral advertising. In proceedings of the eighth symposium on usable privacy and security. 1–15.
[62]
Fernando N Van der Vlist and Anne Helmond. 2021. How partners mediate platform power: Mapping business and data partnerships in the social media ecosystem. Big Data & Society 8, 1 (2021), 20539517211025061.
[63]
José Van Dijck, David Nieborg, and Thomas Poell. 2019. Reframing platform power. Internet Policy Review 8, 2 (2019), 1–18.
[64]
Ari Ezra Waldman. 2021. Industry unbound: The inside story of privacy, data, and corporate Power. Cambridge University Press.
[65]
Miranda Wei, Madison Stamos, Sophie Veys, Nathan Reitinger, Justin Goodman, Margot Herman, Dorota Filipczuk, Ben Weinshel, Michelle L Mazurek, and Blase Ur. 2020. What Twitter knows: Characterizing ad targeting practices, user perceptions, and ad explanations through users’ own Twitter data. In 29th USENIX Security Symposium (USENIX Security 20). 145–162.
[66]
Ben Weinshel, Miranda Wei, Mainack Mondal, Euirim Choi, Shawn Shan, Claire Dolin, Michelle L Mazurek, and Blase Ur. 2019. Oh, the places you’ve been! User reactions to longitudinal transparency about third-party web tracking and inferencing. In Proceedings of the 2019 ACM SIGSAC Conference on Computer and Communications Security. 149–166.
[67]
James Wilson and Daniel Rosenberg. 1988. Rapid prototyping for user interface design. Elsevier, 859–875.
[68]
Jacob O Wobbrock, Leah Findlater, Darren Gergle, and James J Higgins. 2011. The aligned rank transform for nonparametric factorial analyses using only anova procedures. In Proceedings of the SIGCHI conference on human factors in computing systems. 143–146.
[69]
Yaxing Yao, Davide Lo Re, and Yang Wang. 2017. Folk models of online behavioral advertising. In Proceedings of the 2017 ACM Conference on Computer Supported Cooperative Work and Social Computing. 1957–1969.
[70]
Mark Zuckerberg. 2019. The Facts About Facebook. https://www.wsj.com/articles/the-facts-about-facebook-11548374613

Cited By

View all
  • (2024)Folk Models of Loot Boxes in Video GamesProceedings of the ACM on Human-Computer Interaction10.1145/36770728:CHI PLAY(1-23)Online publication date: 15-Oct-2024
  • (2024)AccessShare: Co-designing Data Access and Sharing with Blind PeopleProceedings of the 26th International ACM SIGACCESS Conference on Computers and Accessibility10.1145/3663548.3675612(1-16)Online publication date: 27-Oct-2024
  • (2024)Exploring the Design of Generative AI in Supporting Music-based Reminiscence for Older AdultsProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642800(1-17)Online publication date: 11-May-2024
  • Show More Cited By

Index Terms

  1. Less is Not More: Improving Findability and Actionability of Privacy Controls for Online Behavioral Advertising

      Recommendations

      Comments

      Information & Contributors

      Information

      Published In

      cover image ACM Conferences
      CHI '23: Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems
      April 2023
      14911 pages
      ISBN:9781450394215
      DOI:10.1145/3544548
      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

      Sponsors

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      Published: 19 April 2023

      Permissions

      Request permissions for this article.

      Check for updates

      Author Tags

      1. Privacy
      2. ad settings
      3. advertising
      4. consent.
      5. social media
      6. social platforms
      7. usability
      8. user interface

      Qualifiers

      • Research-article
      • Research
      • Refereed limited

      Conference

      CHI '23
      Sponsor:

      Acceptance Rates

      Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

      Contributors

      Other Metrics

      Bibliometrics & Citations

      Bibliometrics

      Article Metrics

      • Downloads (Last 12 months)592
      • Downloads (Last 6 weeks)83
      Reflects downloads up to 22 Oct 2024

      Other Metrics

      Citations

      Cited By

      View all
      • (2024)Folk Models of Loot Boxes in Video GamesProceedings of the ACM on Human-Computer Interaction10.1145/36770728:CHI PLAY(1-23)Online publication date: 15-Oct-2024
      • (2024)AccessShare: Co-designing Data Access and Sharing with Blind PeopleProceedings of the 26th International ACM SIGACCESS Conference on Computers and Accessibility10.1145/3663548.3675612(1-16)Online publication date: 27-Oct-2024
      • (2024)Exploring the Design of Generative AI in Supporting Music-based Reminiscence for Older AdultsProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642800(1-17)Online publication date: 11-May-2024
      • (2024)Measuring Compliance with the California Consumer Privacy Act Over Space and TimeProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642597(1-19)Online publication date: 11-May-2024
      • (2024)Demo Abstract: PriviFy: Designing Tangible Interfaces for IoT Privacy Configuration2024 IEEE/ACM Ninth International Conference on Internet-of-Things Design and Implementation (IoTDI)10.1109/IoTDI61053.2024.00024(217-218)Online publication date: 13-May-2024
      • (2023)Problematic advertising and its disparate exposure on facebookProceedings of the 32nd USENIX Conference on Security Symposium10.5555/3620237.3620554(5665-5682)Online publication date: 9-Aug-2023

      View Options

      Get Access

      Login options

      View options

      PDF

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader

      Full Text

      View this article in Full Text.

      Full Text

      HTML Format

      View this article in HTML Format.

      HTML Format

      Media

      Figures

      Other

      Tables

      Share

      Share

      Share this Publication link

      Share on social media