Recommendations
Evidence does not support the use of informational documentaries.
Interventions that change intended eating habits may not result in actual change in eating habits. In our study, even very large changes in intention did not change actual behavior.
Future studies should ensure that participants are unaware of the study’s purpose. They can do this with blinding.
Key Findings
Tested a 20-minute documentary “Good For Us” that highlights the environmental, human health and animal welfare harms of eating meat and other animal products.
In a randomized controlled experiment, compared the documentary to a control video (a generic motivational speech). Participants were from the general population of the United States.
Followed up 12 days later with a survey that was described as a different study. This helped to “blind” participants to the purpose of the study when collecting data, reducing potential bias.
Our first study found the documentary had no effect on a variety of different outcomes.
Found no reduction in animal product consumption. The average change we measured in one study was less than a 1-ounce reduction in animal product consumption per week, with a 95% confidence interval ranging from a 6 ounce reduction to a 5 ounce increase.
Found no change in moral valuation of animals (“speciesism”).
Found no meaningful increases in interest in animal activism or in perceived importance of environmental sustainability, animal welfare, or eating a healthful diet.
Our second study was deliberately designed less rigorously, to resemble previous studies that measured intended behavior. Immediately after the documentary, asked viewers if they planned to eat more or less animal products next week. Many viewers planned to eat less animal products in the week after seeing the documentary.
Documentary made viewers 242% more likely to intend to reduce meat consumption than participants who viewed the control video. Critically, our first study suggested that these intentions do not actually translate to reductions in consumption.
A previous meta-analysis suggested that comparable interventions make people about 22% more likely to intend to reduce their meat consumption. So our documentary was likely very convincing relative to other interventions, but still not effective at reducing consumption in our more rigorously-designed study.
Our third study tried to make the documentary more effective. Added a pledge, goal-setting exercises, and reminder email; and participants were people interested in nutrition research. The documentary still was not effective by any measurement. Also looked at just people who attended at least a 2-year college and identified as Democrats, but still no effect.
Abstract
Several societal issues could be mitigated by reducing global consumption of meat and animal products (MAP). In three randomized, controlled experiments (n= 217 to 574), we evaluated the effects of a documentary that presents health, environmental, and animal welfare motivations for reducing MAP consumption. Study 1 assessed the documentary’s effectiveness at reducing reported MAP consumption after 12 days. This study used methodological innovations to minimize social desirability bias, a widespread limitation of past research. Study 2 investigated discrepancies between the results of Study 1 and those of previous studies by further examining the role of social desirability bias. Study 3 assessed the documentary’s effectiveness in a new population anticipated to be more responsive and upon enhancing the intervention content. We found that the documentary did not decrease reported MAP consumption when potential social desirability bias was minimized (Studies 1 and 3). The documentary also did not affect consumption among participants whose demographics suggested they might be more receptive (Study 3). However, the documentary did substantially increase intentions to reduce consumption, consistent with past studies (Studies 2 and 3). Overall, we conclude that some past studies of similar interventions may have overestimated effects due to methodological biases. Novel intervention strategies to reduce MAP consumption may be needed.
1. Introduction
Developing simple interventions to encourage dietary shifts from MAP to healthy plant-based foods could therefore carry widespread societal benefits. Educational interventions that make appeals to individual health [10,16], the environment [10,16], or animal welfare [16,17] may be effective. More subtle “nudge” interventions that may operate outside participants’ conscious awareness, for example by repositioning meat dishes to be less prominent in cafeterias, may also be effective [16,18]. Although these types of interventions are promising, many existing studies have methodological limitations [17]. These include the potential for social desirability bias that could artificially inflate apparent intervention effects [19], measurement of outcomes only in terms of participants’ attitudes or intended behavior rather than actual MAP consumption, and small sample sizes. As a result, we are aware of very few specific interventions that are adequately well-evidenced to strongly support their widespread dissemination at this point.
We conducted a series of parallel-group, randomized controlled experiments designed to help resolve these methodological challenges of previous studies. Namely, our studies took stringent precautions against social desirability bias, used longitudinal designs, and measured food consumption outcomes using food frequency questionnaires. The intervention was a 20-min documentary that encourages dietary shifts from all meats and animal products to plant-based diets. We selected this documentary because its content reflects certain best practices for designing effective interventions in general, and its content also harnesses the specific psychology of MAP consumption [17]. In general, providing educational information can influence beliefs and intentions that may subsequently shape behavior [20]. The public appears to be poorly informed about the aforementioned consequences of global MAP consumption; in fact, many individuals appear to deliberately avoid such information [21]. Thus, providing information that helps remedy this knowledge gap may be effective. Additionally, portraying the desired behavior as aligning with social norms (what others believe one should do, or what others actually do) can effectively shift behaviors, including food choices [22,23]. Providing concrete suggestions for how to change one’s behavior (e.g., recipes) may help individuals to form concrete implementation intentions for what they plan to do when faced with food choices [24]. According to the Theory of Planned Behavior, providing such suggestions may increase individuals’ perceived ability to control their future behavior and their intentions to do so [20]. Indeed, previous interventions to reduce consumption of meat and/or animal products that invoked these components have obtained preliminarily promising results. Such interventions have included, for example, providing leaflets, news articles, and videos [17,25,26,27].
In addition to leveraging these general components of effective behavioral interventions, the documentary we studied was designed to also harness the unique social, moral, and affective psychology underlying MAP consumption [28,29]. For example, although ethical concern about factory farming conditions is now a majority stance in several developed countries [30], MAP consumption remains nearly universal. This discrepancy between people’s ethical views and their actual behavior, termed the “meat paradox” [31], can induce cognitive dissonance. Previous interventions have successfully invoked this dissonance by using meat-animal reminders, which are simple visual or verbal reminders of the connection between MAP and animals (e.g., photographs of meat dishes presented next to photographs of the animals from which they came) [32,33,34,35,36,37]. Last, physical disgust and moral disgust are closely intertwined and powerfully shape food choices [38,39]. Experiencing physical disgust can amplify negative moral judgments, and conversely, experiencing moral disgust can induce physical disgust [40]. Previous interventions to reduce consumption of meat and/or animal products have often invoked disgust by describing, for example, “crowded conditions [and] pens covered in excrement and germs” [41]. We also selected this documentary because it has been disseminated in practice via social media advertising by a nonprofit, The Humane League. For example, in 2019, the nonprofit’s advertising generated 13 million visits to websites deploying documentary-driven interventions, including this documentary, resulting in 8 million minutes of viewing.
In Study 1, we aimed to assess the documentary’s effectiveness using a study design that improved upon certain methodological limitations of previous work, described above. In Study 2, we aimed to adjudicate discrepancies between the results of Study 1 and those of previous studies by further examining the role of social desirability bias. In Study 3, we aimed to assess the documentary’s effectiveness in a different population and upon adding new components to the intervention, which were designed to increase participant engagement. To this end, in Studies 1 and 3, our primary outcome was participants’ total MAP consumption over the past week (henceforth “consumption”), reported approximately 2 weeks after random assignment and exposure to the documentary. In both studies, we secondarily assessed consumption of specific categories of MAP as well as consumption of healthy plant-based foods. We also assessed the extent to which the intervention’s effects might differ by participants’ demographic characteristics; such findings could be used to cost-effectively target dissemination. For example, previous work has suggested that sex, education, and political liberalism could moderate the effectiveness of interventions to reduce consumption of meat and/or animal products [42,43,44,45]. Studies 1 and 3 took stringent precautions against social desirability bias. In Study 2, to further examine the potential for social desirability bias, our primary outcome was participants’ immediate intentions to increase, decrease, or not change their consumption, similar to many existing studies in the literature.
2. Study 1
2.1. Methods
2.1.1. Study Design and Participants
2.1.2. Intervention Documentary and Control Video
2.1.3. Outcomes
2.1.4. Other Measures
2.1.5. Statistical Analyses
Analysis of Primary and Secondary Outcomes
Analysis of Moderators
Sensitivity Analyses
2.2. Results
2.2.1. Participant Characteristics
2.2.2. Attention Check and Awareness of Study’s Purpose
2.2.3. Effect of the Documentary on Outcomes
2.2.4. Moderators
2.2.5. Sensitivity Analyses
2.3. Discussion
3. Study 2
3.1. Methods
3.1.1. Study Design and Participants
3.1.2. Statistical Analyses
3.2. Results
3.3. Discussion
4. Study 3
4.1. Methods
4.1.1. Study Design and Participants
4.1.2. Intervention
4.1.3. Outcome Measures
4.1.4. Statistical Analyses
4.2. Results
4.2.1. Participant Characteristics
4.2.2. Attention Check and Awareness of Study’s Purpose
4.2.3. Effect of the Documentary on Outcomes
4.2.4. Effect of the Documentary among Participants with Target Demographics
4.2.5. Intervention Engagement Items
4.2.6. Sensitivity Analyses
4.3. Discussion
5. General Discussion
5.1. Strengths and Limitations
5.2. Future Directions
Supplementary Materials
Author Contributions
Funding
Institutional Review Board Statement
Informed Consent Statement
Data Availability Statement
Acknowledgments
Conflicts of Interest
References
- Willett, W.; Rockström, J.; Loken, B.; Springmann, M.; Lang, T.; Vermeulen, S.; Garnett, T.; Tilman, D.; DeClerck, F.; Wood, A.; et al. Food in the Anthropocene: The EAT–Lancet Commission on healthy diets from sustainable food systems. Lancet 2019, 393, 447–492. [Google Scholar] [CrossRef]
- Swinburn, B.A.; Kraak, V.I.; Allender, S.; Atkins, V.J.; Baker, P.I.; Bogard, J.R.; Brinsden, H.; Calvillo, A.; De Schutter, O.; Devarajan, R.; et al. The global syndemic of obesity, undernutrition, and climate change: The Lancet Commission report. Lancet 2019, 393, 791–846. [Google Scholar] [CrossRef]
- Gardner, C.D.; Hartle, J.C.; Garrett, R.D.; Offringa, L.C.; Wasserman, A.S. Maximizing the intersection of human health and the health of the environment with regard to the amount and type of protein produced and consumed in the United States. Nutr. Rev. 2019, 77, 197–215. [Google Scholar] [CrossRef]
- Godfray, H.C.J.; Aveyard, P.; Garnett, T.; Hall, J.W.; Key, T.J.; Lorimer, J.; Pierrehumbert, R.T.; Scarborough, P.; Springmann, M.; Jebb, S.A. Meat consumption, health, and the environment. Science 2018, 361, eaam5324. [Google Scholar] [CrossRef] [PubMed]
- Tilman, D.; Clark, M. Global diets link environmental sustainability and human health. Nature 2014, 515, 518–522. [Google Scholar] [CrossRef]
- Scherer, L.; Behrens, P.; Tukker, A. Opportunity for a Dietary Win-Win-Win in Nutrition, Environment, and Animal Welfare. One Earth 2019, 1, 349–360. [Google Scholar] [CrossRef]
- Di Marco, M.; Baker, M.L.; Daszak, P.; De Barro, P.; Eskew, E.A.; Godde, C.M.; Harwood, T.D.; Herrero, M.; Hoskins, A.J.; Johnson, E.; et al. Opinion: Sustainable development must account for pandemic risk. Proc. Natl. Acad. Sci. USA 2020, 117, 3888–3892. [Google Scholar] [CrossRef]
- Intergovernmental Panel on Climate Change. Climate Change 2021: The Physical Science Basis. Contribution of Working Group I to the Sixth Assessment Report of the Intergovernmental Panel on Climate Change. Technical Report. 2021. Available online: https://www.ipcc.ch/report/ar6/wg1/downloads/report/IPCC_AR6_WGI_Full_Report.pdf (accessed on 9 June 2021).
- Bonnet, C.; Bouamra-Mechemache, Z.; Réquillart, V.; Treich, N. Viewpoint: Regulating meat consumption to improve health, the environment and animal welfare. Food Policy 2020, 97, 101847. [Google Scholar] [CrossRef]
- Bianchi, F.; Dorsel, C.; Garnett, E.; Aveyard, P.; Jebb, S.A. Interventions targeting conscious determinants of human behaviour to reduce the demand for meat: A systematic review with qualitative comparative analysis. Int. J. Behav. Nutr. Phys. Activ. 2018, 15, 102. [Google Scholar] [CrossRef] [PubMed]
- Lim, S.S.; Vos, T.; Flaxman, A.D.; Danaei, G.; Shibuya, K.; Adair-Rohani, H.; AlMazroa, M.A.; Amann, M.; Anderson, H.R.; Andrews, K.G.; et al. A comparative risk assessment of burden of disease and injury attributable to 67 risk factors and risk factor clusters in 21 regions, 1990–2010: A systematic analysis for the Global Burden of Disease Study 2010. Lancet 2012, 380, 2224–2260. [Google Scholar] [CrossRef]
- Singh, P.N.; Sabaté, J.; Fraser, G.E. Does low meat consumption increase life expectancy in humans? Am. J. Clin. Nutr. 2003, 78, 526S–532S. [Google Scholar] [CrossRef]
- Gerber, P.; Opio, C.; Steinfeld, H. Poultry Production and the Environment—A Review. Technical Report, Animal Production and Health Division, Food and Agriculture Organization of the United Nations. 2007. Available online: http://www.fao.org/ag/againfo/home/events/bangkok2007/docs/part2/2_2.pdf (accessed on 1 December 2020).
- United Nations General Assembly. The Impacts of Fishing on Vulnerable Marine Ecosystems: Actions Taken by States and Regional Fisheries Management Organizations and Arrangements to Give Effect to Paragraphs 66 to 69 of General Assembly Resolution 59/25 on Sustainable Fisheries, Regarding the Impacts of Fishing on Vulnerable Marine Ecosystems. Technical Report, United Nations. 2016. Available online: https://www.un.org/Depts/los/general_assembly/documents/impact_of_fishing.pdf (accessed on 1 December 2020).
- Scheffer, M.; Carpenter, S.; de Young, B. Cascading effects of overfishing marine systems. Trends Ecol. Evolut. 2005, 20, 579–581. [Google Scholar] [CrossRef]
- Grundy, E.; Slattery, P.; Saeri, A.K.; Watkins, K.; Houlden, T.; Farr, N.; Askin, H.; Lee, J.; Mintoft-Jones, A.; Cyna, S.; et al. Interventions that Influence Animal-Product Consumption: A Meta-Review. Future Foods. in press. Available online: https://osf.io/mcdsq/ (accessed on 1 December 2020).
- Mathur, M.B.; Peacock, J.; Reichling, D.B.; Nadler, J.; Bain, P.A.; Gardner, C.D.; Robinson, T.N. Interventions to reduce meat consumption by appealing to animal welfare: Meta-analysis and evidence-based recommendations. Appetite 2021, 164, 105277. [Google Scholar] [CrossRef]
- Bianchi, F.; Garnett, E.; Dorsel, C.; Aveyard, P.; Jebb, S.A. Restructuring physical micro-environments to reduce the demand for meat: A systematic review and qualitative comparative analysis. Lancet Planetary Health 2018, 2, e384–e397. [Google Scholar] [CrossRef]
- Hebert, J.R.; Clemow, L.; Pbert, L.; Ockene, I.S.; Ockene, J.K. Social desirability bias in dietary self-report may compromise the validity of dietary intake measures. Int. J. Epidemiol. 1995, 24, 389–398. [Google Scholar] [CrossRef]
- Ajzen, I. The theory of planned behavior. Organ. Behav. Human Dec. Process. 1991, 50, 179–211. [Google Scholar] [CrossRef]
- Onwezen, M.C.; van der Weele, C.N. When indifference is ambivalence: Strategic ignorance about meat consumption. Food Qual. Prefer. 2016, 52, 96–105. [Google Scholar] [CrossRef]
- Schultz, P.W.; Nolan, J.M.; Cialdini, R.B.; Goldstein, N.J.; Griskevicius, V. The constructive, destructive, and reconstructive power of social norms. Psychol. Sci. 2007, 18, 429–434. [Google Scholar] [CrossRef] [PubMed]
- Higgs, S. Social norms and their influence on eating behaviours. Appetite 2015, 86, 38–44. [Google Scholar] [CrossRef]
- Adriaanse, M.A.; Vinkers, C.D.; De Ridder, D.T.; Hox, J.J.; De Wit, J.B. Do implementation intentions help to eat a healthy diet? A systematic review and meta-analysis of the empirical evidence. Appetite 2011, 56, 183–193. [Google Scholar] [CrossRef] [PubMed]
- Amiot, C.E.; Boutros, G.E.H.; Sukhanova, K.; Karelis, A.D. Testing a novel multicomponent intervention to reduce meat consumption in young men. PLoS ONE 2018, 13, e0204590. [Google Scholar] [CrossRef]
- Macdonald, B.; Caldwell, K.; Boese, G. The Effects of ’Reduce’ and ’Eliminate’ Appeals on Individual Meat Consumption. Technical Report, Reducetarian Foundation. 2016. Available online: https://osf.io/nxrx3/ (accessed on 1 December 2020).
- Novatná, A. The Influence of Movie on Behavioral Change in Individual Meat and Dairy Products Consumption. Bachelor’s Thesis, Masaryk University, Brno, Czech Republic, 2019. (Unpublished). Available online: https://is.muni.cz/th/cfyr2/Novotna_bakalarska_prace.pdf (accessed on 1 December 2020).
- Loughnan, S.; Bastian, B.; Haslam, N. The psychology of eating animals. Curr. Direct. Psychol. Sci. 2014, 23, 104–108. [Google Scholar] [CrossRef]
- Rozin, P. Towards a psychology of food and eating: From motivation to module to model to marker, morality, meaning, and metaphor. Curr. Direct. Psychol. Sci. 1996, 5, 18–24. [Google Scholar] [CrossRef]
- Cornish, A.; Raubenheimer, D.; McGreevy, P. What we know about the public’s level of concern for farm animal welfare in food production in developed countries. Animals 2016, 6, 74. [Google Scholar] [CrossRef]
- Bastian, B.; Loughnan, S. Resolving the meat-paradox: A motivational account of morally troublesome behavior and its maintenance. Person. Soc. Psychol. Rev. 2017, 21, 278–299. [Google Scholar] [CrossRef]
- Kunst, J.R.; Hohle, S.M. Meat eaters by dissociation: How we present, prepare and talk about meat increases willingness to eat meat by reducing empathy and disgust. Appetite 2016, 105, 758–774. [Google Scholar] [CrossRef]
- Kunst, J.R.; Haugestad, C.A.P. The effects of dissociation on willingness to eat meat are moderated by exposure to unprocessed meat: A cross-cultural demonstration. Appetite 2018, 120, 356–366. [Google Scholar] [CrossRef]
- Earle, M.; Hodson, G.; Dhont, K.; MacInnis, C. Eating with our eyes (closed): Effects of visually associating animals with meat on antivegan/vegetarian attitudes and meat consumption willingness. Group Process. Intergroup Relat. 2019, 22, 1–18. [Google Scholar] [CrossRef]
- Tian, Q.; Hilton, D.; Becker, M. Confronting the meat paradox in different cultural contexts: Reactions among Chinese and French participants. Appetite 2016, 96, 187–194. [Google Scholar] [CrossRef]
- da Silva, C.R. Am I too Cute to Eat? The Effect of Cuteness Appeal towards the Promotion of a More Plant-Based Diet. Master’s Thesis, University Institute of Lisbon, Lisbo, Portugal, 2016. Available online: http://hdl.handle.net/10071/12583 (accessed on 1 December 2020).
- Lackner, Z. The Effect of Dissociation between Meat and Animal on the Experience of Ambivalence Towards Meat; Université de Grenoble Alpes: Saint-Martin-d’Hé res, France, 2019. [Google Scholar]
- Rozin, P.; Fallon, A. The psychological categorization of foods and non-foods: A preliminary taxonomy of food rejections. Appetite 1980, 1, 193–201. [Google Scholar] [CrossRef]
- Feinberg, M.; Kovacheff, C.; Teper, R.; Inbar, Y. Understanding the process of moralization: How eating meat becomes a moral issue. J. Personal. Soc. Psychol. 2019, 117, 50–72. [Google Scholar] [CrossRef]
- Chapman, H.A.; Anderson, A.K. Things rank and gross in nature: A review and synthesis of moral disgust. Psychol. Bull. 2013, 139, 300. [Google Scholar] [CrossRef]
- Cordts, A.; Nitzko, S.; Spiller, A. Consumer response to negative information on meat consumption in Germany. Int. Food Agribusiness Manag. Rev. 2014, 17, 83–106. [Google Scholar]
- Ruby, M.B. Vegetarianism. A blossoming field of study. Appetite 2012, 58, 141–150. [Google Scholar] [CrossRef]
- Rothgerber, H. Meat-related cognitive dissonance: A conceptual framework for understanding how meat eaters reduce negative arousal from eating animals. Appetite 2020, 146, 104511. [Google Scholar] [CrossRef]
- Graça, J.; Godinho, C.A.; Truninger, M. Reducing meat consumption and following plant-based diets: Current evidence and future directions to inform integrated transitions. Trends Food Sci. Technol. 2019, 91, 380–390. [Google Scholar] [CrossRef]
- Sparkman, G.; Macdonald, B.N.; Caldwell, K.D.; Kateman, B.; Boese, G.D. Cut back or give it up? The effectiveness of reduce and eliminate appeals and dynamic norm messaging to curb meat consumption. J. Environ. Psychol. 2021, 75, 101592. [Google Scholar] [CrossRef]
- R Core Team. R: A Language and Environment for Statistical Computing; R Foundation for Statistical Computing: Vienna, Austria, 2019. [Google Scholar]
- Qualtrics Provo UT. Qualtrics XM Platform. 2020. Available online: https://www.qualtrics.com/blog/citing-qualtrics/ (accessed on 1 December 2020).
- Prolific London UK. Prolific Academic. 2020. Available online: https://prolific.co/ (accessed on 1 December 2020).
- Peer, E.; Brandimarte, L.; Samat, S.; Acquisti, A. Beyond the Turk: Alternative platforms for crowdsourcing behavioral research. J. Exp. Soc. Psychol. 2017, 70, 153–163. [Google Scholar] [CrossRef]
- Chandler, J.; Shapiro, D. Conducting clinical research using crowdsourced convenience samples. Ann. Rev. Clin. Psychol. 2016, 12, 53–81. [Google Scholar] [CrossRef]
- The Humane League. Good For Us. 2020. Available online: https://www.youtube.com/watch?v=Bxhx-fIDdwc (accessed on 1 December 2020).
- Diet History Questionnaire III (DHQ III). Technical Report, National Cancer Institute; 2018. Available online: https://epi.grants.cancer.gov/dhq3/ (accessed on 1 December 2020).
- Thompson, F.E.; Subar, A.F.; Brown, C.C.; Smith, A.F.; Sharbaugh, C.O.; Jobe, J.B.; Mittl, B.; Gibson, J.T.; Ziegler, R.G. Cognitive research enhances accuracy of food frequency questionnaire reports: Results of an experimental validation study. J. Am. Diet. Associat. 2002, 102, 212–225. [Google Scholar] [CrossRef]
- Millen, A.E.; Midthune, D.; Thompson, F.E.; Kipnis, V.; Subar, A.F. The National Cancer Institute diet history questionnaire: Validation of pyramid food servings. Am. J. Epidemiol. 2006, 163, 279–288. [Google Scholar] [CrossRef]
- Hekler, E.B.; Gardner, C.D.; Robinson, T.N. Effects of a college course about food and society on students’ eating behaviors. Am. J. Prevent. Med. 2010, 38, 543–547. [Google Scholar] [CrossRef]
- Stapleton, J.H. Linear Statistical Models; John Wiley & Sons: Hoboken, NJ, USA, 2009; Volume 719. [Google Scholar]
- Fagerland, M.W. t-tests, non-parametric tests, and large studies—a paradox of statistical practice? BMC Med. Res. Methodol. 2012, 12, 78. [Google Scholar] [CrossRef]
- Dunnett, C.W. A multiple comparison procedure for comparing several treatments with a control. J. Am. Stat. Associat. 1955, 50, 1096–1121. [Google Scholar] [CrossRef]
- Wilson, D.J. The harmonic mean p-value for combining dependent tests. Proc. Natl. Acad. Sci. USA 2019, 116, 1195–1200. [Google Scholar] [CrossRef]
- VanderWeele, T.J.; Mathur, M.B.; Chen, Y. Outcome-wide longitudinal designs for causal inference: A new template for empirical studies. Stat. Sci. 2020, 35, 437–466. [Google Scholar] [CrossRef]
- VanderWeele, T.J.; Mathur, M.B. Some desirable properties of the Bonferroni correction: Is the Bonferroni correction really so bad? Am. J. Epidemiol. 2019, 188, 617–618. [Google Scholar] [CrossRef]
- Buuren, S.V.; Groothuis-Oudshoorn, K. Mice: Multivariate imputation by chained equations in R. J. Stat. Softw. 2010, 45, 1–68. [Google Scholar] [CrossRef]
- Van Buuren, S. Flexible Imputation of Missing Data; CRC Press: Boca Raton, FL, USA, 2018. [Google Scholar]
- Angrist, J.D.; Imbens, G.W.; Rubin, D.B. Identification of causal effects using instrumental variables. J. Am. Stat. Assoc. 1996, 91, 444–455. [Google Scholar] [CrossRef]
- United States Census Bureau. American Community Survey 1-Year Estimates. 2019. Retrieved from Census Reporter Profile Page for United States. Available online: http://censusreporter.org/profiles/01000US-united-states (accessed on 9 June 2021).
- van’t Riet, J.; Sijtsema, S.J.; Dagevos, H.; De Bruijn, G.J. The importance of habits in eating behaviour. An overview and recommendations for future research. Appetite 2011, 57, 585–596. [Google Scholar] [CrossRef]
- Reese, J. Testing the Effectiveness of Animal Advocacy Messages with Amazon Mechanical Turk. Technical Report, The Sentience Institute. 2015. Available online: https://jacyreese.com/assets/downloads/Testing_the_Effectiveness.pdf (accessed on 1 December 2020).
- Caldwell, K. Welfare Reforms and Meat Consumption. Technical Report, Mercy for Animals. 2016. Available online: https://mercyforanimals.org/welfare-reforms-survey (accessed on 1 December 2020).
- Palomo-Vélez, G.; Tybur, J.M.; van Vugt, M. Unsustainable, unhealthy, or disgusting? Comparing different persuasive messages against meat consumption. J. Environ. Psychol. 2018, 58, 63–71. [Google Scholar] [CrossRef]
- Anderson, J. “Reduce” or “Go Veg?”: Effects on Meal Choice. Technical Report, Faunalytics. 2020. Available online: https://faunalytics.org/reduce-or-go-veg/ (accessed on 1 December 2020).
- Sparkman, G.; Weitz, E.; Robinson, T.N.; Malhotra, N.; Walton, G.M. Developing a scalable dynamic norm menu-based intervention to reduce meat consumption. Sustainability 2020, 12, 2453. [Google Scholar] [CrossRef]
- Michie, S.; Abraham, C.; Whittington, C.; McAteer, J.; Gupta, S. Effective techniques in healthy eating and physical activity interventions: A meta-regression. Health Psychol. 2009, 28, 690. [Google Scholar] [CrossRef]
- Kahan, B.C.; Morris, T.P. Improper analysis of trials randomised using stratified blocks or minimisation. Stat. Med. 2012, 31, 328–340. [Google Scholar] [CrossRef] [PubMed]
- Funder, D.C.; Ozer, D.J. Evaluating effect size in psychological research: Sense and nonsense. Adv. Methods Pract. Psychol. Sci. 2019, 2, 156–168. [Google Scholar] [CrossRef]
- Peacock, J. Measuring Change in Diet for Animal Advocacy. Technical Report, The Humane League Labs. 2018. Available online: https://thehumaneleague.org/article/E009R01-measuring-diet-animal-advocacy (accessed on 1 December 2020).
- Freedman, L.S.; Commins, J.M.; Moler, J.E.; Arab, L.; Baer, D.J.; Kipnis, V.; Midthune, D.; Moshfegh, A.J.; Neuhouser, M.L.; Prentice, R.L.; et al. Pooled results from 5 validation studies of dietary self-report instruments using recovery biomarkers for energy and protein intake. Am. J. Epidemiol. 2014, 180, 172–188. [Google Scholar] [CrossRef]
- Piernas, C.; Cook, B.; Stevens, R.; Stewart, C.; Hollowell, J.; Scarborough, P.; Jebb, S.A. Estimating the effect of moving meat-free products to the meat aisle on sales of meat and meat-free products: A non-randomised controlled intervention study in a large UK supermarket chain. PLoS Med. 2021, 18, e1003715. [Google Scholar] [CrossRef]
For Study 1, demographic characteristics of the 649 participants at baseline. Continuous variables are reported as medians with 25th and 75th percentiles. Binary variables are reported as counts and percentages. Subjects could indicate multiple races. “County liberalism”: in the subject’s county, the proportion of votes from the 2000–2016 United States presidential elections that went to the Democratic candidate.
Characteristic | Intervention (n = 327) | Control (n = 322) |
---|---|---|
Sex | ||
Male | 164 (50%) | 178 (55%) |
Female | 158 (48%) | 140 (43%) |
Other | 5 (2%) | 4 (1%) |
Age (years) | 30 (24, 41) | 32 (23, 41) |
Education | ||
Did not graduate high school | 0 (0%) | 2 (1%) |
Graduated high school | 102 (31%) | 103 (32%) |
Graduated 2-year college | 36 (11%) | 28 (9%) |
Graduated 4-year college | 116 (35%) | 119 (37%) |
Completed post-graduate degree | 73 (22%) | 70 (22%) |
Political party | ||
Democrat | 149 (46%) | 171 (53%) |
Republican | 82 (25%) | 76 (24%) |
Independent | 78 (24%) | 61 (19%) |
Other/I don’t know | 18 (6%) | 14 (4%) |
County liberalism | 0.57 (0.45, 0.70) | 0.55 (0.43, 0.70) |
Race | ||
Caucasian | 242 (74%) | 229 (71%) |
Black/African American | 32 (10%) | 25 (8%) |
Hispanic | 26 (8%) | 30 (9%) |
East Asian | 24 (7%) | 30 (9%) |
Southeast Asian | 9 (3%) | 13 (4%) |
South Asian | 12 (4%) | 11 (3%) |
Native American | 8 (2%) | 9 (3%) |
Middle Eastern | 2 (1%) | 6 (2%) |
Pacific Islander | 3 (1%) | 3 (1%) |
In Study 1, estimated intervention effects for the primary outcome, secondary food outcomes, and exploratory attitude outcomes. Raw mean differences represent ounces consumed over the past week for the primary outcome and secondary food outcomes; they represent units on a 7-point Likert scale for the perceived importance items; and they are omitted for the three composite scales, which were already standardized. Brackets are 95% confidence intervals without correcting for multiple testing.
Outcome | Raw Mean Difference | Standardized Mean Difference | p-Value | Bonferroni p-Value |
---|---|---|---|---|
Primary outcome | ||||
Total meat and animal products | −0.33 (−6.12, 5.46) | −0.01 (−0.17, 0.15) | 0.91 | |
Secondary food outcomes | ||||
Meat | −1.14 (−5.25, 2.97) | −0.04 (−0.2, 0.11) | 0.59 | 1 |
Non-meat animal products | 0.82 (−2.43, 4.07) | 0.04 (−0.13, 0.21) | 0.62 | 1 |
Chicken | −0.01 (−1.98, 1.97) | 0.00 (−0.16, 0.16) | 1 | 1 |
Turkey | −0.5 (−1.42, 0.41) | −0.09 (−0.26, 0.08) | 0.28 | 1 |
Fish | 0.00 (−1.03, 1.04) | 0.00 (−0.16, 0.16) | 1 | 1 |
Pork | −0.1 (−0.98, 0.78) | −0.02 (−0.18, 0.14) | 0.82 | 1 |
Beef | −0.39 (−1.62, 0.84) | −0.05 (−0.21, 0.11) | 0.53 | 1 |
Other meat | −0.16 (−0.95, 0.64) | −0.03 (−0.19, 0.13) | 0.7 | 1 |
Dairy | 1.09 (−1.72, 3.9) | 0.07 (−0.11, 0.24) | 0.45 | 1 |
Eggs | −0.27 (−1.63, 1.09) | −0.03 (−0.19, 0.13) | 0.7 | 1 |
Healthy plant foods | 1.72 (−4.88, 8.31) | 0.04 (−0.12, 0.2) | 0.61 | 1 |
Exploratory attitude outcomes | ||||
Importance of health | 0.10 (−0.10, 0.30) | 0.08 (−0.08, 0.24) | 0.34 | 1 |
Importance of environment | 0.06 (−0.16, 0.29) | 0.05 (−0.12, 0.21) | 0.57 | 1 |
Importance of animal welfare | 0.18 (−0.04, 0.39) | 0.13 (−0.03, 0.29) | 0.12 | 1 |
Interest in activism | 0.17 (0.01, 0.33) | 0.04 | 0.64 | |
Speciesism | −0.08 (−0.24, 0.09) | 0.36 | 1 | |
Social dominance orientation | −0.03 (−0.2, 0.13) | 0.68 | 1 |
For Study 1, estimated moderation by baseline demographic variables of the intervention’s effect on the primary outcome (total MAP consumption). Raw mean differences represent ounces consumed over the past week. Main effects represent differences in average consumption by the demographic variables. Effect modification estimates represent differences in intervention effectiveness for each demographic variable, with negative values representing greater effectiveness (i.e., greater reductions in consumption). Brackets are 95% confidence intervals that do not correct for multiple testing. “Politically neutral”: Independent or “Other/I don’t know”. “County liberalism” represents a 10-percentage point higher proportion of votes cast for Democratic presidential candidates in the participant’s county.
Coefficient | Raw Mean Difference | Standardized Mean Difference | p-Value | Bonferroni p-Value |
---|---|---|---|---|
Main effects | ||||
Intercept | 51.2 (28.99, 73.41) | 1.42 (0.8, 2.04) | <0.0001 | |
Intervention (vs. control) | 16.96 (−12.2, 46.13) | 0.47 (−0.34, 1.28) | 0.25 | |
Female | −9 (−19.08, 1.08) | −0.25 (−0.53, 0.03) | 0.08 | |
Age years ≤25 | 1.71 (−7.13, 10.55) | 0.05 (−0.2, 0.29) | 0.7 | |
At least 2-year college | 2.66 (−5.97, 11.28) | 0.07 (−0.17, 0.31) | 0.54 | |
Caucasian | 5.66 (−2.67, 13.98) | 0.16 (−0.07, 0.39) | 0.18 | |
Democrat (vs. Independent/other) | −0.21 (−14.53, 14.1) | −0.01 (−0.4, 0.39) | 0.98 | |
Republication (vs. Independent/other) | −3.63 (−18.24, 10.98) | −0.1 (−0.51, 0.3) | 0.63 | |
County liberalism | 0.9 (−2.83, 4.62) | 0.02 (−0.08, 0.13) | 0.64 | |
Moderation of intervention effect | ||||
Female | −2.3 (−15.21, 10.61) | −0.06 (−0.42, 0.29) | 0.73 | 1 |
Age years ≤25 | −0.37 (−12.97, 12.22) | −0.01 (−0.36, 0.34) | 0.95 | 1 |
At least 2-year college | −2.22 (−14.44, 9.99) | −0.06 (−0.4, 0.28) | 0.72 | 1 |
Caucasian | −0.71 (−12.43, 11.01) | −0.02 (−0.34, 0.31) | 0.9 | 1 |
Independent/other (vs. Republican) | −0.58 (−19.07, 17.9) | −0.02 (−0.53, 0.5) | 0.95 | 1 |
Democrat (vs. Republican) | −0.75 (−19.04, 17.55) | −0.02 (−0.53, 0.49) | 0.94 | 1 |
County liberalism | −2.34 (−6.71, 2.03) | −0.07 (−0.19, 0.06) | 0.29 | 1 |
For Study 3, demographic characteristics of the 665 participants at baseline. Continuous variables are reported as medians with 25th and 75th percentiles. Binary variables are reported as counts and percentages. Participants could indicate multiple races. “County liberalism”: in the participant’s county, the proportion of votes from the 2000–2016 United States presidential elections that went to the Democratic candidate.
Characteristic | Intervention (n = 333) | Control (n = 332) |
---|---|---|
Sex | ||
Male | 82 (25%) | 98 (30%) |
Female | 251 (75%) | 234 (70%) |
Other | 0 (0%) | 0 (0%) |
Age (years) | 60 (48, 67) | 58 (49, 67) |
Education | ||
Did not graduate high school | 2 (1%) | 2 (1%) |
Graduated high school | 28 (8%) | 24 (7%) |
Graduated 2-year college | 32 (10%) | 26 (8%) |
Graduated 4-year college | 146 (44%) | 127 (38%) |
Completed post-graduate degree | 125 (38%) | 153 (46%) |
Political party | ||
Democrat | 209 (63%) | 192 (58%) |
Republican | 61 (18%) | 83 (25%) |
Independent | 48 (14%) | 45 (14%) |
Other/I don’t know | 15 (5%) | 12 (4%) |
County liberalism | 0.70 (0.70, 0.74) | 0.70 (0.70, 0.74) |
Race | ||
Caucasian | 258 (77%) | 240 (72%) |
Black/African American | 6 (2%) | 8 (2%) |
Hispanic | 26 (8%) | 38 (11%) |
East Asian | 23 (7%) | 31 (9%) |
Southeast Asian | 18 (5%) | 18 (5%) |
South Asian | 12 (4%) | 13 (4%) |
Native American | 3 (1%) | 11 (3%) |
Middle Eastern | 2 (1%) | 11 (3%) |
Pacific Islander | 5 (2%) | 6 (2%) |
For Study 2, estimated intervention effects for the primary outcomes, secondary food outcomes, and exploratory attitude outcomes. Negative estimates represent intervention effects in the desired direction (reduced consumption). “Target demographic”: Participants who reported being Democrats and having graduated 2-year college. Raw mean differences represent ounces consumed over the past week for the primary outcome and secondary food outcomes; they represent units on a 7-point Likert scale for the perceived importance items; and they are omitted for the three composite scales, which were already standardized. Brackets are 95% confidence intervals without correction for multiple testing.
Outcome | Raw Mean Difference | Standardized Mean Difference | p-Value | Bonferroni p-Value |
---|---|---|---|---|
Primary outcome | ||||
Total meat and animal products | −2.46 (−8.78, 3.85) | −0.09 (−0.32, 0.14) | 0.43 | |
Total meat and animal products | ||||
(target demographic) | −1.72 (−8.84, 5.41) | −0.07 (−0.34, 0.21) | 0.63 | |
Secondary food outcomes | ||||
Meat | −0.97 (−4.43, 2.49) | −0.07 (−0.30, 0.16) | 0.57 | 1 |
Non-meat animal products | −1.49 (−6.09, 3.12) | −0.07 (−0.28, 0.14) | 0.52 | 1 |
Chicken | −0.41 (−2.49, 1.67) | −0.04 (−0.27, 0.18) | 0.69 | 1 |
Turkey | 0.02 (−0.5, 0.54) | 0.01 (−0.2, 0.21) | 0.94 | 1 |
Fish | 0.05 (−1.05, 1.15) | 0.01 (−0.18, 0.20) | 0.93 | 1 |
Pork | −0.28 (−0.87, 0.3) | −0.08 (−0.26, 0.09) | 0.34 | 1 |
Beef | −0.11 (−1.05, 0.83) | −0.02 (−0.23, 0.18) | 0.81 | 1 |
Other meat | −0.25 (−0.62, 0.12) | −0.12 (−0.29, 0.06) | 0.19 | 1 |
Dairy | −1.24 (−5.29, 2.8) | −0.06 (−0.26, 0.14) | 0.54 | 1 |
Eggs | −0.23 (−1.76, 1.29) | −0.03 (−0.25, 0.18) | 0.76 | 1 |
Healthy plant foods | 5.23 (−8.3, 18.76) | 0.09 (−0.14, 0.32) | 0.44 | 1 |
Exploratory attitude outcomes | ||||
Importance of health | 0.00 (−0.23, 0.23) | 0.00 (−0.22, 0.21) | 0.99 | 1 |
Importance of environment | 0.00 (−0.26, 0.27) | 0.00 (−0.20, 0.20) | 0.97 | 1 |
Importance of animal welfare | 0.13 (−0.26, 0.52) | 0.10 (−0.20, 0.39) | 0.49 | 1 |
Interest in activism | −0.05 (−0.4, 0.31) | 0.78 | 1 | |
Speciesism | 0.08 (−0.26, 0.42) | 0.62 | 1 | |
Social dominance orientation | 0.02 (−0.28, 0.32) | 0.79 | 1 |
For Study 3, the percent of intervention-group participants (n = 333) who pledged to reduce consumption, who pledged to eliminate consumption, and who made either pledge for each food type.
Food | “Reduce” Pledge (%) | “Eliminate” Pledge (%) | Either Pledge (%) |
---|---|---|---|
Chicken | 40 | 14 | 53 |
Fish | 39 | 7 | 46 |
Pork | 31 | 28 | 58 |
Beef | 35 | 23 | 57 |
Other meat | 36 | 25 | 60 |
Dairy | 36 | 8 | 44 |
Eggs | 39 | 6 | 45 |
© 2021 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).