layout: true --- class: inverse, center, middle, title-slide background-image: url(figures/brain.png) background-size: contain # Studying emotions, mental health and social behavior via social media ## Dr. Hannah Metzler ### Research Summary October 2023 #### Slides: www.hannahmetzler.eu/HMResearchSummary ??? <!-- --- --> <!-- layout: true --> <!-- --- --> # My background .left-column[ <img src="figures/uniwien.jpg" width="200" style="display: block; margin: auto;" /> <img src="figures/ens_sorbonne.svg" width="220" style="display: block; margin: auto;" /> <img src="figures/knowcenter2.svg" width="110" style="display: block; margin: auto;" /> <br> <img src="figures/csh.png" width="190" style="display: block; margin: auto;" /> <img src="figures/Meduni-wien.svg" width="210" style="display: block; margin: auto;" /> ] .right-column[.center-right[ * Master in Psychology * <span style="font-size: 25px; font-style: italic">Emotional, hormonal & neural gender differences in stress responses</span> <br> <br> * PhD in Social & Affective Neuroscience * <span style="font-size: 25px; font-style: italic">The influence of bodily actions on social perception & behaviour <br> <br> * Postdoc & Project Manager in Open Science <br> <br> <br> * Postdoc in Computational Social Science * Project-PI since November 2021 * <span style="font-size: 25px; font-style: italic">Social media, emotions, mental health, misinformation</span> ]] --- <!-- --- --> <!-- layout: true --> <!-- <div class="my-footer"><span> --> <!-- <a href="https://psyarxiv.com/t8mhw"> Metzler et al. Psyarxiv (2020) - </a> --> <!-- <a href="https://rdcu.be/8Gx5"> Chadwick*, Metzler* et al. Motivation & Emotion (2019) - </a> --> <!-- <a href="https://peerj.com/articles/6726"> Metzler & Grèzes. PeerJ (2019)</a> --> <!-- </span></div> --> <!-- --- --> <!-- # Emotions in non-verbal social interaction --> <!-- .right-column[.center-right[ --> <!-- ```{r, echo=FALSE, out.width=700} --> <!-- knitr::include_graphics("figures/nonverbal.jpg") --> <!-- ``` --> <!-- ]] --> <!-- -- --> <!-- .left-column[ --> <!-- **Emotions** --> <!-- - attract & direct attention --> <!-- - affect behavior --> <!-- <br> --> <!-- Open Science! --> <!-- ] --> --- layout: true --- # My research in the area of social media <br><br> <img src="figures/framework.svg" width="1100" style="display: block; margin: auto;" /> ??? My research in the last 3 years has revolved on social media as research tool, as well as a research topic. I want to briefly present 3 research projects to you, in which I focused on social media in one of three different ways: a digital tool to measure behaviors that could not otherwise be measured, a digital media that has effects on real world behavior, and finally, an new kind of social environment: interaction with large amounts of people, opportunity of observing many others, group identities are salient, mediated by platform design and algorithms. --- # Social media as a data source <br><br> <img src="figures/framework_data.svg" width="1100" style="display: block; margin: auto;" /> --- layout: true <div class="my-footer"><span> <a href="https://psyarxiv.com/qejxv"> Metzler, Rimé, Pellert, Niederkrotenthaler, Di Natale & Garcia (2023). Emotion. </a></span></div> --- # Collective emotions during COVID-19 .pull-left[.center-left[ **Social media data** * Emotional expressions on Twitter * 5 weeks after outbreak in 2020 * 8,3 billion tweets in 6 languages * Geolocation: 18 countries **Computational Methods** * Automated text-analysis * Validated emotion dictionaries * Robustness: Machine Learning * Generalized multilevel modeling: <br>*p(emo) ~ time + (country|time)* ]] .pull-right[ <img src="figures/EmotionTimelines2020_Italy.svg" width="600" /> ] ??? ML: Deep learning: RoBERTa fine-tuned to tweets Generalized mixed-effects logistic regression models - Fixed-effect coefficients: Common effects across countries After image: link to stringency and cases in plot: association with real world events --- # Stringency of measures & COVID cases .pull-left[.center-left[ <img src="figures/stringency_periods.svg" width="460" /> ]] .pull-right[.center-right[ <img src="figures/correlation_anx_cases_week1.svg" width="440" /> ]] --- layout: true <div class="my-footer"><span> <a href=https://arxiv.org/abs/2107.13236> Garcia, Pellert, Lasser, Metzler (2021). ArXiv. - </a> <a href=https://www.nature.com/articles/s41598-022-14579-y> Pellert, Metzler, Matzenberger & Garcia (2022). Scientific Reports. </a></span></div> --- # Real-world effects of social media <br><br> <img src="figures/framework_effects.svg" width="1100" style="display: block; margin: auto;" /> --- layout: true <div class="my-footer"><span> <a href="https://www.jmir.org/2022/8/e34705"> Metzler, Baginski, Niederkrotenthaler & Garcia (2022). JMIR. </a></span></div> --- # Media effects research on suicide News reporting on suicide influences suicidal behavior in individuals at risk .pull-left[.center-left[ <img src="figures/Werther.png" width="250" style="display: block; margin: auto;" /> <div style="text-align:center"> Reports on suicide deaths: <br> <span style="font-weight: bold; color:#1f5c99"> Werther</span> effect <br> <font size="4"> <a href='https://www.bmj.com/content/368/bmj.m575'> Meta-analysis: Niederkrotenthaler et al. 2020 </a> </font> </div> ]] .pull-right[.center-right[ <img src="figures/Papageno.png" width="200" style="display: block; margin: auto;" /> <div style="text-align:center"> Stories of hope & coping: <br> <span style="font-weight: bold; color:#1f5c99"> Papageno</span> effect <br> <font size="4"> <a href='https://www.doi.org/10.1192/bjp.bp.109.074633'> (e.g. ) Niederkrotenthaler et al. 2010 </a> </font> </div> ]] <div style="text-align:center; font-weight: bold; color:#1f5c99"> Content, language & emotional connotation matter </div> --- ## Machine learning classification of harmful & protective content .pull-left[ * Social media content on suicide * Big data for robust results * 14.5 million US tweets 2013-2020 ] -- .pull-right[ * Scheme: content categories * Machine Learning to automatically label tweets ] -- <img src="figures/MLresults_per_category.svg" width="1000" style="display: block; margin: auto;" /> ??? Social media: young adults and new content types, but few studies Small datasets with manual labelling: Big data Best performance with BERT * Prevention: Model detects 90% * Suicidal thoughts: Model misses many - sarcastic messages --- layout: true <div class="my-footer"><span> <a href="https://doi.org/10.1177/00048674221126649"> Niederkrotenthaler, Tran, Baginski,..., & Metzler (2023). Australian & New Zealand Journal of Psychiatry. </a></span></div> --- ## Associations with suicides & helpline calls in the US Daily % of all suicide-related tweets 2016-2018 <img src="figures/Daily_timeseries_Coping_Prevention.svg" width="700" style="display: block; margin: auto auto auto 0;" /> * Time series analysis with daily suicide cases & helpline calls * Protective associations: Coping stories & prevention tweets --- layout:true --- # Social media as a digital social environment <br> <img src="figures/framework_env.svg" width="1000" style="display: block; margin: auto;" /> --- layout:true <div class="my-footer"><span> <a href=https://journals.sagepub.com/doi/10.1177/17456916231185057> Metzler & Garcia (2023). Perspectives on Psychological Science. </a></span></div> --- ## Digital media & well-being, fake news & polarization * Social media & its algorithms as the culprit for large societal issues * Social network structure & environment vs. recommendation algorithms * Evidence: algorithms mostly reinforce existing social drivers of these problems * Research on how social and algorithmic influences interact is scarce <img src="figures/logo-rond-twitter.svg" height="150" /> <img src="figures/network.svg" height="180" /> <img src="figures/Facebook_f_logo_(2019).svg" height="150" /> --- layout: true <div class="my-footer"><span> <a href="www.hannahmetzler.eu/emomis"> Emomis project website </a></span></div> --- # Emotional misinformation spreading <img src="figures/factchecking.svg" width="400" /> <img src="figures/pexels-alex-green-5699823.jpg" width="300" /> .left-column[ <span style="font-size: 25px">Digital Humanism project - 400k <br> 12/2021 - 02/2025</span> <img src="figures/wwtf.svg" width="300" /> ] .right-column[ * Emotions attract attention & increase sharing * Polarized group discussions on social media * Beliefs are shaped by our social identity ] ??? * Current interventions focus on accuracy <br> --- ## Socio-emotional processes: Health misinformation <img src="figures/Emomis.svg" width="1100" style="display: block; margin: auto auto auto 0;" /> --- layout: true <div class="my-footer"><span> <a href=https://doi.org/10.31234/osf.io/udqms> Lühring, J., Shetty, A., ..., Metzler, H. (2023). PsyarXiv. </a></span></div> --- ## Emotions = Irrationality & manipulation? * Replication & extension of [Martel et al. (2020)](https://doi.org/10.1186/s41235-020-00252-3") * Pre-registered online survey in Austria in Dec 2021 * Actual false & real COVID-19 news items (n=24): accuracy rating task * Emotional state & response to each item <center> <img src="figures/N15.PNG" height="270" /> <img src="figures/NR14.PNG" height="270" /> --- ## Angry responses driven by people recognizing lies <img src="figures/curvi-linear.svg" width="800" style="display: block; margin: auto;" /> * Higher anger in people **good & bad** at recognizing false news * Angry responses because most people **recognize** false news * Emotions arise when information contradicts beliefs rooted in social identity <div style="color:grey"><small><left> Robust polynomial curves for news discernment & emotional responses. </small> </div> --- layout:true --- ## Pilotstudy: Beliefs incongruent with social identity .left-column[ ![](figures/Facebook Post_Homeopathy_Intervention_Cropped.png)<!-- --> ] .right-column[ * People sympathizing with alternative medicine * Intervention: * History of right-wing extremist support * News articles from right-wing website * Pre-post: Sympathy and trust ratings ] <center> **Highlighting that current beliefs constrast with an important<br> social identity reduces trust in alternative medicine. <br> (r=0.6)** ??? Slide for application talk ## Research skills for the health psychology group .pull-left[.center-left[ ### Quantitative methods * Automated-text analysis * Multilevel modeling & <br> longitutinal data * Coding (R, Matlab, Python) * Online experiments * Open science tools ]] .pull-right[.center-right[ ### Research topics * Social media & well-being/mental health * Media content effects on real-world behavior * Interventions for attitude & behavior change * Social & emotional influences on belief in (health) (mis)information ]] --- layout: true --- # Thank you! <br> For more on my research: https://hannahmetzler.eu For data and code: https://github.com/hannahmetzler Slides: https://hannahmetzler.eu/HMResearchSummary <br> <img src="figures/csh.png" width="220" /> <img src="figures/Meduni-wien.svg" width="220" /> <img src="figures/wwtf.svg" width="300" /> <img src="figures/vibrant.svg" width="260" /> ??? <!-- --- --> <!-- class: inverse, center, middle, title-slide --> <!-- background-image: url(figures/brain.png) --> <!-- background-size: contain --> <!-- # Research Summary Hannah Metzler --> <!-- # Additional slides --> <!-- --- --> <!-- # Validity of emotion measures --> <!-- .pull-left[.center-left[ --> <!-- * UK Twitter data --> <!-- * YouGov: Weekly representative UK emotion survey --> <!-- * 2 year period --> <!-- * Automated text-analysis & Machine Learning --> <!-- * Pre-registered hypotheses for prediction period --> <!-- ]] --> <!-- .pull-right[.center-right[ --> <!-- ```{r, echo=FALSE, out.width=650, fig.align='right'} --> <!-- knitr::include_graphics("figures/Anxiety.svg") --> <!-- ``` --> <!-- ```{r, echo=FALSE, out.width=650, fig.align='right'} --> <!-- knitr::include_graphics("figures/Sadness.svg") --> <!-- ``` --> <!-- ]] --> <!-- * Sentiment analysis in Austria: similar results -->