I coordinate the annual publication of the World Happiness Report, the world’s foremost publication on global wellbeing and human progress. Working in partnership with Gallup, the UN Sustainable Development Solutions Network, and the editorial board, I promote the latest research on global happiness and how to increase it.
In 2019, I helped to create the Happier Lives Institute, a charity evaluator that compares the impact of international NGOs using subjective wellbeing measures. In 2022, I was part of the organising team for the Wellbeing Research & Policy Conference in Oxford. Most recently, my work at the International Alliance of Mental Health Research Funders has supported greater collaboration across the sector.
It would be better to call this: Animal Welfare vs Human Welfare Debate Week
When your scope extends to "any intervention which primarily aims to increase the wellbeing of animals, or decrease their suffering, and...the same for humans”, the term "global health" only represents a sub-set of possible interventions.
Welcome to the forum! Thanks so much for taking the time to dig into this question and sharing your findings. The treatment gap in global mental health is enormous and apps are an essential tool for addressing this challenge.
I didn't have time to review your calculations in detail, but I have a few general reflections that may be useful.
1) There is a brand new meta-analysis on the efficacy of mental health apps which includes 176 RCTS (Linardon et al, 2024). They conclude that "apps have overall small but significant effects on symptoms of depression and generalized anxiety, and that specific features of apps – such as CBT or mood monitoring features and chatbot technology – are associated with larger effect sizes."
2) There is a substantial difference in efficacy between self-help and guided self-help apps. Kaya Guides (incubated by Charity Entrepreneurship) is using WhatsApp to pilot the WHO's guided self-help intervention in India. Their founder wrote an excellent summary of their work here.
3) Be careful with using a single WELLBY number for AMF. The wellbeing effects of life-extending interventions vary widely depending on philosophical choices, so it is better to use the range of possible outcomes rather than a single figure (see The Elephant in the Bednet).
4) John Torous is a leading researcher and thought leader in digital mental health. If you'd like to spend more time learning about this topic, I recommend looking at his recent publications.
5) The current market for mental health apps is completely unregulated and there are major concerns about privacy and data protection. Wellcome recently awarded £1.8m to MHRA and NICE to explore how the market could be regulated more effectively to protect patient safety.
You may be interested in this recent meta-analysis on the efficacy of mental health apps. The authors conclude that: "apps have overall small but significant effects on symptoms of depression and generalized anxiety, and that specific features of apps – such as CBT or mood monitoring features and chatbot technology – are associated with larger effect sizes."
I recommend The Elephant in the Bednet as an accessible introduction to the different philosophical theories for the badness of death.
This comment helps to highlight the importance of language when discussing this topic. Happiness and wellbeing are not the same thing and it can lead to confusion when the two terms are used interchangeably.
This post explains the three main theories of wellbeing: hedonism, desire-based views, and objective list views. If you're a hedonist, then failing to optimise for happiness would be a mistake. However, as Owen points out, people often trade off happiness for other things they value which is more consistent with the objective list theory.
Over recent decades, the field of wellbeing science has settled on 'life satisfaction' as the primary metric for subjective wellbeing. It's still important to track other measures too (e.g., positive/negative affect, sense of meaning/purpose), but I share the view that life satisfaction should be the goal of society.
That's because life satisfaction is the common unit that people use when they make trade-offs between happiness, purpose, duty etc. It's the 'all things considered' assessment of a person's life, according to what they value. Many attempts to measure wellbeing rely on a dashboard of indicators, but in all those cases, the relative weightings of the indicators are decided by the researchers rather than the subjects of the research and, in my view, that misses the whole point. Having said that, I've read some compelling arguments against the life satisfaction approach from Plant (2023) and Thoma (2021) which readers may find insightful.
I'm feeling confused by these two statements:
Although there are other problems, those I have repeated here make the recommendations of the report unsafe.
Even if one still believes the bulk of (appropriate) analysis paths still support a recommendation, this sensitivity should be made transparent.
The first statement says HLI's recommendation is unsafe, but the second implies it is reasonable as long as the sensitivity is clearly explained. I'm grateful to Greg for presenting the analysis paths which lead to SM < GD, but it's unclear to me how much those paths should be weighted compared to all the other paths which lead to SM > GD.
It's notable that Cuijpers (who has done more than anyone in the field to account for publication bias and risk of bias) is still confident that psychotherapy is effective.
I was also surprised by the use of 'unsafe'. Less cost-effective maybe, but 'unsafe' implies harm and I haven't seen any evidence to support that claim.
I recently discovered that GiveWell decided to exclude an outlier in their water chlorination meta-analysis. I'm not qualified to judge their reasoning, but maybe others with sufficient expertise will weigh in?
We excluded one RCT that meets our other criteria because we think the results are implausibly high such that we don't believe they represent the true effect of chlorination interventions (more in footnote).[4] It's unorthodox to exclude studies for this reason when conducting a meta-analysis, but we chose to do so because we think it gives us an overall estimate that is more likely to represent the true effect size.
Maybe you should have a separate debate week on the most appropriate name for the "global health" cause area ;o)