Tuesday, 15 October 2013

MCTs: Mislabelled Cash Transfers

The original version of this blog appeared as a Pathways Perspective on Development Pathways

A new sleight of prestidigitation has occurred in the arcane world of the wizards of conditionality!

As readers may be aware, these conditionistas have promoted four major experiments over the last few years, which they hoped would demonstrate, once and for all, the added value of imposing conditions on the recipients of social transfers. After a series of contested, controversial, but ultimately rather disappointing results from the first three experiments (in Malawi[i], Burkina Faso and Kenya), all hopes were pinned on the fourth experiment, the Tayssir programme in Morocco. This was a two-year pilot designed to increase student participation in primary school, in which independent researchers partnered with the Government of Morocco to evaluate whether imposing conditions increased the educational impact of the cash transfer. [It also had a secondary research purpose, to establish whether it made any difference if the transfer was made to the father or to the mother.]

As with the other three experiments, the methodology used represents what the World Bank’s magnum opus on CCTs[ii] describes as the gold standard:

Ideally, to disentangle the effect of conditions from the income effect inherent in the transfer, an experiment would be designed whereby a first group of households or villages receives a UCT, a second group receives a CCT, and a third group serves as a control group.

This is exactly what happened in Morocco, and the results have just been reported in a paper dated July 13, 2013[iii]. There were essentially two versions of the programme. In its unconditional arm, families with children of primary school age could receive transfers whether or not their children attended school, while, in its conditional arm, cash transfers were disbursed to parents of primary school-age children only on condition that their child did not miss school more than four times each month. [These two groups were further subdivided, to determine if the effectiveness of the transfers depended on the gender of the parent who received the transfer (the child's mother or father).]

Each school sector sampled for the study was randomly assigned to one of five groups:

·       UCT issued to fathers: 80 communities from 40 school sectors.

·       UCT issued to mothers: 80 communities from 40 school sectors.

·       CCT issued to fathers: 180 communities from 90 school sectors.

·       CCT issued to mothers: 178 communities from 89 school sectors.

·       Comparison group: 118 communities from 59 school sectors received no transfers.

Researchers collected information on student attendance and enrolment status for over 47,000 primary school aged children through unannounced visits to all schools. Comprehensive baseline and endline surveys gathered data on around 4,400 households. At endline, a basic test was administered to measure the arithmetic performance of one child per household.

And the result? Overall the impact of providing the cash transfer was impressive: “The Tayssir cash transfers greatly increased school participation under all versions of the program, with the UCT having slightly larger impacts. After two years, the dropout rate among students enrolled in school at the start of the program in UCT schools was about 7 percentage points lower than the dropout rate in comparison schools (at 10 percent), a 70 percent decrease. Re-enrollment of those who had dropped out of school before the program almost doubled in UCT schools as compared to comparison schools, and the share of students who never enrolled in school fell by 43 percent. Performance on a basic arithmetic test improved but not significantly.” [iv]

All well and good. But what about the key question the experiment was meant to be answering, to which there is the tantalising reference underlined above? Yes, indeed. The findings continue: “Making cash transfers conditional did not improve the effectiveness of the program, but may actually have somewhat reduced it: relative to UCT schools, CCT schools had a slightly higher drop-out rate.” Furthermore, “While the CCTs also had a large positive effect on school participation, explicitly conditioning transfers on attendance significantly decreased their impact in the context of this program. In particular, relative to UCTs, CCTs lowered the impact on re-enrollment of children who had dropped out, perhaps because conditionality discouraged some households (or some teachers) from enrolling weaker children in the program. Correspondingly, CCTs also had a significantly lower impact than UCTs on math scores (CCTs had no impact whatsoever, with negative point estimates).”[v]

Oh dear! Not at all what the conditionistas would have wanted to hear! But because the research had been conducted in partnership with an independent institution, it appears that it wasn’t possible, on this occasion, to revisit the data or redo the analysis (as had happened in the case of Malawi). So the conditionistas did the only thing that was available to them: they invented a new category of cash transfer, a Labelled Cash Transfer (or LCT). This is essentially a UCT that has a message attached, a UCT which tells you that education is good for your child, a UCT for which you need to sign up on school premises. The report suggests that this makes an LCT different from a UCT, and implies that an LCT lies somewhere midway along the spectrum between a UCT and a CCT.

What this means, conveniently for the conditionistas, is that all those uncomfortable findings about a UCT outperforming a CCT can be made to disappear like a rabbit in a hat. The report is explicit about this:

“Note that the comparison between LCTs and CCTs tells us little about the question that other papers in the literature have addressed, namely how an unconditional and unlabeled cash transfer program would compare to a CCT.”

Gobbledygook!! This argument requires that an LCT is not the same as a UCT. Is this tenable? Of course not! A UCT does not become “more conditional” (and thus turn into a new beast, an LCT) just because it has a message attached. A condition is a condition: it is, by definition, a requirement that must be fulfilled in order to receive the transfer, where you are punished if you do not fulfil that condition. If a program does not have that (and the LCT arm in Morocco does not), then it is “unconditional”, pure and simple. Think of this in different context: if a driver has a license, he or she is a licensed driver; if not, he or she is an unlicensed driver. Or another: if a researcher adheres to a set of principles, he or she is a principled researched; if not, he or she is an unprincipled researcher. Ergo, an LCT is a UCT, but just one that places greater emphasis on its messaging. And nobody has ever suggested that such messaging is not a very important component of any cash transfer programme.

What is interesting is where the impetus came from, to mis-label UCTs in this manner. One would assume that it did not come internally, from the authors of the research paper. This is because, intriguingly, there exists an earlier version of their report, dated December 4, 2012. And in this version of the report there is no mention whatsoever of an LCT, the words “label”/“labelled” do not appear one single time, the treatment design is unequivocally defined as “conditional vs. unconditional”, and the respective target groups in the experiment are explicitly described as “UCT to mothers” and “UCT to fathers”. Mysterious indeed that LCTs have reared their ugly heads in the space of just seven months. At whose behest? I think we should be told!

Whatever the answer, there are some key messages that emerge from this important study, and they have nothing to do with Labelled Cash Transfers. These are that, in the case of Morocco:

·       Even small cash transfers have a hugely beneficial impact on schooling

·       Applying conditions has a negative impact on programme performance, whilst at the same time increasing both cost and complexity

·       It makes no difference whether the transfer is given to the father or the mother

·       The existence of an effective information and education campaign increases the impact of the transfers.

These findings have serious implications for policy, and should not be obscured by the chicanery of an invented and unnecessary new category of cash transfer. Please may the authors recognise this, and rewrite their report along the lines of their earlier draft, thus proving that they are principled researchers rather than “labelled researchers”! Otherwise there is a danger of not seeing the Bretton Woods for the LCTs.



[i] For a critique of the Malawi experiment, see: Kidd and Calder (2012) The Zomba Conditional Cash Transfer Experiment: an assessment of its methodology. Pathways Perspective No. 6, September 2012.

[ii] Fiszbein, A., and Schady, N., “Conditional Cash Transfers: reducing Present and Future Poverty”, World Bank Policy Research Report, 2009.

[iii] Turning a Shove into a Nudge? A “Labeled Cash Transfer” for Education by Najy Benhassine, Florencia Devoto, Esther Duflo, Pascaline Dupas and Victor Pouliquen.

[iv] NB In these quotations from the report, I have replaced the misleading term “LCT” with the correct term “UCT” – for the reasons explained in the subsequent paragraphs.

[v] Ditto.



Friday, 31 May 2013

The Seven Deadly Myths of Social Protection

The original version of this blog appeared as a Pathways Perspective on Development Pathways

In a stimulating blog, Stephen Kidd discussed the issue of myths in social protection. In this article, I would like to take this further and try to dispel a number of the more common myths surrounding social security systems in developing countries.

Coincidentally, I have just returned from a trip to Madrid. Naturally I visited the Prado museum, where one of the highlights was a splendid table attributed to Hieronymus Bosch, called The Seven Deadly Sins and the Four Last Things.  Here it is:


It occurred to me that there are some interesting parallels between the myths I want to dispel, and the Seven Deadly Sins depicted.

But first, by way of introduction, let us start by clarifying the two very distinct ideologies around social protection that Stephen has delineated.

On the one hand, we have a neo-liberal, small state approach – let us call it Tea Party social protection in memory of Boston, and the resultant philosophy of low taxation and low government expenditure. This approach is firmly rooted in a nineteenth-century “Anglo-Saxon” worldview of “poor relief” and “workhouses”. It is tightly poverty-targeted, based on the argument that scant resources should be focused on the poorest, often identified through (highly inaccurate) mechanisms such as proxy means testing, community targeting, or self-selection.  It is also premised on a belief that “beneficiaries” should do something in exchange for receiving their benefits. So it imposes conditions: either work (as on a workfare programme), or a set of behaviours (such as visiting a health clinic or sending a child to school). There is an emphasis on – not to say obsession with – “graduation” and “exit strategies”; and there is no recognition of entitlement or rights. Examples abound: Latin America’s much-lauded Conditional Cash Transfers (CCT); Ethiopia’s Productive Safety Net Programme (PSNP); Indonesia’s Program Keluarga Harapan (PKH); Pakistan’s Benazir Income Support Programme (BISP); etc. The major proponents of this ideology are the Bretton Woods institutions.

On the other hand, we have a more “universalist” approach, akin to a Nordic view of social security. This places the emphasis on tackling inequality as a means of combating poverty. It tends to provide support to much broader “vulnerable groups” such as people with disabilities, the elderly and children. And it provides benefits to all (or almost all) in these identified groups, even those that are not poor. It represents a more inclusive, so more expensive approach; but it is also more popular, with stronger political appeal, so ultimately better funded and more fiscally sustainable. The argument is that the poor get a more valuable (and more sustainable) transfer than if a much smaller programme had been targeted exclusively at them. These programmes tend not to be conditional, but entitlement-based; and there is much less emphasis on graduation, since exiting happens naturally. Again there are many examples: South Africa’s suite of social grants; old age pensions in Lesotho, Nepal and Thailand; India’s employment guarantee scheme (MGNREGA). The major global proponents of this approach are the United Nations, embodied in the concept of a social protection floor.

As Stephen argues so cogently in his blog, it is – regrettably – the former ideology that is currently predominant in the development discourse. But it is predominant largely because it is based on a set of myths. And it is these myths that I think can be linked to Hieronymus Bosch’s Seven Deadly Sins. They might thus be termed the Seven Deadly Myths of Social Protection.

The first is the Sin of Sloth (accidia in the Latin of the Catholic Catechism), which is linked to the myth propagated by protagonists of the Tea Party approach that providing people with social transfers will result in laziness and dependency. Whilst this may indeed be a concern in developed countries, as current debates in the UK show, it is demonstrably not the case in developing countries where benefit levels tend to be low. In fact all the evidence points to the opposite conclusion: that social transfers, by mitigating risk and allowing investment, actually reduce dependency and improve productivity. Recipients of social transfers in Mexico and South Africa look for work more intensively and extensively, and find employment more successfully, than do workers in comparable households that do not receive social grants; an evaluation of the Mchinji cash transfer programme in Malawi found that 50% of recipients were more likely to produce crops since receiving the cash transfer; and beneficiaries of the Mexican agricultural support programme, Procampo, raised their income by 1.5 to 2.6 times the value of the actual transfer.

The second is the old and much-repeated myth that social transfers encourage irresponsible spending – in other words that they encourage the Sin of Lust (luxuria). Quite apart from being patronising and hypocritical, this assertion is also demonstrably wrong. Poor households are by far the best judges of how to use effectively any resources they are given; and a number of studies have confirmed that they spend their transfers wisely: on food, on health, on education, on productive investments … not on sex, alcohol and cigarettes. Recipients of the old age pension in Lesotho spent less on all such “luxuries” combined than they did in contributions to the church collection-plate! And a study in South Africa showed that households that receive social pensions have higher expenditure shares on food and education and lower expenditure shares on alcohol, tobacco and entertainment, than other households do. As the t-shirts distributed to recipients of the Kalomo social cash transfer in Zambia proudly proclaim: “the poor are not irresponsible”!

The third myth of the Tea Partiers is linked to the Sin of Envy (invidia). Described by Aquinas as “sorrow for another's good”, this is manifested in social protection as a reluctance to “give something for nothing”. This argument, linked to the ones above, is as commonly heard among politicians and commentators in OECD countries as it is in developing countries. It is often used to justify “productive safety nets” (such as workfare) or conditional schemes as a basis for social transfers. But the “productivity” of such schemes, sometimes imposed with minimal consultation by external agents such as governments and donors, is often far less productive than the alternative of providing individuals and households with the means to make their own consumption and investment decisions, without obliging them to waste valuable time and energy on misguided and frequently “unproductive” initiatives.

The fourth argument used to support tightly poverty-targeted social protection programmes may be associated with the Sin of Greed (avaricia). This is the argument that any broader, more universal approach is “unaffordable”. But this is arrant nonsense. Affordability is much more closely associated with political will than with fiscal resources. First, the OECD countries which now rely heavily on social security were themselves much poorer when they introduced social security. Arguably this is indeed part of the reason why they have now become so much richer: there is a strong correlation between national wealth and the amount countries spend on social protection. Another example is Mauritius, where even the IMF cites its early adoption of comprehensive social transfers as a key reason for its dramatic improvements in living standards. Finally, ILO studies of selected African countries calculate that the cost of an $18 per month pension for all over-65s and all people with disabilities would typically represent no more than 0.3% to 1.0% of GDP. Lesotho, for example, introduced a universal social pension which was denounced by the Bretton Woods Institutes as unaffordable…but has gone on increasing its value ever since.

Fifth, and closely linked, is the Sin of Gluttony (gula).  Interestingly, gluttony is defined both as “a misplaced desire of food or its withholding from the needy”, with the latter being most relevant in this context. What those who argue that social protection is unaffordable are actually saying is that they do not accept a greater degree of redistribution: they do not wish current government expenditure from which they may benefit to be redirected to others. The typical example here is encapsulated in consumer subsidy programmes, which by definition benefit those who consume more, to a much greater extent than those who consume less. So, for example, 55% of the benefit of Indonesia’s fuel subsidy goes to the richest 20%, and less than 5% of the benefit to the poorest 20%. And this fuel subsidy costs the government 2.5% of GDP, compared with the 0.5% of GDP that it spends on social assistance programmes. As Galbraith put it so succinctly, quoted in one of the links on Stephen’s blog: “The modern conservative is engaged in one of man's oldest exercises in moral philosophy: that is, the search for a superior moral justification for selfishness”.

Sixth is the myth that grievance systems can compensate for flawed programme design and substandard implementation. This is linked to the Sin of Wrath (ira) and the mistaken assumption made by Tea Partiers that beneficiaries will demonstrate their anger and frustration through appeals procedures. But there is little evidence to support this myth. Grievance systems are often non-existent. Where they do exist, beneficiaries do not use them because they do not understand the basis on which they were, or were not, selected for a programme; they are not fully aware of their entitlement; or they see the whole process as a lottery where the benefit may be taken away as inexplicably as it came…especially if they are so brazen as to complain about any aspect of it. Interestingly, in one or two cases where appeals procedures were properly introduced, such as Kenya’s OVC programme, they had to be retracted because so many angry citizens protested that the system was overwhelmed.

The last, and most egregious, sin of the Tea Party movement is the hubris inherent in the myth that it is possible to target the poorest in any but the most arbitrary fashion. It is not. This represents the Sin of Pride (superbia). Often considered the most serious of the Seven Deadly Sins, Dante defined pride as “love of self, perverted to hatred and contempt for one's neighbour”. So we see advocates of the poverty-targeted approach establishing a range of inherently inaccurate systems to “identify” their poorer brethren; and then passing these targeting approaches off as being transparent, reliable and authoritative. Yet there are serious, well-documented flaws in all the main poverty-targeting methods: proxy means testing exhibits error rates of 60%-70%, especially in programmes with low coverage (the norm in developing countries); community-based targeting is as likely to perpetuate entrenched inequalities as to overturn them; and self-targeting is often either demeaning (for example when it relies on the provision of inferior goods) or distorted (for example when it excludes those without labour capacity, often the very poorest, from workfare).

So, we are faced with a stark choice, represented on Bosch’s table by the “Four Last Things”. In the first of these we see angels and devils weighing a man’s soul: think of this as being an allegory for the decision we have to take between perpetuating the Seven Deadly Myths of social protection, or refuting them.


We need to get the right answer, because the next panel shows the Last Judgement:


This choice we make will determine whether we end up with social protection systems in developing countries that are worthy of hell (one of Bosch’s specialisms!)…


…or of heaven.


And, be warned: as the good Hieronymus is keen to point out in the very centre of his table, Cave Cave Deus Videt ("Beware, Beware, God Sees"). So let’s refute those Tea Party myths!




Come on and open up your heart!

  This blog originally appeared on Development Pathways I very much enjoyed Stephen Kidd’s humble and courageous admission that he is a refo...