We’ve got designs on change: 1 – Findings from our endline household survey (KYTS-ACE)

This may be a bit of a technical post, but it answers the very simple question at the heart of our work: ‘Can design improve health outcomes for children?’ We think the answer is YES.  Here is some of our emerging evidence – see if you agree!

When we began work to save children’s lives by improving access to Oral Rehydration Salts and Zinc in remote areas of Zambia, less than 1% of children with diarrhoea were getting the simple life-saving treatment. By the end of last year, over half (53%) of children in our target areas received ORS and ZInc, and Kit Yamoyo supplied the vast majority of these treatments (77%).

These are the results from visiting over 600 households in remote areas served by our KYTS-ACE project (or to give it its full name: the Kit Yamoyo Transition to Scale – Adapting to Challenging Environments). The 14 districts we served were selected by Zambia’s SUN Programme (Scaling Up Nutrition Programme); those with the highest child nutrition challenges, low population, low incomes and challenging distances. These districts are generally remote, rural with low population densities. Because of this, we focussed on public sector Health Centres (designing the GRZ ORS/Zinc co-pack for delivery by the Government of the Republic of Zambia – GRZ). But we also trained small shop-keepers and opened up distribution through Shoprite supermarkets. The over-riding opinion of health staff and policy makers, is that both public and private sector supply can – and must – continue. More on that below.

GRZ ORS and Zinc co-pack
GRZ ORS/Zinc co-pack

KYTS-ACE districts and interventions
Click on the map to view full-size on Flickr

Now for the technical aspects. There were several aspects of the KYTS-ACE endline survey but this blog post focusses on the randomised household survey. This was overseen by Dr Rohit Ramchandani and undertaken by RuralNet Associates. Future blog posts will deal with the other aspects of the endline survey.

The sampling method

The household survey was undertaken in two of the 14 districts: Mongu and Chipata. Both of these districts are the capital of their respective provinces (Western and Eastern respectively). Both have a Shoprite store and small retailers were trained to sell Kit Yamoyo in both districts, from Feb-15. In Chipata, distribution of the ORS/Zinc co-pack we designed for the government started in Jan-16 and in Mongu distribution started in Jan-17. Households were selected using the random walk method within the green circles of the maps below. The circles are 6 km in diameter and at the centre of each is either a health centre or retailer, chosen at random. In all, 638 households took part in the survey.

KYTS-ACE Endline sampling method

The sample

The table below shows the sample achieved using the above sampling method.

KYTS-ACE Endline sample make-up

The results (the overview)

The way sample broke out is summarised below. The key findings are:

  • 53% of children under 5 children with diarrhoea in the last two weeks used ORS & Zinc
  • 41% of children under 5 with diarrhoea used ORS & Zinc from Kit Yamoyo (12% were given ORS and Zinc from other sources)
  • Thus, 77% (41/53) of the ORS and Zinc being consumed is from some format (either public or private) of Kit Yamoyo

KYTS-Endline HH Survey Results overview

This is a significant shift from the situation in our initial trial where we found that less than 1% of diarrhoea cases were treated with ORS and Zinc. It is also interesting to note that the coverage rate achieved here (41% of children under 5 with diarrhoea being given ORS and Zinc from a Kit Yamoyo design) is similar to the 45% coverage rate achieved in our 2012/13 trial.

Reaching disadvantaged (high-risk) groups

Coverage is important but just as important is the type of coverage achieved. The table below shows that KYTS-ACE was effective in reaching disadvantaged groups and people at high-risk because of poor nutritional status.

Reaching high-risk groupsPLHIV = People Living with the HIV virus.

Which kit format was used?

Of those who used ORS and Zinc from one our our co-packs, 68% of diarrhoea cases were treated with the GRZ ORS/Zinc co-pack given out free at government health centres and 36% were treated with one of the commercial formats. Note that some users had used more than one format.

KYTS-ACE Endline - Type of kit used

Zinc adherence

Adherence to medicine is a problem worldwide and Zinc supplementation is no exception. In our initial trial (2012/13, Zinc tablets were new to the population, yet we managed to achieve the 10-day adherence by 33% of caregivers. Subsequent to the trial, the Kit Yamoyo manufacturer started producing their own Zinc; this presented the opportunity to design a blister pack to encourage better adherence. This process is documented more fully here: Designing for better Zinc adherence. The Kit Yamoyo kits used in the KYTS-ACE project all had the locally produced Zinc. We were pleased to see a small increase in adherence, with 39% of caregivers using Zinc for the prescribed ten days. Strictly speaking, we can’t directly attribute this to the re-design of the Zinc packaging – but it is a move in the right direction. Alongside design, there is an on-going requirement for awareness raising and training for caregivers and for those dispensing Zinc.

Zinc adherence KYTS-ACE vs COTZ 2

The effect of co-packaging on dispensing practice

In parallel with the household survey, we commissioned a small survey on dispensing behaviour. In Mongu District, we selected 8 health centres which were adequately stocked with all dispensing options for diarrhoea available, in both Oct-16 and Oct-17. We wanted to compare dispensing behaviour before and after the new GRZ ORS/Zinc co-pack was available. In Oct-16, before the introduction of the co-pack, all centres had both ORS and Zinc in stock throughout the month, as separate items, so frontline staff were able to choose to dispense ORS alone or ORS together with Zinc. In these health centres, 176 cases of diarrhoea were treated in the month; 44% (77) were give both ORS and Zinc. In Oct-17, the same health centres had both ORS and Zinc in stock, plus the new GRZ ORS/Zinc co-pack. In this month, we saw cases treated correctly nearly double: 87% of cases were treated with ORS and Zinc, and of these, 87% (337) of treatments were delivered with the GRZ ORS/Zinc co-pack. This is a huge and very encouraging change.

Diarrhoea Treatments Mongu 2016 and 2017 cropped

Where improvements are still needed

Use of measuring function

There is still design work to be done though. A triumph of the initial trial was the improvement in the way ORS was mixed. Our trial showed that if you give caregivers the usual 1 litre ORS sachets only 60% mix the ORS correctly. This may be attributed to a lack of awareness of what a litre is and/or the unavailability of vessels with which to measure a litre. This is discussed more fully here: A picture is worth a 1000 words: visualizing the challenges of effective diarrhoea treatment. In contrast to this, 93% of caregivers who used the original Kit Yamoyo mixed the ORS correctly; this was attributed to the fact that the original, rigid Kit Yamoyo packaging could be used to measure the amount of water required to mix the 200 mL ORS sachets in the Kit Yamoyo.

Unfortunately, this advantage of Kit Yamoyo is not seen in the KYTS-ACE data. Only 54% of Kit Yamoyo users with diarrhoea in the last two weeks mixed the Kit Yamoyo ORS correctly. The most significant difference between the trial and the scale-up is the design of the kit packaging. In the trial, it was made from rigid plastic; in the scale-up it was a flexible, gusseted bag. Although the bag was designed to measure the water it was not always used to do so.

The Kit Yamoyo packaging is the measuring device for mixing the ORS Flexi-pack measuring in black hand
Measuring water in the original Kit Yamoyo (left) and the Kit Yamoyo Flexi-pack (right)

The bag has huge distribution and cost benefits: it is cheaper, it very efficient in use of space when packed, and it could eventually be made locally. But it isn’t ‘intuitively’ seen as a measuring vessel, so we need to reinforce the message that the Kit Yamoyo bag can act as a measure.

Key conclusions and actions needed

1. Lobby for the public procurement of co-packaged ORS and Zinc

It is clear that co-packaged ORS and Zinc increases access to the global recommended treatment for diarrhoea: ORS combined with Zinc. We need to lobby for the continued public procurement of co-packaged ORS and Zinc and for this to be supplied nationwide (not just to SUN districts). Global evidence shows that this will reduce child mortality and stunting.

Our findings align with experience in other countries. In 8 states in Nigeria, coverage rates of 31% have been achieved following the distribution of co-packaged ORS and Zinc via government health facilities (Source: CHAI).

Distribution of co-packaged ORS and Zinc is the next piece of low-hanging fruit in the challenge to improve child health.

2. Lobby for co-packaged ORS and Zinc to be added to the Zambia Essential Medicines List (ZEML)

The chances of sustaining the supply of co-packaged ORS and Zinc would be greatly enhanced if co-packaged ORS and Zinc were added to the Zambia Essential Medicines List (ZEML). The EML influences health policy and spending on medicines themselves by government and donors.

3. Lobby for co-packaged ORS and Zinc to be added to the international WHO Essential Medicines List (EML)

The WHO EML acts as model that national governments tend to follow. Getting co-packaged ORS and Zinc on the WHO EML would have a cascade effect. The WHO EML is reviewed every two years and the deadline for applications for consideration in the next review is Nov-18. We have a consortium behind us to lobby WHO, and a number of ‘listening ears’ at the organisation open to reviewing our evidence.

4. Raise awareness that our designs are ‘open-source’ and free for anyone to use

Please do your bit to help us, by sharing this blog post!