A Final Hurrah for KYTS Data Collection:
Endline Findings From The Kit Yamoyo Transition to Scale – Lusaka Household Survey
Our first household survey in Zambia took place in July of 2012. This was when we conducted the baseline for the ColaLife Operational Trial Zambia (COTZ). Here we are, 6 years later, elated to be sharing the findings from our scale-up efforts in Lusaka (under the KYTS-LUSAKA project). To get a full picture of what was achieved under our transition to scale efforts, this post should be read in conjunction with this post about our KYTS-ACE (Adapting to Challenging Environments) Endline.
1. The Set-Up
The data collection for the KYTS-LUSAKA Endline was conducted in February and March 2018. Data collection took place over the course of 3 weeks from late February to mid-March. This was following 1 week of training for all enumerators (12), all of whom had previous experience working on ColaLife research.
KYTS-Lusaka Enumerators with Supervisor Fison Mujenja and Principal Investigator Dr. Rohit Ramchandani
In total, 1,652 household surveys were conducted with caregivers of children under 5 (between 6 and 59 months). All data was collected across 11 compounds of Lusaka (see Table 1; Figure 1; and Figure 2). Households were selected using a random walk method within the yellow circles of the maps below. Each site (i.e. circle) was 1km in diameter. The number of households sampled per site was proportional to the population within the site.
Table 1: Households sampled by site
Community name | Frequency | Percent | |
Site 1: | Bauleni | 149 | 9.02 |
Site 2: | Chainda | 108 | 6.54 |
Site 3/4: | Chipata | 251 | 15.19 |
Site 4: | Kabanana | 12 | 0.73 |
Site 5: | Garden | 196 | 11.86 |
Site 6: | George | 135 | 8.17 |
Site 7: | Lilanda/George | 82 | 4.96 |
Site 8: | Kalingalinga | 99 | 5.99 |
Site 9: | Kanyama | 215 | 13.01 |
Site 10: | Mtendere | 188 | 11.38 |
Site 11: | Chawama | 217 | 13.14 |
Total | 1,652 |
Figure 1 – KYTS-Lusaka Sampling Sites
Figure 2 – Zoomed-in Satellite Image of Households Within Site 1
The simplified (ie top level) version of our outcomes framework (ie “logic model”) below shows the areas where we expected to have influence.
Table 2 – Simplified Outcomes Framework
Level of Influence | Outcome | Indicator |
Impact | Reduce diarrhea specific mortality in children under 5 years of age in Lusaka Province | Estimated number of under-5 lives saved |
Outcome | Children under 5 living in Lusaka Province benefit from increased use of correctly prepared ORS and Zinc for home-based treatment of diarrhea | Percentage of households with at least one child under-five who has: a) experienced one or more episodes of diarrhoea in the past two weeks and; b) received ORS and Zinc combination therapy |
Number and percentage of under-fives who have: a) received ORS treatment alone; and b) zinc treatment alone Proportion of caregivers who prepared ORS solution correctly (rational use based on preparing ORS in the correct concentration). |
||
Proportion of caregivers who report administering zinc to their U5 children with diarrhoea for: a) the entire 10-day course; and b) in the correct dosage |
||
Average treatment delay (time between onset of diarrhoea and administration of treatment) |
2. The Intervention
Our approach under KYTS-LUSAKA differed from KYTS-ACE, in that Kit Yamoyo was only available through the private sector (with the exception of about 6,000 kits, which the Ministry of Health decided to release into Lusaka Province towards the end of the project in response to ORS and zinc shortages at some of the health centres). This meant that for the majority of the 30-month scale-up in Lusaka, Kit Yamoyo was mainly available through small private sector retailers at the community level (many of whom received training from the project), as well as through our public-private partnerships with formal supermarkets like Shoprite. All of the private sector Kit Yamoyo formats – Kit Yamoyo Essential flexi-pack (ORS and zinc only), Kit Yamoyo original flexi-pack (ORSZ + Soap), and Kit Yamoyo screw-top – were all available at different points during the project.
3. The Sample
The table below presents descriptive variables for the sample achieved using the above methodology.
Table 3 – Sample Description
VARIABLE | |
Caregivers/Respondent | |
Mean Age | 29 years |
Sex | 3% male; 97% female |
Relationship to Child | 84% mothers; 7% grandmothers; 5% aunts; 4% other |
Completed Education | Grade: 1 to 4 (5%); 5 to 7 (28%); 8 to 9 (38%); 10 to 12 (22%); higher learning (4%); None (3%) |
Children Under 5 | |
Mean Age | 29 months |
Sex | 50% male; 50% female |
2-Week Period Prevalence of Diarrhoea | 16% (note: as a point of comparison, the reported 2-week period prevalence under KYTS-ACE was 32% in rural areas, but see “limitations” section at the end of this post) |
4. The Results
The key findings from KYTS-LUSAKA are shown below, reporting against the logic model presented above.
Table 4 – Key Findings
Level of Influence | Outcome | Indicator | Findings |
Impact | Reduce diarrhoea specific mortality in children under 5 years of age in Lusaka Province | Estimated number of under-5 lives saved | 104 (blog post forthcoming) |
Outcome | Children under 5 living in Lusaka Province benefit from increased use of correctly prepared | Percentage of households with at least one child under-five who has: | |
ORS and Zinc for home-based treatment of diarrhoea | a) experienced one or more episodes of diarrhoea in the past two weeks and; | a) 16% (note the limitations section below) |
|
b) received ORS and Zinc combination therapy | b) 33% (higher = better) | ||
Percentage of under-fives who have: | |||
a) received ORS treatment alone; and | a) 39% (lower = better) | ||
b) zinc treatment alone | b) 3% (lower = better) | ||
Proportion of caregivers who prepared ORS solution correctly (rational use based on preparing ORS in the correct concentration) | a) 62% (Non-Kit Yamoyo users; 1L sachet); and b) 63% (Kit Yamoyo users) |
||
Proportion of caregivers who report administering zinc to their U5 children with diarrhoea for: a) the entire 10-day course; and b) in the correct dosage |
Non-Kit Yamoyo Zinc: a) 0% b) 66%Kit Yamoyo Zinc: a) 49% b) 77% |
||
Average treatment delay (time between onset of diarrhoea and administration of treatment) | Kit Yamoyo Users: 0.60 days (68% on same day as diarrhoea struck) Non-Kit Users: 1.07 days (49% on same day as diarrhoea struck) |
Presented more visually, the outcome tree below shows how some of these key outcomes relate to our sample and summarizes some of our additional outputs and outcomes:
Figure 3 – Endline Analysis Tree Diagram Click on image to view full-size on Flickr
5. The Reach
Innovation without access is no innovation at all. With a core focus on delivery and access of Kit Yamoyo, we wanted to better understand the specific populations being reached. This critical understanding is central to ensuring equality. We therefore disaggregated our key outcomes to better understand utilization amongst specific high-risk groups. The table below provides a summary of usage amongst these groups.
Category | Proportion of HH’s with an Individual in Category | Proportion of HH’s Reached with Kit Yamoyo and with an Individual in Category (in last 2 weeks or amongst ever users) |
Female Headed Household | 27% | 48% in last 2 weeks |
Persons with Disability in Household | 4% | 4% in last 2 weeks |
Caregiver Reporting Person Living with HIV/AIDS in Household | 5% | 8% in last 2 weeks |
Orphan in Household | 20% | 32% in last 2 weeks |
Households with > 6 People | 26% | 24% of ever kit users |
Primary Caregiver with no Primary Education | 3% | 8% in last 2 weeks |
Households Meeting Definition for Extreme Poor | Of those that ever used the Kit Yamoyo, ~8% would be considered extremely poor |
Figure 4 – Monthly Income of Ever Kit Yamoyo Users (showing line of extreme poverty)
Note: USD $1.90/day threshold or K19.50 is used to define extremely poor (i.e. ~K585/month)
(source: odi.org/comment/9934-definition-extreme-poverty-has-just-changed-here-s-what-you-need-know)
6. Discussion and Conclusions
What do some of our key findings tell us?
- In Lusaka, we have achieved a coverage level of 33% for ORS and Zinc. While this is a significant improvement over baseline (13%), we haven’t managed to hit the coverage rates seen in KYTS-ACE or COTZ. Does the combination approach of having kits available in the public and private sectors lead to higher coverage rates? Likely. Are there factors that make it more difficult to achieve higher coverage rates in more densely populated urban settings than in rural settings with fewer access options? What are these factors? We have more questions!
- As with our KYTS-ACE endline findings, correct preparation of ORS was no better in Kit Yamoyo users than in non-Kit Yamoyo users (i.e. 1L sachet users). This was disappointing at first, but prompted me to look further at the data. After disaggregating by kit type, here is what we found:
- 51% of Kit Yamoyo users used the Kit Yamoyo “ESSENTIAL” flexi-pack without soap, 25% used the flexi-pack with soap, 9% used the screw-top, and 9% used the GRZ version (limited distribution in Lusaka).
- 55-59% of those that used the private sector flexi-pack models prepared the solution correctly;
- 69% of those that used the GRZ Flexi-pack prepared the ORS in the correct concentration (perhaps because of more direction from health centres).
- Although the sample size was smaller, 100% of those who used the screw-top version prepared the ORS solution in the correct concentration.
- Only 65% of the 1L sachet users consumed the full amount of solution prepared. In 88% of cases, residual solution was thrown out. The quantity of discarded solution ranged from 250ml (37%), to 500ml (42%), to more than 500ml (21%). This data provides additional support for smaller, 200ml, sachet sizes as per those designed for the Kit Yamoyo.
- Only 51% of Kit Yamoyo users said they were aware that they could use the packaging/container as a measure for the water used to prepare the ORS, despite it being clearly articulated/diagramed in the instructions and on the packaging itself. The use of the flexi-pack as a measure seems not to be as intuitive as the formats with rigid containers (the original Aidpod trial format and screw-top). More needs to be done to promote this functionality.
- One thing’s for sure (also supported by research from other countries), co-packaging helps increase coverage of ORS and Zinc.
- Please see additional conclusions/recommendations from the KYTS ACE-Endline, which continue to be supported by these KYTS-LUSAKA findings
7. Limitations
Because the survey was conducted soon after a cholera epidemic (which took place within some of the Lusaka compounds sampled (Oct 2017-Feb/Mar 2018) and included the enforcement of emergency measures), respondents may have had reservations in sharing information relating to diarrhoea out of fear of reprisal. There is likely to have been under-reporting, particularly with regard to incidence/prevalence of diarrhoeal disease. Thus, findings should be interpreted within this context, and are likely to be conservative estimations.
Any questions?
Please comment on this blog post with any questions you have.