PMA2014/Kenya Round 2 Indicators

Round 1 Sample Design

The PMA2020 survey collects data annually at the national (urban and rural) and regional levels to allow for the estimation of key indicators to monitor progress in family planning. The resident enumerator (RE) model enables replication of the surveys twice a year for the first two years, and annually each subsequent year, to track progress.

PMA2014/Kenya Round 1 used a multi-stage cluster design with urban/rural and county as strata. The first stage of sampling was at the county level using probability proportional to size procedures to select nine out of 47 counties: Nairobi, Kilifi, Nandi, Nyamira, Kiambu, Bungoma, Siaya, Kericho and Kitui. Within the nine selected counties, 120 enumeration areas (EAs) were selected proportional to size with urban/rural stratification. The sample was powered to generate national and urban/rural estimates of all woman mCPR with less than 3% margin of error.

In each selected EA, field supervisors randomly selected up to three private service delivery points (SDPs) to be interviewed by an RE using the SDP questionnaire. The field supervisors themselves administered the SDP questionnaires at an additional three public SDPs that serve each EA - the lowest, second-lowest and third-lowest level public health SDPs designated to serve each EA (a dispensary, a health center and a referral hospital), either at the sub-county or county level.

Round 2 Sample Update

Data collection for Round 2 continued in the same 120 EAs selected in Round 1. Mapping and listing in PMA2020 is generally done on an annual basis (typically during the first and third rounds). As Round 2 occurred approximately six months after Round 1, the original listing frame was used for Round 2. Field supervisors randomly selected 42 households from the original household listing. A household roster was completed and all eligible women age 15-49 in selected households were approached and asked to provide informed consent (and assent if aged 15-17 years) to participate in the study.

The majority of SDPs are repeated in each round, forming a panel survey. If an EA had more than three private SDPs identified during the listing process, then a new sample of the private SDPs is selected during each round.

PMA2020 uses standardized questionnaires for households, individual females and service delivery points (SDPs) to gather data about households and individual females that are comparable across program countries and consistent with existing national surveys. Prior to launching the survey in each country, local experts review and modify these questionnaires to ensure all questions are appropriate to each setting.

Three questionnaires were used to collect data from the PMA2014/Kenya-R2 survey: the household questionnaire, the female questionnaire and the service delivery point (SDP) questionnaire. These questionnaires were based on model surveys designed by PMA2020 staff at the Bill & Melinda Gates Institute for Population and Reproductive Health in Baltimore and fieldwork materials of the 2008-09 Kenyan Demographic and Health Survey (KDHS). All PMA2020 questionnaires are administered using Open Data Kit software and Android smartphones. The PMA2014/Kenya-R2 questionnaires were in English and could be switched into Kiswahili on the phone. The questionnaires were translated using available translations from similar population surveys and experts in translation. Female resident enumerators in each enumeration area administered the household questionnaire and female questionnaire in selected households.

The household questionnaire gathers basic information about the household such as ownership of livestock and durable goods, as well as characteristics of the dwelling unit including wall, floor, and roof materials, water sources and sanitation facilities. The first section of the household questionnaire, the household roster, lists basic demographic information about all usual members of the household and visitors who stayed with the household the night before the interview. This roster is used to identify eligible respondents for the female questionnaire. In addition to the roster, the household questionnaire also gathers data that are used to measure key water, sanitation and hygiene (WASH) indicators, including regular sources and uses of water, sanitation facilities used and prevalence of open defecation by household members.

The female questionnaire is used to collect information from all women age 15-49 who were listed on the household roster at selected households. The female questionnaire gathers specific information on education; fertility and fertility preferences; family planning access, choice and use; quality of family planning services; exposure to family planning messaging in the media; and the burden of collecting water on women.

The SDP questionnaire collected information about the provision and quality of reproductive health services and products, integration of health services, and water and sanitation within the health facility.

Training

The PMA2014/Kenya-R2 fieldwork training started with a three-day refresher training for all returning field staff, held from October 21-23, 2014 and led by PMA2020 staff from the Bill & Melinda Gates Institute for Population and Reproductive Health and staff from the International Centre for Reproductive Health Kenya (ICRH-K), PMA2020’s implementing partner. The training was held in Nairobi, Kenya. A total of 120 resident enumerators received training. All training participants were given instructions on survey changes to the tools since the previous round.

Throughout the training, resident enumerators (REs) and supervisors were evaluated based on their performance on phone-based assessments. The RE training was conducted primarily in English, whereas some small group review sessions were conducted in Kiswahili.

Supervisors received additional training prior to and after the RE training to further strengthen their supervision skills, including instruction on conducting re-interviews, carrying out random spot checks, and dealing with the local/community leaders and engaging the communities.

Data Collection and Processing

Data collection was conducted between November and December 2014. Unlike traditional paper-and-pencil surveys, PMA2020 uses Open Data Kit (ODK) Collect, an open-source software application, to collect data on mobile phones. All the questionnaires were programmed using this software and installed onto all project smartphones. The ODK questionnaire forms are programmed with automatic skip-patterns and built-in response constraints to reduce data entry errors.

The ODK application enabled REs and supervisors to collect and transfer survey data to a central ODK Aggregate cloud server. This instantaneous aggregation of data allowed for concurrent data processing and course corrections while PMA2020 was still active in the field. Throughout data collection, central staff at ICRH-K in Kenya and the data manager at the Gates Institute in Baltimore routinely monitored the incoming data and notified field staff of any potential errors, missing data or problems found with form submissions on the central server. The use of mobile phones combined data collection and data entry into one step; therefore, data entry was completed when the last interview form was uploaded at the end of data collection in December.

Once all data were on the server, data analysts cleaned and de-identified the data, applied survey weights, and prepared the final data set for analysis using Stata® version 14 software. The national dissemination workshop of preliminary results was held on July 15 at the Sarova, Panafric Hotel in Nairobi, Kenya.

This table shows response rates for household and female respondents by residence (rural/urban) for PMA2014/Kenya-R2. A total of 5,038 households were selected for the PMA2014 survey; 4,803 households were found to be occupied at the time of the fieldwork. Ninety-six percent (4,604) of the occupied households consented to a household-level interview. The response rate at the household level was higher in rural (98.2%) than in urban (92.6%) area.

In the occupied households that provided an interview, a total of 4,403 eligible women aged 15 to 49 years were identified. Overall, 98.3% of the eligible women were available and consented to the interview. The female response rate was slightly higher in the rural (98.6%) relative to the urban (97.9%) EAs. Only de facto females are included in the PMA analyses; the final completed de facto female sample size was 4,329.

The final SDP sample include 354 facility interviews, of which 324 were completed for a response rate of 91.5%

To view the sample errors for the PMA2020 indicators described above, download the full SOI report here. For more information about PMA2020 indicators, including estimate type and base population, click here.