PMA2014/Kaduna Round 1 Indicators

Round 1 Sample Design

In Nigeria, the PMA2020 survey collects data at the state-level to allow for the estimation of key indicators to monitor progress in family planning - both at the population and the service delivery points (SDPs) levels. The resident enumerator (RE) model enables replication of the surveys twice a year for the first two years, and annually each year after that, to track progress.

For the first round of data collection in the Kaduna state (PMA2014/Kaduna), the sample was designed to provide state-level estimates with urban-rural stratification, using a two-­stage cluster design. First, the primary sampling unit were selected systematically within with probability proportional to size. The master frame of Enumeration Areas (EAs) was based on the 2006 Nigerian population census. Census enumeration areas in Nigeria are on average 47 households in size. In order to obtain an enumeration area of approximately 200 households, a cluster of EAs was constructed – hereinafter referred to as EA cluster. An index enumeration area, along with a list of contiguous EAs and associated sampling probabilities, were provided by the National Population Commission (NPopC). EAs were combined into EA clusters - primary sampling units in Nigeria - and sampling probabilities were adjusted. A total of 66 EA clusters were selected in Kaduna.

In each selected EA cluster, all households, health SDPs, and key landmarks in the EA cluster were listed and mapped by trained REs to create a sampling frame for the second stage of the sampling process. The mapping and listing process and data collection took place between September and October 2014. Mapping and listing took an average of 5 days for each EA cluster. Once listed, field supervisors systematically selected 35 households using a random number-generating mobile-phone application. All eligible women in selected households were approached and asked to provide informed consent to participate in the survey. Using this multistage sampling procedure and anticipated non-response rates, PMA2014/Kaduna had a final sample size of 2,309 households and 2,635 eligible women. Weights were adjusted for non-response at the household and individual levels and applied to appropriate estimates in this report.

For the SDP survey, up to three private SDPs, including pharmacies, within each sampled EA cluster boundary were randomly selected from the listing. In addition, three public health SDPs—a health post, a health center, and a district hospital designated to serve the EA population—were selected.

For the SDP survey, up to three private SDPs, including pharmacies, within each sampled EA cluster boundary were randomly selected from the listing. In addition, three public health SDPs—a health post, a health center, and a district hospital designated to serve the EA population—were selected.

PMA2020 uses standardized questionnaires to gather data about households and individual females that are comparable across program countries and consistent with existing national surveys. Prior to launching the survey in each country, local experts review and modify these questionnaires to ensure all questions are appropriate to each setting. All female questionnaires were translated into the local languages.

The household, female and service delivery point (SDP) questionnaire were based on model surveys designed by PMA2020 staff at the Bill & Melinda Gates Institute for Population and Reproductive Health at the Johns Hopkins Bloomberg School of Public Health in Baltimore, Maryland, USA, the Center for Evaluation Resources and Development (CRERD), the Population and Reproductive Health Program (PRHP) at the Obafemi Awolowo University in IleIfe, and Bayero University Kano (BUK), and fieldwork materials of the Nigeria Demographic and Health Survey (DHS). All PMA2020 questionnaires are administered using Open Data Kit (ODK) software and Android smartphones. The PMA2014/Kaduna-R1 questionnaires were in English and could be switched into local languages (Hausa and Yoruba) on the phone. The questionnaires were translated using available translations from similar population surveys and experts in translation. The interviews were conducted in the local language, or English in a few cases when the respondent was not comfortable with the local language. Female resident enumerators in each enumeration area (EA) administered the household and female questionnaires in the selected households.

The household questionnaire gathers basic information about the household, such as ownership of livestock and durable goods, as well as characteristics of the dwelling unit, including wall, floor and roof materials, water sources, and sanitation facilities. This information is used to construct a wealth quintile index.

The first section of the household questionnaire, the household roster, lists basic demographic information about all usual members of the household and visitors who stayed with the household the night before the interview. This roster is used to identify eligible respondents for the female questionnaire. In addition to the roster, the household questionnaire also gathers data that are used to measure key water, sanitation, and hygiene (WASH) indicators, including regular sources and uses of WASH facilities used and prevalence of open defecation by household members.

The female questionnaire is used to collect information from all women age 15 to 49 who were listed on the household roster at selected households. The female questionnaire gathers specific information on: education; fertility and fertility preferences; family planning access, choice and use; quality of family planning services; exposure to family planning messaging in the media; and the burden of collecting water on women.

The SDP questionnaire collected information about the provision and quality of reproductive health services and products, integration of health services, and water and sanitation within the SDP.

Training

The PMA2014/Kaduna-R1 fieldwork training started in September 2014 with central staff, supervisors and resident enumerators (REs). PMA2020 staff from the Bill & Melinda Gates Institute for Population and Reproductive Health of the Johns Hopkins Bloomberg School of Public Health led the training, with support from CRERD and BUK project staff. The training was held in Kaduna State. The field supervisors then became the trainers for the two subsequent RE training sessions that took place in September 2014.

Data Collection and Processing

Data collection was conducted between September and October 2014. Unlike traditional paper-and-pencil surveys, PMA2020 uses Open Data Kit (ODK) Collect, an open-source software application, to collect data on mobile phones. All the questionnaires were programmed using this software and installed onto all project smartphones. The ODK questionnaire forms are programmed with automatic skip-patterns and built-in response constraints to reduce data entry errors.

The ODK application enabled REs and supervisors to collect and transfer survey data to a central ODK Aggregate cloud server. This instantaneous aggregation of data also allowed for concurrent data processing and course corrections while PMA2020 was still active in the field. Throughout data collection, central staff at CRERD, and the data manager at the Gates Institute at Johns Hopkins in Baltimore, Maryland routinely monitored the incoming data and notified field staff of any potential errors, missing data or problems found with form submissions on the central server. The use of mobile phones combined data collection and data entry into one step; therefore, data entry was completed when the last interview form was uploaded at the end of data collection in October.

Once all data were on the server, data analysts cleaned and de-identified the data, applied survey weights, and prepared the final dataset for analysis using Stata.

This table shows response rates of household and female respondents for PMA2014/Kaduna-Round 1 survey. Of the 2,309 households selected 2,287 (99.0%) households were occupied at the time of the fieldwork. Among the 2,287 potential respondents, 2,194 consented to the household interview (95.9% response rate).

In the selected households 2,618 eligible women age 15 to 49 years were identified and 2,569 of them were interviewed (response rate of 98.1%).

To view the sample errors for the PMA2020 indicators described above, download the full SOI report here. For more information about PMA2020 indicators, including estimate type and base population, click here.