PMA2014/Ethiopia Round 1 Indicators

The PMA2020 survey collects annual data at the national and regional levels to allow the estimation of key indicators to monitor progress in family planning. The resident enumerator model enables replication of the surveys each year, and every six months for the first two years, to track progress.

For the first round of data collection (referred to as PMA2014/Ethiopia), the survey targeted a sample size of 200 enumeration areas, which were selected by CSA to be representative at the national level (including urban and rural areas) and in 5 of 11 regional divisions. The enumeration areas were selected systematically with probability proportional to size and urban or rural stratification in the 10 regions (excluding Addis Ababa city, which is only urban). The sample sizes for five regions (Amhara, Oromiya, SNNPR, Tigray and Addis Ababa city) were designed to provide regional estimates. CSA provided the enumeration area selection probabilities for the PMA2020 sampled clusters for constructing weights.

Prior to data collection, all households, health SDPs and key landmarks in each enumeration area were listed and mapped by the resident enumerators to create a frame for the second stage of the sampling process. This mapping and listing process took place in the first week of data collection in each enumeration area. Once listed, 35 households were randomly selected by field supervisors using a phone-based random number-generating application. All occupants in selected households were enumerated and from this list, all eligible women were approached and asked to give informed consent to participate in the study.

Up to three private SDPs within each enumeration area boundary were randomly selected from the listing. In addition, three public health SDPs—a health post, a health center, and a district hospital designated to serve the enumeration area population—were selected.

Weights were adjusted for non-response at the household and individual levels and applied to all household and individual estimates in this report.

PMA2020 uses standardized questionnaires for households and SDPs to gather data that is comparable across program countries and consistent with existing national surveys. Prior to launching the survey in each country, these questionnaires are reviewed and modified by local experts to ensure all questions are appropriate to each setting.

Three questionnaires were used to collect data from the PMA2014/Ethiopia-R1 survey: the household questionnaire, the female questionnaire and the service delivery point (SDP) questionnaire. These questionnaires are based on model surveys designed by PMA2020 staff at the Bill & Melinda Gates Institute for Population and Reproductive Health in Baltimore, Addis Ababa University (AAU), and fieldwork materials of the 2011 Ethiopia Demographic and Health Survey (EDHS).

All PMA2020 questionnaires are administered using Open Data Kit (ODK) software installed on mobile phones (smartphones) using the Android operating system. The PMA2014/Ethiopia questionnaires appeared in three local languages (Amharic, Afan Oromo and Tigrigna), in addition to English.

Female resident enumerators in each enumeration area administered the household questionnaire and female questionnaire in selected households, and the SDP questionnaire for sampled private SDPs. PMA2014/Ethiopia field supervisors administered the SDP questionnaire in public SDPs.

The household questionnaire gathers basic information about the household that is used to construct a wealth quintile index, such as ownership of durable goods, as well as characteristics of the dwelling unit, including wall, floor, and roof material, water sources and sanitation facilities. Using PMA2020’s innovative mobile technology, the household questionnaire is then linked with the female questionnaire, allowing for disaggregation of the indicators generated by data from the female questionnaire into household wealth quintiles.

The first section of the household questionnaire, the household roster, lists basic demographic information about all usual members of the household and visitors who stayed with the household the night before the interview. This roster is used to identify eligible respondents for the female questionnaire. In addition to the roster, the household questionnaire also gathers data that are used to measure key water, sanitation and hygiene (WASH) indicators, including regular sources and uses of water, sanitation facilities used and prevalence of open defecation by household members

The female questionnaire is used to collect information from all women ages 15 to 49 who were listed on the household roster at selected households. The female questionnaire gathers specific information on education; fertility and fertility preferences; family planning access, choice and use; quality of family planning services; exposure to family planning messaging in the media; and the burden of collecting water on women.

In each selected enumeration area, field supervisors randomly selected up to three private SDPs to be interviewed by a resident enumerator using the SDP questionnaire. The field supervisors themselves administered the SDP questionnaires at an additional three public SDPs that serve each enumeration area.

The SDP questionnaire collected information about the provision and quality of reproductive health services and products, integration of health services, and water and sanitation within the health facility.

Training

The PMA2014/Ethiopia fieldwork training started with a two-week training of trainers of 5 regional coordinators, 30 field supervisors, and 3 central staff that was conducted from October 28 to November 8, 2013. The training was led by PMA2020 staff from the Bill & Melinda Gates Institute for Population and Reproductive Health. These field supervisors then became the trainers for four subsequent resident enumerator training sessions, with the first two trainings taking place from November 20 to November 30, 2013 in Bishoftu and January 1st to 4th, 2014 at Red Cross Training Center in Addis Ababa. In addition, concurrent trainings in Addis Ababa, Gondar, and Mekele towns were held January 14 to 24, 2014; a total of 200 resident enumerators received training.

All training participants were given comprehensive instruction on how to complete the household, female, and SDP questionnaires. In addition to PMA2020 survey training, all participants received training on contraceptive methods by an Ethiopian obstetrician/gynecologist.

Throughout the trainings, resident enumerators and supervisors were evaluated based on their performance on several written and phone-based assessments, mock field exercises and class participation. As all questionnaires were completed on project smartphones, the training also familiarized participants with Open Data Kit and smartphone use in general. All trainings included three days of field exercises, during which participants entered a mock enumeration area to practice listing, mapping and conducting household, female and SDP interviews; recording all responses on their project phones; and submitting to a practice cloud server—a centralized data storage system. The resident enumerator trainings were conducted primarily in Amharic, whereas some small group sessions were conducted in Afan Oromo and Tigrigna.

Supervisors received additional training on how to oversee fieldwork and complete household re-interviews used to carry out random spot-checks in 10 percentage of the households interviewed by resident enumerators.

Data Collection & Processing

Data collection was conducted between January and March 2014.

Unlike traditional paper-and-pencil surveys, PMA2020 uses Open Data Kit Collect, an open-source software application, to collect data on mobile phones. All the questionnaires were programmed using this software and installed onto all project smartphones. The Open Data Kit questionnaire forms are programmed with automatic skip-patterns and built-in response constraints to prevent data entry errors.

The Open Data Kit Collect application enabled resident enumerators and supervisors to collect and transfer survey data, via the General Packet Radio Service network, to a central Open Data Kit Aggregate cloud server in real time. This instantaneous aggregation of data also allowed for realtime monitoring of data collection progress, concurrent data processing and course corrections while PMA2020 was still active in the field. Throughout data collection, central staff at AAU in Ethiopia and a data manager in Baltimore routinely monitored the incoming data and notified field staff of any potential errors, missing data or problems found with form submissions on the central server.

The use of mobile phones combined data collection and data entry into one step; therefore, data entry was completed when the last interview form was uploaded at the end of data collection in March.

Once all data were on the server, data analysts cleaned and de-identified the data, applied survey weights, and prepared the final data set for analysis using Stata® version 12 software. Ongoing data analysis was conducted between February and May 2014 and the national dissemination workshop was held on May 27, 2014, in Addis Ababa, Ethiopia.

This table shows response rates at the household and female respondent levels for both PMA2014/Ethiopia-R1 and the EDHS 2011. Of the households selected for surveys, a total of 6,919 households were found to be occupied at the time of the fieldwork. Of these 6,919 potential respondents, 6,772 consented to the household interview, for a response rate of 97.9%. The response rate was similar for both urban and rural areas (97.9%).

In the selected households, 6,611 eligible women ages 15 to 49 were identified, and 6,468 of them participated in interviews (97.8% response rate). The participation rate was similarly high in urban areas (98.0%) and rural areas (97.6%).

To view the sample errors for the PMA2020 indicators described above, download the full SOI report here. For more information about PMA2020 indicators, including estimate type and base population, click here.