Evaluation of performance and perceived utility of mental healthcare indicators in routine health information systems in five low- and middle-income countries

Abstract

In most low- and middle-income countries (LMIC), routine mental health information is unavailable or unreliable, making monitoring of mental healthcare coverage difficult. This study aims to evaluate a new set of mental health indicators introduced in primary healthcare settings in five LMIC.

Method A survey was conducted among primary healthcare workers (n = 272) to assess the acceptability and feasibility of eight new indicators monitoring mental healthcare needs, utilisation, quality and payments. Also, primary health facility case records (n = 583) were reviewed by trained research assistants to assess the level of completion (yes/no) for each of the indicators and subsequently the level of correctness of completion (correct/incorrect – with incorrect defined as illogical, missing or illegible information) of the indicators used by health workers. Assessments were conducted within 1 month of the introduction of the indicators, as well as 6–9 months afterwards.

Results Across both time points and across all indicators, 78% of the measurements of indicators were complete. Among the best performing indicators (diagnosis, severity and treatment), this was significantly higher. With regards to correctness, 87% of all completed indicators were correctly completed. There was a trend towards improvement over time. Health workers' perceptions on feasibility and utility, across sites and over time, indicated a positive attitude in 81% of all measurements.

Conclusion This study demonstrates high levels of performance and perceived utility for a set of indicators that could ultimately be used to monitor coverage of mental healthcare in primary healthcare settings in LMIC. We recommend that these indicators are incorporated into existing health information systems and adopted within the World Health Organization Mental Health Gap Action Programme implementation strategy.