- Open Access
Promoting good policy for leadership and governance of health related rehabilitation: a realist synthesis
© The Author(s). 2016
Received: 29 January 2016
Accepted: 1 August 2016
Published: 24 August 2016
Good governance may result in strengthened performance of a health system. Coherent policies are essential for good health system governance. The overall aim of this research is to provide the best available scientific evidence on principles of good policy related leadership and governance of health related rehabilitation services in less resourced settings. This research was also conducted to support development of the World Health Organization’s (WHO) Guidelines on health related rehabilitation.
An innovative study design was used, comprising two methods: a systematic search and realist synthesis of literature, and a Delphi survey of expert stakeholders to refine and triangulate findings from the realist synthesis. In accordance with Pawson and Tilley’s approach to realist synthesis, we identified context mechanism outcome pattern configurations (CMOCs) from the literature. Subsequently, these CMOCs were developed into statements for the Delphi survey, whereby 18 expert stakeholders refined these statements to achieve consensus on recommendations for policy related governance of health related rehabilitation.
Several broad principles emerged throughout formulation of recommendations: participation of persons with disabilities in policy processes to improve programme responsiveness, efficiency, effectiveness, and sustainability, and to strengthen service-user self-determination and satisfaction; collection of disaggregated disability statistics to support political momentum, decision-making of policymakers, evaluation, accountability, and equitable allocation of resources; explicit promotion in policies of access to services for all subgroups of persons with disabilities and service-users to support equitable and accessible services; robust inter-sectoral coordination to cultivate coherent mandates across governmental departments regarding service provision; and ‘institutionalizing’ programmes by aligning them with preexisting Ministerial models of healthcare to support programme sustainability.
Alongside national policymakers, our policy recommendations are relevant for several stakeholders, including service providers and service-users. This research aims to provide broad policy recommendations, rather than a strict formula, in acknowledgement of contextual diversity and complexity. Accordingly, our study proposes general principles regarding optimal policy related governance of health related rehabilitation in less resourced settings, which may be valuable across diverse health systems and contexts.
Governance of health systems comprises the actions adopted by a society to organize itself to promote the health of its population . Although governance is the least understood component of health systems, it impacts on all other health system functions . Good governance may result in strengthened performance of a health system, including effective delivery of health services, and improved health outcomes [2, 3]. Governance has in recent years transitioned to the fore of the international development agenda, indicating a shift from attention to micro level, project specific objectives to macro level issues of policy-making .
Policymakers in less resourced settings are required to know how to most effectively strengthen the performance of health systems . Recent developments in the social model and human rights perspective on disability and rehabilitation require that the complexities of leadership and governance be addressed through a participative, transparent, well-defined and structured framework [2, 6]. In many resource poor settings, however, patchworks of health services and different service providers are prevalent , with such fragmentation resulting in increased barriers to accessing health services, provision of poor quality services, inefficient use of resources, duplication of services, and decreased service-user satisfaction . Coherent but flexible policies, which weave together health related human rights and opportunities, are essential to promote good governance and leadership of health systems.
Rehabilitation is central to a health system addressing the needs of its population . Rehabilitation is a valuable resource for persons with disabilities, directly contributing to individual wellbeing as well as the socioeconomic development of the community . Rehabilitation may be defined as ‘a set of measures that assist individuals who experience, or are likely to experience, disability to achieve and maintain optimal functioning in interaction with their environments’ (pp. 96) . Rehabilitation and disability in the broader sense are contested concepts however [12, 13], and therefore their application in healthcare continues to be complex and challenging. Conversely, this dynamic also offers opportunities to create innovative leadership and governance mechanisms.
As stated in the Declaration of Alma Ata , rehabilitation services are an essential component of primary healthcare aiming to address the main health issues in the community. Importantly, as advocated by the Community Based Rehabilitation (CBR) Guidelines, the health related aspects of rehabilitation are strongly connected to the broader needs, rights, aspirations and wellbeing of persons with disabilities, including in areas relating to education, livelihood, social and empowerment, to enhance quality of life . As emphasized by the United Nations Convention on the Rights of Persons with Disabilities (UNCRPD) , comprehensive rehabilitation services are required in the areas of health, employment, education and social services to support participation and inclusion in the community and all aspects of society.
Rationale for realist synthesis
The overall aim of this research is to provide the best available scientific evidence on principles of good policy related leadership and governance of health related rehabilitation services in less resourced settings. This research was also conducted to support the development of the WHO Guidelines on health related rehabilitation, positioned in the context of the WHO ‘Framework for Action’ for strengthening health systems , which comprises leadership and governance as one of six components.
Our aim is to provide broad recommendations for successful policy related leadership and governance of health related rehabilitation in less resourced settings, rather than to offer a strict formula, which would fail to recognize the diversity and complexity of specific national, regional and local contexts. Healthcare systems may be conceptualized as complex adaptive systems (CAS) [18, 19], which are influenced by many factors, including service delivery, health workforce, information, medical products, vaccines and technologies, financing, and leadership and governance . As emphasized by Best et al. , ‘although CAS are complex and unpredictable, they are amenable to guided transformation by applying simple rules that are sufficiently flexible to allow for adaptation’ (pp. 423). Policy recommendations arising from a CAS perspective avoid complicated checklists and specific directions for change; rather, the local context is examined and findings are produced as broad principles of action – in contexts such as X, try Y . Accordingly, through conducting this research, we aim to enable 'guided transformation' of policy for leadership and governance of health related rehabilitation in less resourced settings by proposing 'simple rules' or broad recommendations, which require contextual adaptation due to variation in structures, systems, and resources.
Governments’ complex assortment of responsibilities and actors indicates that strategies to change national governments’ role in the performance of the health system should not be considered in isolation; rather, these strategies need to be understood in the broader context in which they occur . Accordingly, policymakers are required to understand how and why programmes work and do not work in different contexts, to support their decision-making of which policies or programmes to use and how to adapt them to local contexts .
According to Pawson et al. , the basic task of the realist synthesis process is to formulate answers to what is it about this type of intervention that works, for whom, in what circumstances, in what respects, and why . Realist methods are being increasingly used to explore complex public health issues . Realist syntheses can provide policymakers with rich and pragmatic information with regards to complex health interventions for planning and implementing programmes .
Realist approaches assume that nothing works for everyone or in every context; and that context significantly influences programme outcomes, signified by the basic realist formula in Pawson and Tilley’s model of ‘mechanism + context = outcome’ . Pawson et al.  argue that understanding what works in social interventions requires establishing causal relationships. In realist inquiry, the cause–effect relationship (for instance as represented by X causes Y) is rigorously explored by trying to determine just how a causal outcome (O) between two events (X and Y) is actually brought about (the mechanism (M)), through the context (C) in which the relationship occurs.
We therefore sought to identify effective patterns and pathways from the contexts, mechanisms, and outcomes of the studies included in the realist synthesis using the context mechanism outcome pattern configurations (CMOCs) formulation of realist synthesis methodology .
Overarching research question
Consistent with realist syntheses [23, 26], a programme theory was created through an iterative process comprising consultation with research team members and exploring relevant literature to formulate a theoretically based evaluative framework for the research question.
‘What policies, including processes of policy development, implementation, monitoring and evaluation, promote good leadership and governance of health related rehabilitation in less resourced settings?’
Both a systematic searching approach and snowballing were used for the literature search, closely following the Cochrane Collaboration Guidelines for conducting a systematic review .
Inclusion and exclusion criteria for realist review
2003 – present.
Searching will be conducted in English, with any non-English titles to be translated.
Types of Research
Qualitative, quantitative and mixed methods:
- Intervention studies
- Descriptive studies
Research and development studies.
Types of Documents
Primary and secondary (review) studies, including:
- Journal articles, book chapters, policy reports, technical reports, conference proceedings and reports, and accessible dissertations.
Addresses the following:
- Rehabilitation AND leadership/governance with a focus on policy
- Low-income setting OR can be applied to a low-income setting
Prior to 2003.
Types of Research
Types of Documents
Book reviews, abstracts, bibliographies.
- Rehabilitation services delivered by different sectors, i.e. vocational rehabilitation
- Not applicable to a low-income setting
- Non-disability related services
Codes for Exclusion
Rehabilitation – Article does not relate to issues of rehabilitation.
Policy – Article does not relate to leadership/governance with a focus on policy.
Setting – Study location not applicable.
Research – Research method does not fit inclusion criteria.
Document – Document type does not fit inclusion criteria.
Search terms for systematic search of literature
1(a) AND 2 AND 3
1(b) AND 2 AND 3
1 (a) Leadership AND policy.
1 (b) Governance AND policy.
2. CAHD OR CBR OR ‘Community approaches to handicap in development’ OR ‘Community based inclusive development’ OR ‘Community rehabilitation’ OR ‘Community based rehabilitation’ OR ‘Functional restoration’ OR Habilitation OR ‘Health related rehabilitation’ OR ILD OR ‘Inclusive local development’ OR ‘Participatory community development’ OR Rehab* OR Rehabilitation OR ‘Restoration of function’ OR (Rehabilitation w/3 (care OR services OR support OR therapy)) OR ((therapy OR therapies) w/3 (cognitive OR complementary OR occupational OR physical OR recreational OR respiratory OR social OR speech)).
3. Africa OR Asia OR Caribbean OR ‘Central America’ OR ‘Eastern Europe’ OR ‘Latin America’ OR ‘Less resourced’ OR LMIC OR LIC OR ‘Low income countries’ OR ‘Low income country’ OR ‘Low and middle income countries’ OR ‘Low and middle income country’ OR Pacific OR ‘South America’ OR ‘Third world’ OR ((developing OR ‘less developed’ OR ‘least developed’ OR ‘under developed’ OR poor) w/3 (countries or country or nation or nations)).
Databases were selected as those most relevant to disability, health related rehabilitation, and governance. The following 11 databases were used in the search: PubMed, WHOLIS, Embase, AIM (African Index Medicus), ABI Inform, LILACS, PsycINFO, SCIE, Rehabdata, Scopus, and CIRRIE. A search was also conducted on the archives of the journal ‘Disability, CBR and Inclusive Development’ as these archives were not included in the databases outlined above.
Snowballing comprised emailing organizations outlined by the Office of the United Nations High Commissioner for Refugees  and other organizations identified by the research team; contacting team members and other stakeholders to request relevant documents; performing searches on search engines; and searching references of relevant reviews and of all included articles.
Selection and appraisal of documents
Articles were selected for inclusion in the realist synthesis in numerous stages. At each stage, multiple reviewers from the research team reviewed and selected articles. Articles identified through the databases search were reviewed on article title and, if identified as appropriate, were subsequently reviewed based on abstract and then full text by two researchers from the research team independently. A third reviewer mediated any diverging opinions between the two researchers so that a decision was reached. All appropriate documents from snowballing were reviewed based on full text. Throughout each stage, at least one reviewer had experience in disability and/or rehabilitation and one in health governance/policy.
Quality rating of articles
The methodological quality of all included articles was assessed using the Mixed Methods Appraisal Tool (MMAT)  – a tool designed for the appraisal stage of complex systematic literature reviews that include qualitative, quantitative and mixed methods studies. In accordance with the MMAT, all articles were assigned a score between one and four, whereby one = 25 %, two = 50 %, three = 75 % and four = 100 %, indicating their methodological quality. A score of ‘N/A’ was assigned to articles that could not be appraised as a qualitative, quantitative or mixed methods study.
For each article, information was collected on CMOCs. A comprehensive, systematic and transparent process of data analysis was developed, involving the design of a data extraction template. Using the template, reviewers extracted CMOCs from each article, and subsequently linked these CMOCs to the research question. Two reviewers, one working in rehabilitation studies and one with a background in disability and policy analysis, independently extracted CMOCs from articles. The reviewers reviewed all included articles and for each article completed as much of the data extraction template as possible according to the information provided by the article. This process was frequently discussed amongst the research team to support the consistency and validity of findings.
The primary reviewer synthesized the findings from both reviewers’ CMOCs-extraction of articles. For this process, a data analysis matrix was developed, adapted from a previous realist synthesis . Accordingly, through coding using content and thematic analyses, the primary reviewer identified and synthesized substantial and frequent patterns of CMOCs from both reviewers’ CMOCs.
The methodology for the second phase was a Delphi study. The Delphi study attained ethical approval from the Health Policy and Management/Centre for Global Health Research Ethics Committee of Trinity College Dublin, Ireland. The Delphi survey is a group facilitation technique, which has an iterative, multistage process, designed to convert individual opinion into group consensus . The Delphi aims to achieve consensus on the opinions of experts through a series of structured questionnaires, which are completed anonymously by experts; responses are summarized between rounds and fed back to the participants through a process of controlled feedback, and this process is repeated until consensus is reached . Central to the Delphi method is its anonymity and confidentiality, iterations, controlled feedback, and arithmetic aggregation of group scores [35, 36].
Advantages of the Delphi include providing a mode of group decision-making whereby participants do not need to travel to a group meeting place; anonymity, thereby reducing the impact of social-emotional behavior and allowing participants to focus more so on task oriented activities; and avoidance of direct confrontation between group members [37, 38]. The structure of the Delphi comprises the positive attributes of interacting of interacting groups, including knowledge from diverse sources, while averting their negative components, due to social, personal and political conflicts; it allows input from a substantial number of participants who could conceivably convene in a group meeting, from participants who are geographically dispersed .
A panel of experts was recruited, described later in this article, based on experience and expertise in policy and/or rehabilitation, which could provide insight into leadership and governance for health-related rehabilitation. Prior to conducting the Delphi survey, a minimum of 10 participants and a maximum of 25 participants were chosen as the parameters for the sample size of the survey, in accordance with recommendations of sample sizes for Delphi studies .
Inclusion criteria for experts were the following: (1) Expert in their field; (2) previous experience working in a less resourced context; (3) previous experience/expertise in the area of leadership and governance; and (4) availability and willingness to participate. Exclusion criteria (criteria additional to not conforming to the inclusion criteria) comprised: (1) Already participating in another Delphi study; and (2) no experience/expertise in areas mentioned in the inclusion criteria.
The panel was recruited through purposeful sampling, specifically snowball sampling. The initial contact list for possible participants was created by the research team. All possible participants identified in the initial list were contacted; if they could not participate, they were asked to suggest other possible participants that fit the criteria. The research team was also included as possible participants in the Delphi as they were considered to be experts. Experts were recruited for the study until sufficient coverage of different categories of experts – service-users, service providers, and policy/decision-makers – was achieved.
For each survey round, participants were emailed with a link to the survey via Survey Monkey . Participants provided their level of agreement and comments in relation to the statements. These comments were used for further adjustments to the statements for the subsequent survey iteration. Statements were rated on a Likert scale ranging from one to five (Strongly Disagree to Strongly Agree). As guided by a previous Delphi Study on health related rehabilitation , a statement was considered to be ‘accepted’ or to have reached agreement amongst participants if it attained an average rating of four or above and a standard deviation of below one. Statements that were ‘not accepted’ in a survey round were revised based on participants’ comments, and were put forward to subsequent survey rounds.
Quality of articles
Based on MMAT guidelines, depending on each article’s attributes as a qualitative, quantitative or mixed methods study, one article was scored as one for its methodological quality rating; eight articles were scored as two for their quality ratings; eight articles were scored as three for their quality ratings; and two articles were scored as four for their methodological quality ratings. A further 17 articles were scored as N/A. Therefore, the methodological quality rating of 17 articles could not be assessed, as these articles did not fit the methodological criteria for assessment.
Context mechanism outcome pattern configurations and statements
Synthesized CMOCs for a sample included study
Reference: 01 Title: Araya R, Alvarado R, Sepulveda R, Rojas G. Lessons from scaling up a depression treatment program in primary care in Chile. Rev Panam Salud Pública. 2012;32(3):234-240.
System-wide or project-specific
Sectoral or inter-sectoral
Community mental health services; Depression; Healthcare delivery; Mental health; Chile.
Chile: Programa Nacional de Diagnóstico y Tratamiento de la Depresión) National Depression Detection and Treatment Program (PNDTD).
Retrospective qualitative study; In-depth semi-structured interviews with six key informants.
Depression treatment programme users.
This research reports on a summary of elements that led to scaling up and sustainability of the PNDTD programme, Chile, 2008.
Strategic alliances were created across sectors with strategic partners, between the Mental Health Unit and the Primary Care Division (PCD), and with the Ministry of Women.
Senior Officers at the Ministry of Health (MoH).
3 quality score –Qualitative.
1. Scientific Evidence
i) A national disease-burden study was conducted.
ii) Two large psychiatric morbidity surveys were conducted.
iii) Other studies showed that depression was also very common among primary care patients.
iv) A trial was conducted of cost-effectiveness of an improved treatment of depression through primary care in Chile.
v) A randomized controlled trial of a programme to improve the management of depressed women in the primary care setting showed positive results.
vi) The MoH hired an academic institution to undertake a small scale evaluation of the effectiveness of the programme.
1. i) The psychiatric morbidity surveys were used to advocate for more resources for the PNDTD.
ii) The studies were based on local data.
iii) The Mental Health Unit at the MoH leveraged available evidence effectively.
iv) A workable action plan was presented to policymakers.
v) There was ongoing communication between the research team and those designing the programme.
1. The MoH decided that depression would become the country’s third highest health priority for 2002.
1. Scientific evidence:
When scientific evidence on a disease burden is collected, and used to advocate for more resources; based on local data; and effectively leveraged and presented to policymakers with a workable action plan, a specific health issue can be established as a national health priority – even in a context of socioeconomic challenges such as in a low- or middle-income country.
2. Teamwork and Leadership
i) There was an informal team of leaders acting in parallel at different levels and with a shared vision.
2. Leaders shared common features: “politically friendly” and trustworthy; good at forming alliances; able to apply technical information; and good communicators.
2. Effective teamwork and leadership facilitated the creation of powerful strategic alliances, which facilitated institutionalizing the programme within the ministerial framework.
2. Teamwork and Leadership:
Effective teamwork and leadership – by a group of respected and “politically friendly” professionals acting as leaders in a team effort; who are capable of communicating effectively with decision-makers; with the capacity to detect emerging opportunities and react accordingly; who are capable of negotiating political agreements at all levels; who have at least basic technical knowledge, and can prepare a solid proposal; and who are trustworthy individuals capable of forming alliances with strategic partners – can create powerful strategic alliances, which can facilitate institutionalizing a programme within a ministerial framework.
3. Strategic Alliances
i) There was a strategic alliance between the Mental Health Unit and the PCD.
ii) Other strategic alliances were formed outside of the MoH, with the Ministry of Women and some universities.
3. i) A strong alliance was created – the Mental Health Unit had technical capacity while the PCD had resources.
ii) Academics provided information, which provided support for introducing the programme.
3. The PCD accepted ownership and management of the programme.
3. Strategic alliances:
Strategic alliances – with key individuals who have positions of political power in a MoH; across sectors with strategic partners; that can persist over time; and with other units by which a programme may be co-owned – can result in a PCD accepting ownership and management of a programme.
4. Programme Institutionalization
i) A gradual process occurred of “institutionalization” of the programme.
4. i) The programme was aligned with well-known models of care, similar to those of other ministerial programmes.
ii) The programme was introduced as another ministerial programme, complying with regulations and ring-fenced funding.
iii) New and ring-fenced funding was secured.
iv) A critical-mass of human resources was used.
v) The programme had itemized resource allocation, e.g. resource allocation for psychologists, medication, etc.
vi) The programme was highly structured in technical and financial terms.
4. The programme was highly sustainable.
4. Programme institutionalization:
Institutionalizing a programme – by using well recognized models of healthcare delivery within the MoH; placing the programme among other well established PCD programmes; introducing personnel that are widely available and at an affordable cost with the potential to lead the programme locally; and fence-ringing any new and essential financial resources – can result in strong programme sustainability.
i) Responsibility for most patient care was transferred to the PCD, away from specialized psychiatric services.
ii) Transfer of responsibilities from psychiatrists to psychologists was conducted, who were widely available at an affordable price.
iii) Psychologists were hired as key players.
5. Task-shifting may increase the availability of human resources, allowing more patients to receive treatment.
5. When the PNDTD was scaled up, psychologists were hired in all primary care centres and became the programme’s cornerstone.
5. Task shifting:
In contexts of a shortage of specialized health workers, task-shifting to less specialized health workers may increase the availability of human resources for health so that more patients can access healthcare.
In total, three rounds of the Delphi survey were conducted. Overall, 19 participants were emailed with the link to the online survey, with 18 participants overall completing all three survey rounds. Twelve participants were female and six were male. Persons with disabilities were represented in the survey with six participants identifying themselves as having a disability. Overall, ten participants were in the 35–44 age group, five participants in the 45–54 group, two participants in the 55–64 group, and one participant in the 75+ age group. Participants’ countries of origin were varied, comprising Egypt (one participant), Nepal (one), India (two), Sri Lanka (one), Pakistan (one), Fiji (one), Australia (one), Britain (three), Ireland (two), Italy (one), France (one), Norway (two), and the Netherlands (one).
A large range of expertise was covered by participants and while each participant was selected for their expertise in one particular area, many had extensive knowledge and experience in more than one relevant area. Years of experience that experts had in their relevant fields ranged from 8 to 55+ years with an average of 18.2 years of experience. Disciplines with which participants identified were as follows: Human rights; disability rights; disability and human rights; disability law and policy; political science and disability; health systems; health policy; health; CBR coordinator; management; epidemiology; social development and disability; social sciences (disability); governance and social inclusion; social sciences; physiotherapy; medical anthropology; community based rehabilitation; physical medicine and rehabilitation; public health; management in non-governmental organization (NGO) in disability and development; occupational therapy; disability-inclusive development; and disability and rehabilitation. Participants reported experience working in a variety of regions, including Sub-Saharan Africa, North America, and South East Asia.
Participants comprised service-users including organizations of persons with disabilities (DPOs) (two participants), persons with disabilities (one), and civil society (one); service providers including physical rehabilitation specialists (one), and a CBR programme manager/coordinator (one); and policy/decision-makers including NGOs (three), Department of Health (one), policymakers (two), CBR experts (three), and policy analysis experts (three). The participant categories of service-users, service providers, and decision-makers were based on a health related rehabilitation framework published by Handicap International .
In the first survey round, 44 statements were considered ‘accepted’ by achieving the criteria for agreement and seven statements were ‘not accepted’; in the second round, 39 statements met the criteria, and 12 statements did not; while in the third and final round, 34 statements met the criteria while 17 statements did not achieve the criteria for agreement.
Participation of persons with disabilities in policy processes, and the research that guides such processes, to improve programme responsiveness, efficiency, effectiveness, and sustainability, and to strengthen service-user self-determination and satisfaction.
Collection of disaggregated disability statistics, and development of health information systems, to enable a situational analysis of disability for the purposes of supporting political momentum, decision-making of policymakers, evaluation, accountability, and equitable allocation of resources.
Explicit recognition in policies that disability may interact with other vulnerability factors, for example displaced populations with disabilities, which may create double discrimination, multiple disadvantages, and increased barriers to accessing health services. Accordingly, explicit promotion in policies of access to services for all subgroups of persons with disabilities and service-users to support equitable and accessible services.
Strong inter-sectoral coordination for the provision of rehabilitation services, including CBR, for the purposes of creating coherent mandates across governmental departments regarding service provision.
‘Institutionalizing’ rehabilitation programmes by aligning programmes with well-known, preexisting Ministerial models of healthcare, similar to other Ministerial programmes, to support programme sustainability.
‘Statements’ and examples of proposed outcomes
Statements (Policy recommendations)
Examples of proposed outcomes
1. What works in including persons with disabilities in decision-making regarding the development, implementation and monitoring/evaluation of policies/plans?
1. Implementing the UNCRPD requires persons with disabilities to be involved in developing, implementing and evaluating rehabilitation policies, and for the capacity of persons with disabilities to be increased to strengthen their involvement.
1. Supports responsiveness to needs, and shared control over agenda setting.
2. Disability desks and focal persons should be established in all government ministries. Where persons with disabilities have appropriate levels of expertise and understanding given the context, they should be preferred candidates.
2. Strengthens focus on disability issues.
3. As an interim measure to promote inclusion, there should be a quota of policymakers who are persons with disabilities, which could be filled by persons with disabilities who have appropriate training and qualifications.
3. Prioritizes rehabilitation and supports participation of persons with disabilities in policy development.
4. New and advanced leadership pathways, such as volunteer opportunities, service on boards/committees, and leadership development workshops, should be created for disability advocates to represent persons with disabilities in service governance roles.
4. Equips service-users with skills to participate in advocacy and policy planning.
5. Research for rehabilitation services should be conducted with a participatory ethos. This requires that the research skills of persons with disabilities be developed, that the ability of researchers to meaningfully involve persons with disabilities is developed, and that adequate resources are provided by governments to increase such education/skill development.
5/6. Allows persons with disabilities to gain influence over research that guides policies.
6. More ‘emancipatory research’, or participatory research, should be conducted, allowing persons with disabilities to gain greater influence over decision-making for policies.
7. Helping representatives of different types of disabilities to identity and express common challenges could strengthen their influence in service provision and ensure service provision responds to the full range of the diversity of disability.
7. Strengthens advocacy.
8. Service users of rehabilitation services should also be involved in the governance of such services, including for example on advisory and review panels and boards of steering committees.
8. – Strengthens programme sustainability.
– Improves relevance of programmes.
9. ICT (information and communication technologies) are promising technologies for persons with disabilities to participate in e-governance in the long-term, including planning and monitoring.
9. Supports participation of persons with disabilities in governance.
10. Regular community analyses, context surveys, and user needs assessments are necessary to ensure that e-governance meets the needs of persons with disabilities.
10. – Assesses needs of subgroups of persons with disabilities to participate in e-governance.
– Creates a comprehensive system design.
11. Statistical information and training should be available and accessible to persons with disabilities and DPOs so that they can meaningfully contribute to and engage with rehabilitation policy processes.
11. Creates a sense of ownership of research for persons with disabilities.
12. The participation of persons with disabilities, their families and their representatives in the planning, evaluation and monitoring of rehabilitation services should be mandated at local, national, regional and international levels.
12. – Supports service-user satisfaction.
– Supports service efficiency/effectiveness.
2. What are the features of national legislation/policies that work to support the development and provision of rehabilitation services?
13. A State’s Constitution and antidiscrimination laws should facilitate the realization of disability rights.
13. Strengthens legal and policy support for persons with disabilities and service-users.
14. It is critical that measures to support accountability and transparency in the provision of rehabilitation services are indicated in policies.
14. Supports accountability/transparency, so that governance creates inclusive, responsive and fair processes and outcomes, and public trust in a social system.
15. Rehabilitation should be integrated into general health policy and health sector reform plans, from primary care to tertiary hospitals with focus beginning on primary care.
15. Supports programme continuity.
16. CBR policies should be incorporated within existing health systems and with local and national health policies and legislation to ensure continuity and to secure annual budgets and other resources, while still allowing for a degree of flexibility of CBR projects.
16. Strengthens programme continuity and securing of resources for CBR.
17. Policies relating to rehabilitation should uphold the following seven primary aims for the provision of rehabilitation services (17–23 below):
Safe: Avoid injury to people, including physical or psychological harm, from the care that is intended to help them.
17. Service-users avoid injury from care.
18. Effective: Provide services based on available scientific evidence to all who could benefit and refrain from providing services to those not likely to benefit.
18. Service-users receive appropriate care based on scientific evidence.
19. Person centred: Provide care that is respectful of and responsive to individual preferences, needs and values and ensure that service-users’ values guide all practitioners’ decisions. Awareness raising and education of service-users with regard to treatment options and human rights is important.
19. – Service-users receive appropriate, respectful and understanding care.
– Service-users exercise choice.
20. Timely: Reduce waits and potentially harmful delays for both those who receive and practitioners who provide care.
20. Reduces waits for services.
21. Efficient: Avoid waste, including waste of equipment, supplies, ideas, and energy and take into account views and suggestions of service-users and their families.
21. Creates a structured system that matches resources with service demands.
22. Equitable: Provide care that does not vary in quality due to personal characteristics, such as gender, ethnicity, geographic location, socioeconomic status or type of impairment.
22. Supports justly distributed service provision based on need, including for vulnerable groups.
23. Accessible: Provide care that is accessible to all, including vulnerable groups, such as ethnic minorities, with regards to physical, economic, and information access to health services.
23. Strengthens accessible health care.
3. Do any of the listed features of national legislation and policies have a greater risk of adverse effect on particular groups of people and types of services?
24. Policies should recognize that disability may interact with other vulnerability factors that increase discrimination, e.g. women or children with disabilities.
24. Supports access to services for persons with disabilities who may experience double discrimination and multiple disadvantages (e.g. ethnic minorities with disabilities).
25. Policies relating to rehabilitation should ensure that services are available to all groups of persons with disabilities, and allow disaggregation of data by subgroups that may be more vulnerable.
25. Supports access to services for all subgroups of persons with disabilities, such as persons with intellectual disabilities.
26. To promote equitable and accessible rehabilitation services, policies should specify how the particular barriers that marginalize certain groups would be overcome and associated budgetary allocation plans should be defined.
26. Supports access to services for vulnerable groups, such as children with special needs.
27. In national policies, specific mechanisms of exclusion in accessing health services should be addressed for different subgroups of persons with disabilities.
27. Policies support human rights and social inclusion in service provision.
28. The participation of persons with severe or multiple disabilities and persons with mental disabilities and/or their families/representatives in policy development should be prioritized/emphasized on an equal basis with others, with priority in contexts where they are significantly excluded from policy development.
28. Strengthens inclusion of subpopulations of persons with disabilities, such as persons with mental disabilities, who experience specific barriers to accessing services.
4. What are the features of a rehabilitation strategy/plan that work to achieve rehabilitation objectives?
29. A national Rehabilitation Plan should be in place, and developed based on the UNCRPD, other international human rights instruments, and needs based assessments, with clear implementation and monitoring protocols.
29. Strengthens policy implementation.
30. CBR should be implemented by mobilizing partnerships, which include CBR programmes, government Ministries, persons with disabilities and their families and representatives, DPOs and NGOs.
30. Creates shared funding, resources, expertise, and ownership of programmes.
31. Strong inter-sectoral coordination, including coordination of funding, for all health related rehabilitation services, including CBR, is important with regards to provision of rehabilitation services.
31. Creates coherent mandates across governmental departments for services.
32. Health related rehabilitation should be integrated into a broader and comprehensive strategy to provide services for people who need rehabilitation services and persons with disabilities in all aspects of society, including health, employment, and education.
32. Strengthens access to services in all aspects of society for service-users.
5. What are the key steps to developing national legislation/policies and related strategies/plans for rehabilitation?
33. Policymakers should receive rights based education/training to adopt a disability lens in the formation of all relevant policies.
33. Improves status and prioritization of rehabilitation amongst policymakers.
34. Governments should proactively consult with persons with disabilities, their families, DPOs, the private sector, NGOs, and international organizations throughout policy development.
34. – Supports service effectiveness.
– Increases service-user satisfaction.
35. National authorities should align policy objectives and implementation with international instruments concerning the rights of persons with disabilities, such as the UNCRPD.
35. Provides a holistic approach for policies as the UNCRPD covers broad needs of service-users.
36. Mechanisms for sharing of information and experiences between countries and across regions should be strengthened for the purposes of national, regional, and local policy development.
36. Strengthens shared learning regarding service provision and policy development.
37. Information collected on disability should be disseminated proactively, succinctly, quickly, and in a language and format that decision-makers, as well as persons with disabilities, can easily and quickly understand.
37. Strengthens participation of persons with disabilities in decision-making.
6. What factors facilitate or impede the implementation of national legislation/policies and related strategies/plans for rehabilitation?
38. A national Implementation Plan should be devised to support the implementation of policies for rehabilitation. Where a Rehabilitation Board exists, it should contribute to devising the plan.
38. Strengthens policy implementation.
39. A coordination mechanism, such as a National Disability Board, should be established to oversee the implementation of rights of persons with disabilities.
39. Oversees policy implementation, and coordinates national inter-sectoral liaison on disability.
40. A national Code of Practice should be formulated through input from service-users and aligned with the UNCRPD to implement policies on rehabilitation.
40. Supports implementation of policy and legislation; harmonizes public health laws.
41. Development of strategic alliances between the Rehabilitation unit and PCD of governments is important for the equitable implementation of policies for rehabilitation.
41. – Supports shared strengths/resources.
– Creates co-ownership of a programme.
42. The alignment/integration of rehabilitation programmes with well recognized, preexisting models of healthcare delivery within the MoH can strengthen programme delivery and the implementation of policies for rehabilitation.
42. Supports programme sustainability.
43. Governments should provide equitable and nondiscriminatory levels of resources to implement policies for mental health services.
43. Promotes realizing rights in the lives of mental health service-users.
44. All government Ministries should have budget allocations to make services inclusive and accessible.
44. States comply with Article 9 of UNCRPD.
45. Governments should provide adequate funding and resources within their budgets to ensure the availability of human resources for implementation of policies for rehabilitation.
45. Provides sufficient numbers of trained rehabilitation workers.
46. CBR implementation is dependent on the support of community leaders, government, and persons with disabilities, DPOs, NGOs, rehabilitation professionals and paraprofessionals and the community.
46. – Increases CBR sustainability.
– Enhances skills of those working in CBR.
7. What works in monitoring and evaluating rehabilitation legislation/policies and strategies/plans?
47. National, regional and local Mental Health Review Boards should be in place to support mental health service-users and the provision of mental health services with participation of/contributions by service-users if prioritized by representative organizations in each context.
47. – Oversees policy implementation, and coordinates inter-sectoral liaison.
– Protects the rights of rehabilitation service-users by investigating abuse and exploitation.
48. Governments should provide adequate levels of funding for the collection of disability statistics using both quantitative and qualitative research methods, including disaggregated information, to enable a situational analysis of disability.
48. – Informs planning.
– Creates political momentum by identifying successful interventions.
49. A well-developed and well-implemented health management information system, which includes the collection of disability disaggregated data, should be in place with ethical privacy rules for management of data.
49. – Supports policymaker decision-making.
– Assists evaluation of CBR programmes.
50. Government national, regional, and local CBR focal persons should be in place and regularly monitored.
50. Oversees CBR programmes.
51. A continuous review of processes is critical to identify areas of success and failure of any part of the process of the development, implementation and monitoring of policies.
51. Reviews policies to identify strengths and lapses in response to changes in demands, needs of service-users, and research findings.
A variety of broad principles emerged throughout formulation of recommendations: participation of persons with disabilities in policy processes; collection of disaggregated disability statistics; explicit promotion in policies of access to services for all subgroups of persons with disabilities and service-users; robust inter-sectoral coordination; and ‘institutionalizing’ programmes by aligning them with preexisting Ministerial models of healthcare.
An innovative methodology was used for this research that combined evidence from the literature with opinions of expert stakeholders to provide recommendations on policy for leadership and governance of health related rehabilitation in less resourced settings. These recommendations do not provide a prescriptive or exhaustive list, but propose broad principles that may be applied with consideration of contextual complexity and diversity. It is not appropriate, therefore, to propose how policy for governance of health related rehabilitation should be structured across all contexts. However, some general principles are provided, which may be valuable across diverse health systems and contexts, regarding optimal policy for governance of health related rehabilitation in less resourced settings.
Overall, findings from this research propose the meaningful participation of persons with disabilities in policy processes, and the research that guides such processes, as stipulated in the UNCRPD  and echoed pervasively in the literature [2, 3, 6, 14, 31, 32, 77, 79, 80]. It is also evident from this research that there may be concrete, measureable ways to strengthen participation, including supporting access to research and statistical information and training for persons with disabilities to support meaningful contribution of persons with disabilities to policy processes. Findings from this research suggest that outcomes of participation comprise strengthened self-determination; improved responsiveness to persons with disabilities’ needs and service-user satisfaction; enhanced efficiency, effectiveness, relevance, and sustainability of services; and shared ownership and influence regarding resources, processes, and outcomes of research that impact decision-making of policies.
The research findings also support the collection of disaggregated disability statistics, and development of health management information systems, to enable a situational analysis of disability, as per the UNCRPD , and literature [32, 76, 78]. As proposed by the World Report on Disability, ‘evidence for the effectiveness of interventions and programmes is extremely beneficial to guide policymakers in developing appropriate services; allow rehabilitation workers to employ appropriate interventions; (and) support people with disabilities in decision-making’ (pp. 121) . According to our findings, robust data collection can inform decision-making of policymakers; instigate political momentum; strengthen evaluation and accountability of programmes; and enable equitable allocation of resources. Importantly, the research findings suggest that the value and impact of such data may be strengthened when disseminated proactively, succinctly, quickly, and in a language and format that decision-makers, as well as persons with disabilities, can easily understand. Furthermore, our findings indicate that mechanisms for sharing of data between countries and across regions may support shared learning regarding service provision and policy development.
Explicit recognition in policies that disability may interact with other vulnerability factors, for example displaced populations with disabilities, which may create double discrimination, multiple disadvantages, and increased barriers to accessing health services, is also supported by the research findings, and specified in the UNCRPD  and literature [53, 76, 80–82]. The findings also suggest that policies include disaggregated disability data and explicitly promote the availability of services for all subgroups of persons with disabilities, such as persons with intellectual disabilities. Thus, to promote inclusive, equitable and accessible rehabilitation services, it is recommended that policies specify how the particular barriers that marginalize specific groups will be overcome and define associated budgetary allocation plans. If social inclusion underpins policy formation, it is more likely that this principle will be inculcated in health service delivery [6, 79].
Strong inter-sectoral coordination for the provision of rehabilitation services, including CBR, is supported by the research findings, for the purposes of creating coherent mandates across governmental departments regarding service provision, as reflected in the UNCRPD , World Report on Disability , Declaration of Alma-Ata , and literature [42, 53, 76, 77]. Coordination is essential as disability is a crosscutting issue [67, 70]. In accordance with our findings, a coordination mechanism is proposed, such as a National Disability Board or Mental Health Review Board, to coordinate inter-sectoral liaison on disability and rehabilitation at national, regional and local levels. Through establishing a coordinating mechanism, States may comply with Article 33 on ‘National implementation and monitoring’ of the UNCRPD , and ensure that responsibility for realizing the rights of persons with disabilities encompasses an extensive range of governmental sectors at different levels. Our findings also support the integration of health related rehabilitation into a broader and comprehensive strategy to strengthen inclusion and access to services for service-users and persons with disabilities in all aspects of society, including health, employment, and education, as advocated by the CBR Guidelines  and UNCRPD .
Programme ‘institutionalization’ can be realized by aligning a rehabilitation programme with well-known, preexisting models of healthcare, akin to those of other Ministerial programmes, to support programme sustainability, as indicated by this research [42, 76]. Comparable mechanisms to support programme sustainability, also suggested by our findings, include the integration of rehabilitation programmes into a national system, such as the MoH and other relevant Ministries, so that a programme continues to function, irrespective of the cessation of donor funding for example. Similarly, ‘institutionalizing’ policies for CBR with local and national policies and legislation can support continuity.
Aside from the formal health system, governance comprises collaboration with other sectors, including the private sector and civil society, to promote population health in a way that is participatory and inclusive . As emphasized by Siddiqi et al. , good governance does not concern governments alone, but comprises the ‘complex mechanisms, processes and institutions through which citizens and groups articulate their interests, mediate their differences and exercise their legal rights and obligations’ (pp. 14). Accordingly, in addition to national policymakers, our policy recommendations have relevance for a variety of stakeholders, including international nongovernmental organizations, intergovernmental organizations, private sector, DPOs, civil society, national service providers, community service providers, service-users and their representatives and families; our recommendations are supported by evidence collected on, by and for such stakeholders. Our recommendations recognize the importance of extensive, careful and meaningful collaboration between such stakeholders throughout policy processes, and the research that guides such processes. Moreover, translating research into evidence-based policy needs to be systematically addressed using a coordinated and coherent approach with the inclusion of a wide range of stakeholders . Just as individuals perceive environmental threats and opportunities differently , so too stakeholders perceive different threats and opportunities in the policy environment and these need to be addressed in order to keep stakeholders engaged, empowered and supportive.
Strengths and limitations
By using a realist synthesis to explore policy for leadership and governance of health related rehabilitation in less resourced settings, evidence and insight on this research topic has been generated that would most likely not be provided by alternative empirical approaches. Combining a realist synthesis with a Delphi study offered a unique approach to synthesis. This two-method study design offered the advantages of combining the authority and contextual focus of a systematic search and realist synthesis of the literature, with the additional credibility of increased stakeholder expertise and experience provided by the Delphi survey.
One challenge, however, was the broad research topic, which necessitated narrowing our research question and literature search to conduct more focused and informative research. Furthermore, combining the opportunities of a Cochrane style systematic search of the literature with a realist synthesis was at times challenging. For example, a common characteristic of systematic reviews, including Cochrane reviews , is formal appraisal of the methodological quality of included studies . However, as outlined above, as realist syntheses include a wide variety of documents, the methodological quality rating of several articles could not be appraised.
The Delphi method also has a number of observed limitations. For example, the panel of experts, while purposefully chosen to fulfill selected criteria of diverse stakeholder perspectives, was nonetheless dependent on our own networks and this may have introduced sampling bias. Furthermore, interactions between the researcher and participants were not in person but computer mediated and this may have influenced the gathering of information. The participation of experts from different countries and health systems with diverse priorities and resources may have increased the difficulty of arriving at consensus . Importantly, however, diversity of opinions may reflect the variety of approaches in international health related rehabilitation practice  and policy processes. Indeed, this Delphi study availed of a diverse range of experts to confirm important elements of health related rehabilitation policy processes in varied contexts, and so we effectively built in heterogeneity to the study participant pool.
This research highlighted that little direct evidence is available on successful policy for leadership and governance of health related rehabilitation in less resourced settings. This dearth of evidence suggests that researchers and decision-makers collect and disseminate more robust and detailed evidence to support this area of research and practice.
To the best of our knowledge, there are no previously conducted realist studies on policy for governance of health related rehabilitation in less resourced contexts. However, the findings are in accordance with other health policy and strategy focused studies in their support of contextualizing health policies and policy processes [20, 22].
This research aims to enable 'guided transformation' of policy for leadership and governance of health related rehabilitation by proposing broad recommendations, which require contextual adaptation. Importantly, there is no one-size-fits-all approach to reforming health care systems; rather, policymakers can use principles of best practice to increase the effectiveness of health care spending and the efficiency of health care systems . The innate complexity and substantial diversity across health systems and broader socio-geo-political contexts necessitates more general and sufficiently flexible policy recommendations. Accordingly, our study proposes broad principles of successful policy for leadership and governance of health related rehabilitation in less resourced settings.
AIM, african index medicus; C, context; CAHD, community approaches to handicap in development; CAS, complex adaptive systems; CBR, community based rehabilitation; CMOCs, context mechanism outcome pattern configurations; DPOs, organizations of persons with disabilities; ICT, information and communication technologies; ILD, inclusive local development; LMIC, low and middle-income countries; M, mechanism; MMAT, mixed methods appraisal tool; MoH, ministry of health; N/A, not applicable; NGO, non-governmental organization; O, outcome; PCD, primary care division; PNDTD, (programa nacional de diagnóstico y tratamiento de la depresión) national depression detection and treatment program; UNCRPD, united nations convention on the rights of persons with disabilities; WHO, world health organization
The authors would like to thank the Disability and Rehabilitation Team in the Department of Violence and Injury Prevention and Disability of the World Health Organization for funding this research. The authors would also like to thank the participants of the Delphi survey who provided their valuable expertise and experience for the development of recommendations, and Dr. Joanne Greenhalgh for providing her expertise and valuable support throughout the realist synthesis.
The Disability and Rehabilitation Team in the Department of Violence and Injury Prevention and Disability of the World Health Organization funded this research for the development of the WHO Guidelines on Health-related Rehabilitation for Work Package 2 relating to Leadership and Governance (Project: HQVIP1207210; Award: 58007). While there was regular discussion between the research team and funding body throughout the duration of the research project, the research team chose the study design, and independently carried out the collection, analysis and interpretation of data, and preparation of the manuscript.
Availability of data and materials
The datasets supporting the conclusions of this article are available on the Website of the Centre for Global Health, Trinity College Dublin [https://global-health.tcd.ie/research/ghrg].
MM was the Principle Researcher and created the study design. Throughout the realist synthesis, all authors contributed to devising the overarching research question, search strategy and research process and were available for discussion concerning questions or research issues that arose. JMV conducted the research in collaboration with all authors. JMV, BG, HM and MM screened the articles throughout the systematic literature search. JMV and AE reviewed all included articles and prepared separate CMOCs. JMV synthesized CMOCs and generated statements with MM. CM conducted the Delphi study in consultation with MM, JM, and BG. JMV formulated the first draft of the manuscript with all authors providing feedback. All authors have approved the final version.
JMV, Postgrad H. Dip., is a Doctoral Researcher at the Centre for Global Health and School of Psychology, Trinity College Dublin, Dublin, Ireland.
MML, PhD, is a Professor of Global Health and Director of the Centre for Global Health, Trinity College Dublin, Dublin, Ireland; and Extraordinary Professor at the Centre for Rehabilitation Studies, Stellenbosch University, Stellenbosch, South Africa.
BG, M.Sc., is a Doctoral Researcher at the Centre for Global Health, Trinity College Dublin, Dublin, Ireland.
CMC, M.Sc., is working as an Occupational Physiotherapist.
AE, PhD, is Chief Scientist at SINTEF Technology and Society, Oslo, Norway; a Professor at the Department of Health Science, Norwegian University of Science and Technology, Trondheim, Norway; and a Guest Professor at the Centre for Rehabilitation Studies, Stellenbosch University, Stellenbosch, South Africa.
HM, PhD, is a Senior Lecturer in Health Systems at the School of Nursing, Midwifery and Health Systems, University College Dublin, Dublin, Ireland.
PG, M.Sc., is Head of Support to the Civil Society Technical Unit at Handicap International, Lyon, France.
AD, PhD, is a Rehabilitation Technical Advisor in Global Health at Handicap International, Washington, USA.
GM, PhD, is Director and a Senior Lecturer at the Centre for Rehabilitation Studies, Stellenbosch University, Stellenbosch, South Africa.
EMA, PhD, is a Professor of Health Systems at the School of Nursing, Midwifery and Health Systems, University College Dublin, Dublin, Ireland.
BS, MPH, is a Senior Technical Advisor for the CBM-Nossal Partnership for Disability Inclusive Development at the Nossal Institute for Global Health, University of Melbourne, Melbourne, Australia.
MA, PhD, is a Professor and Director of Research and Grants at Ahfad University for Women, Omdurman, Sudan.
CN, PhD, is Edward Kennedy Professor of Health Policy and Management at the Centre of Health Policy and Management, Trinity College Dublin, Dublin, Ireland.
The authors declare that they have no competing interests.
Consent for publication
Ethics approval and consent to participate
The Delphi study attained ethical approval from the Health Policy and Management/Centre for Global Health Research Ethics Committee of Trinity College Dublin, Ireland. Participants provided written informed consent prior to participating in the study.
Open AccessThis article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.
- Dodgson R, Lee K, Drager N. Global Health Governance: A Conceptual Review (Discussion Paper no.1). London: Centre on Global Change & Health (London School of Hygiene & Tropical Medicine), Geneva, Switzerland: Department of Health and Development (WHO); 2002. http://apps.who.int/iris/bitstream/10665/68934/1/a85727_eng.pdf. Accessed 10 Aug 2016.
- Siddiqi S, Masud TI, Nishtar S, Peters DH, Sabri B, Bile KM, et al. Framework for assessing governance of the health system in developing countries: gateway to good governance. Health Policy. 2009;90(1):13–25. doi:10.1016/j.healthpol.2008.08.005.View ArticlePubMedGoogle Scholar
- Lewis M, Pettersson G. Governance in Health Care Delivery: Raising Performance. Washington: World Bank; 2009. http://www-wds.worldbank.org/external/default/WDSContentServer/WDSP/IB/2009/10/13/000158349_20091013151915/Rendered/PDF/WPS5074.pdf. Accessed 10 Aug 2016.
- Brinkerhoff DW, Bossert TJ. Health Governance: Concepts, Experience and Programming Options. Washington: US AID; 2008. https://www.hfgproject.org/health-governance-concepts-experience-programming-options/. Accessed 10 Aug 2016.
- Mikkelsen-Lopez I, Wyss K, de Savigny D. An approach to addressing governance from a health system framework perspective. BMC Int Health Hum Rights. 2011;11(13):1–11. doi:10.1186/1472-698X-11-13.Google Scholar
- Amin M, MacLachlan M, Mannan H, El Tayeb S, El Khatim A, Swartz L, et al. EquiFrame: a framework for analysis of the inclusion of human rights and vulnerable groups in health policies. Health Hum Rights. 2011;13(2):82–101.Google Scholar
- McIntyre D, Garshong B, Mtei G, Meheus F, Thiede M, Akazili J, et al. Beyond fragmentation and towards universal coverage: insights from Ghana, South Africa and the United Republic of Tanzania. Bull World Health Organ. 2008;86(11):871–6.View ArticlePubMedPubMed CentralGoogle Scholar
- Jiménez P, Medlen KP, Fleitas Estévez I. Diagnostic imaging for global health: implementation and optimization of Radiology in the developing world. In: Mollura DJ, Lungren MP, editors. Radiology in global health: strategies, implementation and applications. New York: Springer; 2014. p. 127–38.Google Scholar
- Meyer T, Gutenbrunner C, Kiekens C, Skempes D, Melvin JL, Schedler K, et al. ISPRM Discussion paper: promising a conceptual description of health-related rehabilitation services (special report). J Rehabil Med. 2014;46(1):1–6. doi:10.2340/16501977-1251.View ArticlePubMedGoogle Scholar
- Skempes D, Stucki G, Bickenbach J. Health-related rehabilitation and human rights: analyzing States’ obligations under the United Nations Convention on the Rights of Persons with Disabilities (special communication). Arch Phys Med Rehabil. 2014;96(1):163–73. doi:10.1016/j.apmr.2014.07.410.View ArticlePubMedGoogle Scholar
- WHO (World Health Organization), World Bank. World Report on Disability. Geneva: WHO, Washington, D.C., United States: World Bank; 2011. http://www.who.int/disabilities/world_report/2011/en/. Accessed 10 Aug 2016.
- Mannan H, MacLachlan M. Disability and health: a research agenda. Soc Inclusion. 2013;1(1):37–45. doi:10.12924/si2013.01010037.View ArticleGoogle Scholar
- Meyer T, Gutenbrunner C, Bickenbach J, Cieza A, Melvin J, Stucki G. Towards a conceptual description of rehabilitation as a health strategy. J Rehabil Med. 2011;43(9):765–9. doi:10.2340/16501977-0865.View ArticlePubMedGoogle Scholar
- Declaration of Alma-Ata. Declaration of Alma-Ata. International Conference on Primary Health Care, Alma-Ata, USSR, 6-12 September 1978. Declaration adopted at: International Conference on Primary Health Care; September 6-12, 1978; Almaty, Kazakhstan. http://www.who.int/publications/almaata_declaration_en.pdf. Accessed 10 Aug 2016.
- WHO (World Health Organization), UNESCO (United Nations Educational, Scientific and Cultural Organization), ILO (International Labour Organization), IDDC (International Disability and Development Consortium). Community-Based Rehabilitation Guidelines. WHO, UNESCO, ILO, IDDC. 2010a. http://www.who.int/disabilities/cbr/guidelines/en/. Accessed 10 Aug 2016.
- United Nations. Convention on the Rights of Persons with Disabilities and Optional Protocol. New York: United Nations; 2006. http://www.un.org/disabilities/documents/convention/convoptprot-e.pdf. Accessed 10 Aug 2016.
- WHO (World Health Organization). Strengthening Health Systems to Improve Health Outcomes: WHO’s Framework for Action. Geneva: WHO; 2007. http://www.who.int/healthsystems/strategy/everybodys_business.pdf. Accessed 10 Aug 2016.
- Best A, Greenhalgh T, Lewis S, Saul JE, Carroll S, Bitz J. Large-system transformation in health care: a realist review. Milbank Q. 2012;90(3):421–56. doi:10.1111/j.1468-0009.2012.00670.x.View ArticlePubMedPubMed CentralGoogle Scholar
- Institute of Medicine (Committee on Quality of Health Care in America). Crossing the Quality Chasm: A New Health System for the 21st Century. Washington: National Academy Press; 2001. http://www.nap.edu/openbook.php?isbn=0309072808. Accessed 10 Aug 2016.
- Saltman RB, Jakubowski E. Comparative governance themes and issues. In: Jakubowski E, Saltman RB, editors. The changing national role in health system governance: a case-based study of 11 European countries and Australia. Stockholm: Ministry of Health and Social Affairs Sweden, Brussels, Belgium: European Observatory on Health Systems and Policies; 2013. http://kebijakankesehatanindonesia.net/v13/images/buku_elektronik/The-Changing-National-Role-in-Health-System-Governance.pdf. Accessed 10 Aug 2016.
- Westhorp G. Realist impact evaluation: an introduction. London: Overseas Development Institute; 2014.Google Scholar
- Pawson R, Greenhalgh T, Harvey G, Walshe K. Realist review – a new method of systematic review designed for complex policy interventions. J Health Serv Res Policy. 2005;10(1):21–34.View ArticlePubMedGoogle Scholar
- Rycroft-Malone J, McCormack B, Hutchinson AM, DeCorby K, Bucknall TK, Kent B, et al. Realist synthesis: illustrating the method for implementation research. Implement Sci. 2012;7(33):1–10. doi:10.1186/1748-5908-7-33.Google Scholar
- Harris P, Friel S, Wilson A. ‘Including health in systems responsible for urban planning’: a realist policy analysis research programme. BMJ Open. 2015;5(7):1–8. doi:10.1136/bmjopen-2015-008822.View ArticleGoogle Scholar
- Pawson R, Tilley N. Realistic evaluation. London: Sage Publications Ltd.; 1997.Google Scholar
- McCormack B, Rycroft-Malone J, Decorby K, Hutchinson AM, Bucknall T, Kent B, et al. A realist review of interventions and strategies to promote evidence-informed healthcare: a focus on change agency. Implement Sci. 2013;8(107):1–12. doi:10.1186/1748-5908-8-107.Google Scholar
- The Cochrane Collaboration. Cochrane Handbook for Systematic Reviews of Interventions. London: The Cochrane Collaboration; 2015. http://community.cochrane.org/handbook. Accessed 10 Aug 2016.
- Egüez MI. NGOs and UN Agencies Assisting Persons with Disabilities: A Non-Exhaustive Reference List of Organizations Working with and for Persons with Disabilities World-wide. Geneva: Office of the United Nations High Commissioner for Refugees (UNHCR); 2008. http://www.refworld.org/pdfid/48297a4e2.pdf. Accessed 10 Aug 2016.
- Pluye P, Robert E, Cargo M, Bartlett G, O’Cathain A, Griffiths F, et al. Proposal: A Mixed Methods Appraisal Tool for Systematic Mixed Studies Reviews. Quebec: McGill; 2011. http://mixedmethodsappraisaltoolpublic.pbworks.com/w/file/fetch/84371689/MMAT%202011%20criteria%20and%20tutorial%202011-06-29updated2014.08.21.pdf. Accessed 10 Aug 2016.
- Dieleman M, Kane S, Zwanikken P, Gerretsen B. Increasing Access to Health Workers in Rural and Remote Areas (Technical Report no. 1). Realist Review and Synthesis of Retention Studies for Health Workers in Rural and Remote Areas. Geneva: WHO; 2011. http://whqlibdoc.who.int/publications/2011/9789241501262_eng.pdf. Accessed 10 Aug 2016.
- CBM (Christian Blind Mission). CBR Policy Paper 2010. Bensheim: CBM; 2010. http://www.cbm.org/article/downloads/54741/CBR_policy.pdf. Accessed 10 Aug 2016.
- Chataika T, Kallon F, Mji G, MacLachlan M. Did What? Research Project in Brief: A-PODD in Sierra Leone (African Policy on Disability and Development). Dublin: Global Health Press; 2011. http://global-health.tcd.ie/assets/doc/In%20Brief%20A-PODD%20in%20SIERRA%20LEONE%20PDF%20-%2018%20Nov.pdf. Accessed 10 Aug 2016.
- WHO (World Health Organization), UNESCO (United Nations Educational, Scientific and Cultural Organization), ILO (International Labour Organization), IDDC (International Disability and Development Consortium). Community Based Rehabilitation Guidelines: Health Component. WHO, UNESCO, ILO, IDDC; 2010b. http://whqlibdoc.who.int/publications/2010/9789241548052_health_eng.pdf?ua=1. Accessed 10 Aug 2016.
- Hasson F, Keeney S, McKenna H. Research guidelines for the Delphi survey technique. J Adv Nurs. 2000;32(4):1008–15. doi:10.1046/j.1365-2648.2000.t01-1-01567.x.PubMedGoogle Scholar
- de Meyrick J. The Delphi method and health research. Health Educ. 2003;103(1):7–16. doi:10.1108/09654280310459112.View ArticleGoogle Scholar
- Rowe G, Wright G. The Delphi technique as a forecasting tool: issues and analysis. Int J Forecast. 1999;15(4):353–75. doi:10.1016/S0169-2070(99)00018-7.View ArticleGoogle Scholar
- Clayton MJ. Delphi: a technique to harness expert opinion for critical decision‐making tasks in education. Educ Psychol. 1997;17(4):373–86. doi:10.1080/0144341970170401.View ArticleGoogle Scholar
- Okoli C, Pawlowski SD. The Delphi method as a research tool: an example, design considerations and applications. Inf Manage. 2004;42(1):15–29. doi:10.1016/j.im.2003.11.002.View ArticleGoogle Scholar
- Survey Monkey website. https://www.surveymonkey.com/. Accessed 10 Aug 2016.
- NiMhurchadha S, Gallagher P, MacLachlan M, Wegener ST. Identifying successful outcomes and important factors to consider in upper limb amputation rehabilitation: an international web-based Delphi survey. Disabil Rehabil. 2013;35(20):1726–33. doi:10.3109/09638288.2012.751138.View ArticlePubMedGoogle Scholar
- Gilmore B, MacLachlan M, McVeigh J, McClean C, Carr S, Duttine A, et al. (in review). A realist synthesis of human resource skills required to implement the health-related aspects of the CBR Guidelines. Arch Phys Med Rehabil.Google Scholar
- Araya R, Alvarado R, Sepulveda R, Rojas G. Lessons from scaling up a depression treatment program in primary care in Chile. Rev Panam Salud Pública. 2012;32(3):234–40.View ArticlePubMedGoogle Scholar
- Boersma M. Protecting children with disabilities from violence in CBR projects: why we need to work with a different form of child protection policy for children with disabilities. Disabil, CBR Inclusive Dev. 2013;24(3):112–22. doi:10.5463/DCID.v24i3.261.View ArticleGoogle Scholar
- Bricout JC, Baker PMA. Deploying information and communication technologies (ICT) to enhance participation in local governance for citizens with disabilities. Int J Inf Commun Technol Hum Dev. 2010;2(2):34–51. doi:10.4018/jicthd.2010040103.View ArticleGoogle Scholar
- Bury TJ, Stokes EK. A global view of direct access and patient self-referral to physical therapy: implications for the profession. Phys Ther. 2013;93(4):449–59. doi:10.2522/ptj.20120060.View ArticlePubMedGoogle Scholar
- Caldwell J, Switzer ME. Leadership development of self advocates: life stories and perspectives of leaders within the self-advocacy movement. Chicago: Department of Disability and Human Development, University of Illinois at Chicago; 2008.Google Scholar
- Dawad S, Jobson G. Community-based rehabilitation programme as a model for task-shifting. Disabil Rehabil. 2011;33(21-22):1997–2005. doi:10.3109/09638288.2011.553710.View ArticlePubMedGoogle Scholar
- Eide AH, Amin M, MacLachlan M, Mannan H, Schneider M. Human rights, social inclusion and health equity in International Donors’ policies. Disabil, CBR Inclusive Dev. 2012;23(4):24–40. doi:10.5463/DCID.v23i4.144.Google Scholar
- Gillespie S, Haddad L, Mannar V, Menon P, Nisbett N. The politics of reducing malnutrition: building commitment and accelerating progress. Lancet. 2013;382(9891):552–69. doi:10.1016/s0140-6736(13)60842-9.View ArticlePubMedGoogle Scholar
- Kleintjes S, Lund C, Swartz L. South African mental health care service user views on priorities for supporting recovery: implications for policy and service development. Disabil Rehabil. 2012;34(26):2272–80. doi:10.3109/09638288.2012.681005.View ArticlePubMedGoogle Scholar
- Kleintjes S, Lund C, Swartz L. Organising for self-advocacy in mental health: experiences from seven African countries. Afr J Psychiatry. 2013;16(3):187–95. http://0-dx.doi.org.brum.beds.ac.uk/10.4314/ajpsy.v16i3.25.Google Scholar
- Kuipers P, Wirz S, Hartley S. Systematic synthesis of community-based rehabilitation (CBR) project evaluation reports for evidence-based policy: a proof-of-concept study. BMC Int Health Hum Rights. 2008;8(3):1–15. doi:10.1186/1472-698x-8-3.Google Scholar
- Mannan H, McVeigh J, Amin M, MacLachlan M, Swartz L, Munthali A, et al. Core concepts of human rights and inclusion of vulnerable groups in the disability and rehabilitation policies of Malawi, Namibia, Sudan, and South Africa. J Disabil Policy Stud. 2012;23(2):67–81. doi:10.1177/1044207312439103.View ArticleGoogle Scholar
- Plotner AJ, Trach JS. Leadership development perspectives from Community Rehabilitation Program Directors, managers, and direct-service personnel. J Rehabil. 2010;76(2):3–9.Google Scholar
- Ramlall S. The Mental Health Care Act No 17 - South Africa. Trials and triumphs: 2002-2012. Afr J Psychiatry. 2012;15(6):407–10. http://0-dx.doi.org.brum.beds.ac.uk/10.4314/ajpsy.v15i6.49.View ArticleGoogle Scholar
- Ribeiro CTM, Ribeiro MG, Araújo AP, Mello LR, Rubim Lda C, Ferreira JE. The public health care system and rehabilitation actions in Brazil. Rev Panam Salud Pública. 2010;28(1):43–8.View ArticlePubMedGoogle Scholar
- St. Pierre C, Anthony WAE, editors. Principled leadership in mental health systems. Boston, United States: Centre for Psychiatric Rehabilitation, Boston University. Recovery & Rehabilitation. 2008;4(1). http://cpr.bu.edu/wp-content/uploads/downloads/2011/11/Principled-Leadership-in-Mental-Health-Systems.pdf. Accessed 10 Aug 2016.
- Ferreira K, Hodges S, Israel N, Mazza J. System Implementation Issue Brief No. 3 - Lessons from Successful Systems: Leadership Qualities in Successful Systems of Care. Tampa: University of South Florida, Louis de la Parte Florida Mental Health Institute, Research and Training Center for Children’s Mental Health; 2007. http://www.oregon.gov/oha/amh/wraparound/steering/brief3.pdf. Accessed 10 Aug 2016.
- Huss R, Green A, Sudarshan H, Karpagam SS, Ramani KV, Tomson G, et al. Good governance and corruption in the health sector: lessons from the Karnataka experience. Health Policy Plan. 2011;26(6):471–84. doi:10.1093/heapol/czq080.View ArticlePubMedGoogle Scholar
- Badr E, Mohamed NA, Afzal MM, Bile KM. Strengthening human resources for health through information, coordination and accountability mechanisms: the case of the Sudan. Bull World Health Organ. 2013;91(11):868–73. doi:10.2471/blt.13.118950.View ArticlePubMedPubMed CentralGoogle Scholar
- Banda-Chalwe M, Nitz JC, de Jonge D. Globalising accessibility: drawing on the experiences of developed countries to enable the participation of disabled people in Zambia. Disabil Soc. 2012;27(7):917–34. doi:10.1080/09687599.2012.692024.View ArticleGoogle Scholar
- Benté JR. Performance measurement, health care policy, and implications for rehabilitation services. Rehabil Psychol. 2005;50(1):87–93. doi:10.1037/0090-55220.127.116.11.View ArticleGoogle Scholar
- Cornielje H, Velema JP, Finkenflugel H. Community based rehabilitation programmes: monitoring and evaluation in order to measure results. Lepr Rev. 2008;79(1):36–49.PubMedGoogle Scholar
- Ebenso B, Idah M, Anyor T, Opakunmi F. Lessons from the evolution of a CBR programme for people affected by leprosy in Northern Nigeria. Lepr Rev. 2010;81(4):318–31.PubMedGoogle Scholar
- Hoy DG, Rickart KT, Durham J, Puntumetakul R, Mansoor GF, Muijlwijk A, et al. Working together to address disability in a culturally-appropriate and sustainable manner. Disabil Rehabil. 2010;32(16):1373–5. doi:10.3109/09638280903524803.View ArticlePubMedGoogle Scholar
- Jacobson E. Comparative policy brief: status of intellectual disabilities in the Republic of Haiti. J Policy Pract Intellect Disabil. 2008;5(2):122–4. doi:10.1111/j.1741-1130.2008.00158.x.View ArticleGoogle Scholar
- Kiima D, Jenkins R. Mental health policy in Kenya – an integrated approach to scaling up equitable care for poor populations. Int J Ment Health Syst. 2010;4(19):1–8. doi:10.1186/1752-4458-4-19.Google Scholar
- Kirchner C. Seize the moment! Establishing vision-related rehabilitation and access in the nation’s public health policy agenda. J Vis Impair Blind. 2006;100:780–92.Google Scholar
- Lazcano-Ponce E, Katz G, Allen-Leigh B, Magaña Valladares L, Rangel-Eudave G, Minoletti A, et al. Intellectual development disorders in Latin America: a framework for setting policy priorities for research and care. Rev Panam Salud Pública. 2013;34(3):204–9.PubMedGoogle Scholar
- Lord JE, Suozzi D, Taylor AL. Lessons from the experience of U.N. Convention on the rights of persons with disabilities: addressing the democratic deficit in global health governance. J Law Med Ethics. 2010;38(3):564–79. doi:10.1111/j.1748-720X.2010.00512.x.View ArticlePubMedGoogle Scholar
- Mji G, MacLachlan M, Melling-Williams N, Gcaza S. Realising the rights of disabled people in Africa: an introduction to the special issue. Disabil Rehabil. 2009;31(1):1–6. doi:10.1080/09638280802280288.View ArticlePubMedGoogle Scholar
- Mmatli TO. Translating disability-related research into evidence-based advocacy: the role of people with disabilities. Disabil Rehabil. 2009;31(1):14–22. doi:10.1080/09638280802280387.View ArticlePubMedGoogle Scholar
- Penny N, Zulianello R, Dreise M, Steenbeek M. Community-based rehabilitation and orthopaedic surgery for children with motor impairment in an African context. Disabil Rehabil. 2007;29(11-12):839–43. doi:10.1080/09638280701240052.View ArticlePubMedGoogle Scholar
- Stringfellow JW, Muscari KD. A program of support for consumer participation in systems change: the West Virginia Leadership Academy. J Disabil Policy Stud. 2003;14(3):142–7. doi:10.1177/10442073030140030301.View ArticleGoogle Scholar
- Clohan DB, Durkin EM, Hammel J, Murray P, Whyte J, Dijkers M, et al. Postacute rehabilitation research and policy recommendations. Arch Phys Med Rehabil. 2007;88(11):1535–41. doi:10.1016/j.apmr.2007.07.022.View ArticlePubMedGoogle Scholar
- WHO, Regional Office for Africa. Implementation of UN standard rules on the equalization of opportunities for persons with disabilities, Brazzaville, Republic of Congo, 17-19 November 2004, Inter-Country Meeting Report. Geneva: WHO; 2005.Google Scholar
- WHO, Regional Office for South-East Asia. Strengthening the Application of UN Standard Rules in the South Asian Region, Report of an Inter-Country Workshop, Bangalore, India, 15-18 September, 2003. Geneva: WHO; 2004. http://apps.searo.who.int/PDS_DOCS/B3606.pdf. Accessed 10 Aug 2016.
- Renard P, Urseau I. Physical and Functional Rehabilitation (Policy Paper). Lyon: Handicap International; 2013. http://www.hiproweb.org/uploads/tx_hidrtdocs/PP10Rehabilitation.pdf. Accessed 10 Aug 2016.
- MacLachlan M, Amin M, Mannan H, El Tayeb S, Bedri N, Swartz L, et al. Inclusion and human rights in health policies: comparative and benchmarking analysis of 51 policies from Malawi, Sudan, South Africa and Namibia. PLoS One. 2012;7(5):e35864. doi:10.1371/journal.pone.0035864.View ArticlePubMedPubMed CentralGoogle Scholar
- United Nations (General Assembly). Standard Rules on the Equalization of Opportunities for Persons with Disabilities. New York: United Nations; 1993. http://www.un.org/esa/socdev/enable/dissre00.htm. Accessed 10 Aug 2016.
- Emmett T, Alant E. Women and disability: exploring the interface of multiple disadvantage. Dev South Afr. 2006;23(4):445–60. doi:10.1080/03768350600927144.View ArticleGoogle Scholar
- UN Women. International Day of Persons with Disabilities. Empowering and including women and girls with disabilities. New York: UN Women; 2015. http://www.unwomen.org/en/news/stories/2015/12/empowering-and-including-women-and-girls-with-disabilities. Accessed 10 Aug 2016.
- WHO. Health systems: governance. Geneva: WHO. http://www.who.int/healthsystems/topics/stewardship/en/. Accessed 10 Aug 2016.
- Walsh-Danishmandi A, MacLachlan M. Environmental risk to the self: factor analysis and development of sub-scales for the Environmental Appraisal Inventory (EAI) with an Irish sample. J Environ Psychol. 2000;20(2):141–9.View ArticleGoogle Scholar
- Higgins JPT, Altman DG, Sterne JAC. Chapter 8: assessing risk of bias in included studies. In: Higgins JPT, Green S, editors. Cochrane handbook for systematic reviews of interventions (version 5.1.0). London: The Cochrane Collaboration; 2011. http://handbook.cochrane.org/chapter_8/8_assessing_risk_of_bias_in_included_studies.htm. Accessed 10 Aug 2016.
- Elkins MR, Herbert RD, Moseley AM, Sherrington C, Maher C. Rating the quality of trials in systematic reviews of Physical Therapy interventions. Cardiopulm Phys Ther J. 2010;21(3):20–6.PubMedPubMed CentralGoogle Scholar
- OECD (Organisation for Economic Co-operation and Development). Health Care Systems: Getting More Value for Money. OECD Economics Department Policy Notes (No. 2). Paris: OECD Economics Department; 2010. http://www.oecd.org/eco/growth/46508904.pdf. Accessed 10 Aug 2016.