Download a PDF of this issue - Field Exchange - Emergency ...

Download a PDF of this issue - Field Exchange - Emergency ... Download a PDF of this issue - Field Exchange - Emergency ...

fex.ennonline.net
from fex.ennonline.net More from this publisher
19.11.2014 Views

News Table 1: Number of benchmarks per Health System (HS) function (horizontal) for the three levels of implementation (vertical) and total HS functions National District Community Total A. Governance 44 40 36 120 1. Information/Assessment 4 4 3 11 Capacity 2. Policy Formulation and 16 15 11 42 Planning 3. Social Participation and 10 9 10 29 System Responsiveness 4. Accountability 10 9 9 28 5. Regulation 4 3 3 10 B. Financing 13 16 14 43 6. Pooling and Allocation 7 10 7 24 of Financial Resources 7. Joint financing 5 5 6 16 8. Purchasing and Provider 1 1 1 3 Payments C. HR 33 35 33 101 9. Planning 5 6 4 15 10. Policies 5 5 4 14 11. Performance 4 4 5 13 Management 12. Training and education 11 12 12 35 13. In-service training or 6 6 6 18 IMSAM/MNCH* integrated training 14. Pre-service training 2 2 2 6 IMSAM /MNCH integrated D. Supply 18 17 9 44 15. Pharmaceutical Policy, 12 13 5 30 Laws, and Regulations 16. Joint supply 3 3 3 9 management** 17. Selection of 3 1 1 5 Pharmaceuticals E. Service delivery 23 31 29 83 18. Availability and 2 2 3 7 continuity of care 19. Access and coverage of 3 3 4 10 IMSAM services 20. Utilisation 6 6 5 17 21. Organisation: Integrated 3 4 4 11 package 22. Quality assurance 7 13 9 29 23. Community Participation 2 3 4 11 in Service Delivery F. HIS 13 16 7 36 24. IMSAM integrated in HIS 10 13 6 29 25. M&E 3 3 1 7 TOTAL 144 155 128 427 *Maternal, newborn and child health ** RUTF supply falls under this catergory intends to further guide the identification and coverage of gaps in sustained integration of CMAM. Components of framework The framework is composed of three parts: • benchmark matrix to facilitate assessment • a tool (visual) to help summarise main assessment findings • a planning, monitoring and evaluation tool to facilitate yearly and multiyear planning, monitoring and evaluation. The benchmarks matrix suggests for each of the six HS components, a series of conditions, referred to as benchmarks 8 , that should be in place in order to help attain a sustainable level of IMSAM into the health system (see Table 1 for an overview). Programme staff must take these into account when planning, implementing, monitoring, and evaluating IMSAM. The benchmarks matrix has three levels as planning, implementing, monitoring, and evaluating are approached differently at national, sub-national/district or community level. The benchmark matrix can be used vertically by one of the three implementation levels (national, sub-national/ district, and community) or horizontally by HS function, expressed under the six building blocks (governance, financing, human resources, supply, service delivery and health information system). The way the benchmark matrix is used depends on national or local priorities, identified by all relevant stakeholders, especially by government services responsible and/or closely involved in CMAM. This flexible use should support CMAM programme managers in defining IMSAM technical and financial inputs in health sector audits, programmatic and financial reviews and sectoral reforms. For example, if stakeholders agree that the objective is to assess human resources (HR) for IMSAM, because investment in HRs for the health sector is planned, the assessors can single out the benchmarks for the HR component (see Figure 1 for an example). Meanwhile the community component can be looked at, for example, in preparation for community health policy development discussions or just for regular yearly, or multi-year, planning or evaluation purposes. Framework in practice At this stage of development of the approach, the benchmarks are grouped per level and per HS function on excel sheets (as reflected in Figure 1). Each level of planning and implement ation (national, sub-national/district, community) corresponds to one excel sheet. On each sheet, the first column corresponds to a HS function and its sub-division (see Figure 2). The second column gives the benchmarks/conditions list followed by a column on guidance, if any. Different assessors can assess each benchmark/condition separately according to a range of provided possible scenarios (expressed in columns: highly adequate, adequate, present but not adequate, not adequate at all). This allows for objective and quantitative rating compared to the benchmark/ condition for integration. A column for comments is included, so assessors can add qualitative comments in addition to the rating, explaining why/how/when. The next column will capture the data sources, followed by the score from interviewees and their names. The last column will indicate the average score, reflected in the visual tool (see Figure 3). As obvious from this description, the final results depend entirely on the opinion of assessors. It is therefore essential to include all relevant stakeholders. Ideally, these are HS 8 Also called golden standards by the WHO/Health matrix Figure 1: district benchmark assessment work sheet for planning part of Human Resources (HR) HS function Functions Benchmarks Guidance Highly Adequate Present but not Not adequate adequate adequate at all HR 9. Planning 9.1 Health care professionals distribution in urban and rural areas balanced YES, highly adequate 9.2 Human resources data system set up YES, the system exists and is used regularly 9.3 Comprehensive human-resource strategy for MNCHN initiated 9.4 Facilities have adequate numbers of staff and it exists scale up and down of staff according to the season and livelihood zones including a HR planning system At least 90% of staff are in place YES, the strategy exists, it's comprehensive and implemented YES, Staff is in place and scale up & down exists 9.5 Special budget dedicated to HR YES, it exists with adequate resources 9.6 Job classification system created YES, the system exists and is functional Rationale/ Comments: NA or If not adequate, why? Data source Response from interviewees 3 2 1 0 Name 1 Name 2 Name 3 YES, adequate YES, the system exists but is seldom used YES, the strategy exists and implemented but not comprehensive YES, staff are in place but scale up & down are rare YES, it exists but without adequate resources YES, the system exists and is functional but partially YES, partially adequate YES the system exists but it is never used YES, the strategy exists, it's comprehensive but not implemented YES, the position exist but is not filled YES, it exists but not used YES, the system exists but is not functional NO, not adequate NO, no system NO, no HR strategy NO, no adequate staff NO, no special budget NO, no system Average 59

News specialists, CMAM programme managers, M&E specialists, technical and financial partners, etc. Given the importance of including the right people in the assessment, a mapping of actors prior to the assessment is advised (see below). This will limit the risk of biased results. Using results of the assessment, the feasibility of addressing the identified gaps can be analysed using the planning tool. This planning tool can be used to facilitate comparison of the target result, also present in the benchmarks matrix as the benchmark or condition, with the existing situation, or identified gap (See Figure 4 for an example). Weaknesses, barriers to change and opportunities are identified, interventions proposed and budget and timelines defined. Once this analysis is completed, proposed actions, timeline, cost, etc. can be put together in a yearly or multiyear action plan. Progress on implementation of the action plan can then be monitored on a regular basis. Suggested process for use of the framework At this stage of development of the tool, four steps are suggested. They are composed of: Step 1: Pre-assessment As indicated, the framework needs to fit context specific needs. During the pre-assessment step, all country specific details will be agreed. These include: a) identification/ mapping of all relevant stakeholders to be invited to support assessment (government services, donors, CMAM partners, etc.), b) agreement of the scope, time frame, budget and dates of the assessment, c) identification of IMSAM and health systems data sources and documents, listing of identified gaps as well as health system strengthening interventions, etc. Step 2: Assessment using benchmark matrix This step starts with a literature review of all relevant documents. These can be HR policies, M&E tools used, data collected from facilities, facility registers, quality supervision reports, administrative and budget documents, supply registration lists, review of training curricula, client exit interviews reports, etc. The benchmark matrix is then filled out by different stakeholders or assessors. It is important to note that this is a self-assessment (important for stakeholders, especially MoH, ownership) undertaken by a group of experts. It is advised to organise group work in a way that the assessors only assess the benchmarks, or conditions, they are expert on. This also helps keep duration of assessment to a minimum, as different groups can work simultaneously. After the group work, the different results will be brought together and discussed as explained in Step 3. When available information is insufficient, key informant interviews, e.g. health system users, can be organised in order to complete the assessment. In addition, site visits are highly UNICEF/NYHQ2009-0204/Ysenburg, Somalia, 2009 A woman feeds a child a ready-to-use food as part of a UNICEF-supported nutrition programme in Jowhar Camp, Somalia Figure 3: Example of visualisation tool with summary of results: IMSAM Human Resources – District level assessment results Results Rating Level Adequacy achieved IMSAM Human Resources – District A HR- mean* 1.4 46% HR – mean HR planning 1.2 40% 3.0 HR policy 3 100% 2.0 In-services HR planning Performance management 2.3 76% 1.0 Training & education 1.3 43% 0.0 In-services 0.7 23% Training & education Performance management *Average for all HR section results HR policy recommended as they allow direct observation of most of the service delivery components (e.g. facility registers, daily availability of services, stock-out, reports….) and therefore reduce the bias in the scoring. Step 3: Analysis and validation During the consensus building meeting, the average rating for each condition is given, visualised and results are reviewed. The presentations and final assessment report should include rating and summary of comments, as rating alone cannot capture all aspects of the conditions. For example, the condition could be present but supported 100% by NGOs and therefore not sustainable. Steps 1 to 3 are closely linked and implemented during the same exercise, while Step 4 can be organised at a different moment after analysis of assessment results. Step 4: Development of multi-year and yearly action plan Starting from the identified gaps (conditions that are not fulfilled, benchmarks not reached), the stakeholders will analyse which Legend Rating Level Adequacy achieved Highly adequate 2.25 - 3 75 -100% Adequate 1.50 – 2.24 50 – 74% Present, but not adequate 0.75 – 1.49 25 – 49% Not adequate at all 0 – 0.74 0 – 24% gaps they want to address, how these gaps will be addressed and within which time frame using the planning tool (shared earlier in Figure 4). This will be captured in the corresponding action plan. From this exercise, yearly and multi-year action plans can be defined, including a corresponding monitoring and evaluation approach. Stakeholders can decide to repeat all steps or parts on a yearly or multi-year basis as part of monitoring, evaluation and planning of national CMAM programmes. Expected results The process is expected to facilitate national ownership, commitment and sustained adequate investment in the management of acute severe malnutrition and to provide a standardised approach for identification of bottlenecks in scaling up of IMSAM across countries. Even, if the approach is meant to be standardised, countries should adapt the framework to their context. This approach will allow for development of yearly and multi-year costed actions plans Figure 4: Example of Planning tool: HR function at community level Level HS function Target Result (benchmark) Community HR Clear written ToR for CHW Weakness current result Oral ToR Threat/ Barriers to changing result Staff turnover Lack of literate staff Opportunities for change/ enabling factors National guideline exist Objective /expected results 100% of CHWs have signed a JD Proposed intervention to address change - CHW supervisor to write ToR - DMO to standardise ToR according to national guideline Impact on other MNCH programme & HS Performance - Standardisation among CHWs - Integration with iCCM HR performance Feasibility Timeline/ implementation speed Human Resources needed yes Year 1 - 90% CHWs position staffed Cost Budget: xx USD TOR: Terms of reference CHW: Community Health Workers JD: Job description DMO: District Medical Officer iCCM: Intergrated Community Case Management 60

News<br />

specialists, CMAM programme managers, M&E<br />

specialists, technical and financial partners, etc.<br />

Given the importance <strong>of</strong> including the right<br />

people in the assessment, a mapping <strong>of</strong> actors<br />

prior to the assessment is advised (see below).<br />

This will limit the risk <strong>of</strong> biased results.<br />

Using results <strong>of</strong> the assessment, the feasibility<br />

<strong>of</strong> addressing the identified gaps can be analysed<br />

using the planning tool. This planning tool can be<br />

used to facilitate comparison <strong>of</strong> the target result,<br />

also present in the benchmarks matrix as the<br />

benchmark or condition, with the existing situation,<br />

or identified gap (See Figure 4 for an<br />

example). Weaknesses, barriers to change and<br />

opportunities are identified, interventions<br />

proposed and budget and timelines defined. Once<br />

<strong>this</strong> analysis is completed, proposed actions, timeline,<br />

cost, etc. can be put together in a yearly or<br />

multiyear action plan. Progress on implementation<br />

<strong>of</strong> the action plan can then be monitored on a<br />

regular basis.<br />

Suggested process for use <strong>of</strong> the<br />

framework<br />

At <strong>this</strong> stage <strong>of</strong> development <strong>of</strong> the tool, four steps<br />

are suggested. They are composed <strong>of</strong>:<br />

Step 1: Pre-assessment<br />

As indicated, the framework needs to fit context<br />

specific needs. During the pre-assessment step, all<br />

country specific details will be agreed. These<br />

include: a) identification/ mapping <strong>of</strong> all relevant<br />

stakeholders to be invited to support assessment<br />

(government services, donors, CMAM partners,<br />

etc.), b) agreement <strong>of</strong> the scope, time frame,<br />

budget and dates <strong>of</strong> the assessment, c) identification<br />

<strong>of</strong> IMSAM and health systems data sources<br />

and documents, listing <strong>of</strong> identified gaps as well<br />

as health system strengthening interventions, etc.<br />

Step 2: Assessment using benchmark matrix<br />

This step starts with a literature review <strong>of</strong> all relevant<br />

documents. These can be HR policies, M&E<br />

tools used, data collected from facilities, facility<br />

registers, quality supervision reports, administrative<br />

and budget documents, supply registration<br />

lists, review <strong>of</strong> training curricula, client exit interviews<br />

reports, etc. The benchmark matrix is then<br />

filled out by different stakeholders or assessors.<br />

It is important to note that <strong>this</strong> is a self-assessment<br />

(important for stakeholders, especially<br />

MoH, ownership) undertaken by a group <strong>of</strong><br />

experts. It is advised to organise group work in a<br />

way that the assessors only assess the benchmarks,<br />

or conditions, they are expert on. This also<br />

helps keep duration <strong>of</strong> assessment to a minimum,<br />

as different groups can work simultaneously.<br />

After the group work, the different results will be<br />

brought together and discussed as explained in<br />

Step 3.<br />

When available information is insufficient, key<br />

informant interviews, e.g. health system users,<br />

can be organised in order to complete the assessment.<br />

In addition, site visits are highly<br />

UNICEF/NYHQ2009-0204/Ysenburg, Somalia, 2009<br />

A woman feeds a child a ready-to-use food<br />

as part <strong>of</strong> a UNICEF-supported nutrition<br />

programme in Jowhar Camp, Somalia<br />

Figure 3: Example <strong>of</strong> visualisation tool with summary <strong>of</strong> results: IMSAM Human Resources – District level<br />

assessment results<br />

Results<br />

Rating Level Adequacy<br />

achieved<br />

IMSAM Human Resources – District A<br />

HR- mean* 1.4 46%<br />

HR – mean<br />

HR planning 1.2 40%<br />

3.0<br />

HR policy 3 100%<br />

2.0<br />

In-services<br />

HR planning Performance management 2.3 76%<br />

1.0<br />

Training & education 1.3 43%<br />

0.0<br />

In-services 0.7 23%<br />

Training &<br />

education<br />

Performance<br />

management<br />

*Average for all HR section results<br />

HR policy<br />

recommended as they allow direct observation<br />

<strong>of</strong> most <strong>of</strong> the service delivery<br />

components (e.g. facility registers, daily availability<br />

<strong>of</strong> services, stock-out, reports….) and<br />

therefore reduce the bias in the scoring.<br />

Step 3: Analysis and validation<br />

During the consensus building meeting, the<br />

average rating for each condition is given,<br />

visualised and results are reviewed. The<br />

presentations and final assessment report<br />

should include rating and summary <strong>of</strong><br />

comments, as rating alone cannot capture all<br />

aspects <strong>of</strong> the conditions. For example, the<br />

condition could be present but supported<br />

100% by NGOs and therefore not sustainable.<br />

Steps 1 to 3 are closely linked and implemented<br />

during the same exercise, while Step 4<br />

can be organised at a different moment after<br />

analysis <strong>of</strong> assessment results.<br />

Step 4: Development <strong>of</strong> multi-year and<br />

yearly action plan<br />

Starting from the identified gaps (conditions<br />

that are not fulfilled, benchmarks not<br />

reached), the stakeholders will analyse which<br />

Legend<br />

Rating Level Adequacy<br />

achieved<br />

Highly adequate 2.25 - 3 75 -100%<br />

Adequate 1.50 – 2.24 50 – 74%<br />

Present, but not adequate 0.75 – 1.49 25 – 49%<br />

Not adequate at all 0 – 0.74 0 – 24%<br />

gaps they want to address, how these gaps<br />

will be addressed and within which time<br />

frame using the planning tool (shared earlier<br />

in Figure 4). This will be captured in the corresponding<br />

action plan. From <strong>this</strong> exercise,<br />

yearly and multi-year action plans can be<br />

defined, including a corresponding monitoring<br />

and evaluation approach.<br />

Stakeholders can decide to repeat all steps<br />

or parts on a yearly or multi-year basis as part<br />

<strong>of</strong> monitoring, evaluation and planning <strong>of</strong><br />

national CMAM programmes.<br />

Expected results<br />

The process is expected to facilitate national<br />

ownership, commitment and sustained<br />

adequate investment in the management <strong>of</strong><br />

acute severe malnutrition and to provide a<br />

standardised approach for identification <strong>of</strong><br />

bottlenecks in scaling up <strong>of</strong> IMSAM across<br />

countries. Even, if the approach is meant to be<br />

standardised, countries should adapt the<br />

framework to their context.<br />

This approach will allow for development<br />

<strong>of</strong> yearly and multi-year costed actions plans<br />

Figure 4: Example <strong>of</strong> Planning tool: HR function at community level<br />

Level<br />

HS function Target<br />

Result<br />

(benchmark)<br />

Community HR Clear<br />

written ToR<br />

for CHW<br />

Weakness<br />

current<br />

result<br />

Oral ToR<br />

Threat/<br />

Barriers to<br />

changing<br />

result<br />

Staff<br />

turnover<br />

Lack <strong>of</strong><br />

literate<br />

staff<br />

Opportunities<br />

for change/<br />

enabling<br />

factors<br />

National<br />

guideline<br />

exist<br />

Objective<br />

/expected<br />

results<br />

100% <strong>of</strong><br />

CHWs<br />

have<br />

signed a<br />

JD<br />

Proposed<br />

intervention to<br />

address change<br />

- CHW supervisor<br />

to write ToR<br />

- DMO to<br />

standardise ToR<br />

according to<br />

national<br />

guideline<br />

Impact on other<br />

MNCH<br />

programme &<br />

HS Performance<br />

- Standardisation<br />

among CHWs<br />

- Integration<br />

with iCCM HR<br />

performance<br />

Feasibility Timeline/<br />

implementation<br />

speed<br />

Human<br />

Resources<br />

needed<br />

yes Year 1 - 90%<br />

CHWs<br />

position<br />

staffed<br />

Cost<br />

Budget:<br />

xx USD<br />

TOR: Terms <strong>of</strong> reference CHW: Community Health Workers JD: Job description DMO: District Medical Officer iCCM: Intergrated Community Case Management<br />

60

Hooray! Your file is uploaded and ready to be published.

Saved successfully!

Ooh no, something went wrong!