18.07.2013 Views

Predictive validity of the Hendrich fall risk model II in an acute ...

Predictive validity of the Hendrich fall risk model II in an acute ...

Predictive validity of the Hendrich fall risk model II in an acute ...

SHOW MORE
SHOW LESS

You also want an ePaper? Increase the reach of your titles

YUMPU automatically turns print PDFs into web optimized ePapers that Google loves.

<strong>Predictive</strong> <strong>validity</strong> <strong>of</strong> <strong>the</strong> <strong>Hendrich</strong> <strong>fall</strong> <strong>risk</strong> <strong>model</strong> <strong>II</strong> <strong>in</strong> <strong>an</strong><br />

<strong>acute</strong> geriatric unit<br />

Dhurata Ivziku a , Maria Matarese b, *, Claudio Pedone a<br />

a Campus Bio-Medico University Hospital, Rome, Italy<br />

b School <strong>of</strong> Nurs<strong>in</strong>g, Campus Bio-Medico University, Rome, Italy<br />

ARTICLE INFO<br />

Article history:<br />

Received 12 March 2010<br />

Received <strong>in</strong> revised form 31 July 2010<br />

Accepted 4 September 2010<br />

Keywords:<br />

Assessment tool<br />

Elderly<br />

Falls<br />

Geriatric unit<br />

Risk factors<br />

Sensitivity <strong>an</strong>d specificity<br />

International Journal <strong>of</strong> Nurs<strong>in</strong>g Studies 48 (2011) 468–474<br />

ABSTRACT<br />

* Correspond<strong>in</strong>g author.<br />

E-mail addresses: d.ivziku@unicampus.it (D. Ivziku),<br />

m.matarese@unicampus.it (M. Matarese), c.pedone@unicampus.it<br />

(C. Pedone).<br />

Contents lists available at ScienceDirect<br />

International Journal <strong>of</strong> Nurs<strong>in</strong>g Studies<br />

0020-7489/$ – see front matter ß 2010 Elsevier Ltd. All rights reserved.<br />

doi:10.1016/j.ijnurstu.2010.09.002<br />

journal homepage: www.elsevier.com/ijns<br />

Background: Falls are <strong>the</strong> most common adverse events reported <strong>in</strong> <strong>acute</strong> care hospitals, <strong>an</strong>d<br />

older patients are <strong>the</strong> most likely to <strong>fall</strong>. The <strong>risk</strong> <strong>of</strong> <strong>fall</strong><strong>in</strong>g c<strong>an</strong>not be completely elim<strong>in</strong>ated,<br />

but it c<strong>an</strong> be reduced through <strong>the</strong> implementation <strong>of</strong> a <strong>fall</strong> prevention program. A major<br />

evidence-based <strong>in</strong>tervention to prevent <strong>fall</strong>s has been <strong>the</strong> use <strong>of</strong> <strong>fall</strong>-<strong>risk</strong> assessment tools.<br />

M<strong>an</strong>y tools have been <strong>in</strong>creas<strong>in</strong>gly developed <strong>in</strong> recent years, but most <strong>in</strong>struments have not<br />

been <strong>in</strong>vestigated regard<strong>in</strong>g reliability, <strong>validity</strong> <strong>an</strong>d cl<strong>in</strong>ical usefulness.<br />

Objectives: This study <strong>in</strong>tends to evaluate <strong>the</strong> predictive <strong>validity</strong> <strong>an</strong>d <strong>in</strong>ter-rater reliability<br />

<strong>of</strong> <strong>Hendrich</strong> <strong>fall</strong> <strong>risk</strong> <strong>model</strong> <strong>II</strong> (HFRM <strong>II</strong>) <strong>in</strong> order to identify older patients at <strong>risk</strong> <strong>of</strong> <strong>fall</strong><strong>in</strong>g <strong>in</strong><br />

geriatric units <strong>an</strong>d recommend its use <strong>in</strong> cl<strong>in</strong>ical practice.<br />

Design: A prospective descriptive design was used.<br />

Sett<strong>in</strong>g: The study was carried out <strong>in</strong> a geriatric <strong>acute</strong> care unit <strong>of</strong> <strong>an</strong> Itali<strong>an</strong> University<br />

hospital.<br />

Particip<strong>an</strong>ts: All over 65 years old patients consecutively admitted to a geriatric <strong>acute</strong> care<br />

unit <strong>of</strong> <strong>an</strong> Itali<strong>an</strong> University hospital over 8-month period were enrolled.<br />

Methods: The patients enrolled were screened for <strong>the</strong> <strong>fall</strong>s <strong>risk</strong> by nurses with <strong>the</strong> HFRM <strong>II</strong><br />

with<strong>in</strong> 24 h <strong>of</strong> admission. The <strong>fall</strong>s occurr<strong>in</strong>g dur<strong>in</strong>g <strong>the</strong> patient’s hospital stay were<br />

registered. Inter-rater reliability, area under <strong>the</strong> ROC curve, sensitivity, specificity, positive<br />

<strong>an</strong>d negative predictive values <strong>an</strong>d time for <strong>the</strong> adm<strong>in</strong>istration were evaluated.<br />

Results: 179 elderly patients were <strong>in</strong>cluded. The <strong>in</strong>ter-rater reliability was 0.87 (95% CI<br />

0.71–1.00). The adm<strong>in</strong>istration time was about 1 m<strong>in</strong>. The most frequently reported <strong>risk</strong><br />

factors were depression, <strong>in</strong>cont<strong>in</strong>ence, vertigo. Sensitivity <strong>an</strong>d specificity were respectively<br />

86% <strong>an</strong>d 43%. The optimal cut-<strong>of</strong>f score for screen<strong>in</strong>g at <strong>risk</strong> patients was 5 with <strong>an</strong><br />

area under <strong>the</strong> ROC curve <strong>of</strong> 0.72. The <strong>risk</strong> factors more strongly associated with <strong>fall</strong>s were<br />

confusion <strong>an</strong>d depression.<br />

Conclusions: As <strong>fall</strong>s <strong>of</strong> older patients are a common problem <strong>in</strong> <strong>acute</strong> care sett<strong>in</strong>gs it is<br />

necessary that <strong>the</strong> nurses use specific validate <strong>an</strong>d reliable <strong>fall</strong> <strong>risk</strong> assessment tools <strong>in</strong><br />

order to implement <strong>the</strong> most effective prevention measures. Our f<strong>in</strong>d<strong>in</strong>gs provided<br />

support<strong>in</strong>g evidence to <strong>the</strong> choice <strong>of</strong> <strong>the</strong> HFRM <strong>II</strong> to screen older patients at <strong>risk</strong> <strong>of</strong> <strong>fall</strong><strong>in</strong>g <strong>in</strong><br />

<strong>acute</strong> care sett<strong>in</strong>gs.<br />

ß 2010 Elsevier Ltd. All rights reserved.<br />

What is already known about <strong>the</strong> topic?<br />

Falls are <strong>the</strong> most common adverse events reported <strong>in</strong><br />

<strong>acute</strong> care hospitals, especially <strong>in</strong> <strong>the</strong> aged.<br />

The <strong>risk</strong> <strong>of</strong> <strong>fall</strong><strong>in</strong>g c<strong>an</strong>not be completely elim<strong>in</strong>ated, but it<br />

c<strong>an</strong> be reduced through <strong>the</strong> implementation <strong>of</strong> effective<br />

<strong>fall</strong> prevention programs.


A major strategy <strong>of</strong> <strong>the</strong> <strong>fall</strong> prevention programs<br />

supported by evidence has been <strong>the</strong> use <strong>of</strong> a <strong>fall</strong>-<strong>risk</strong><br />

assessment tool to identify patients highly at <strong>risk</strong> <strong>of</strong><br />

<strong>fall</strong><strong>in</strong>g on which to allocate <strong>the</strong> resources <strong>an</strong>d concentrate<br />

<strong>the</strong> healthcare efforts for prevention.<br />

Fall <strong>risk</strong> assessment tools have been <strong>in</strong>creas<strong>in</strong>gly<br />

developed <strong>in</strong> recent years, but most <strong>in</strong>struments have<br />

not been evaluated for reliability, <strong>validity</strong> <strong>an</strong>d cl<strong>in</strong>ical<br />

usefulness.<br />

The <strong>Hendrich</strong> <strong>fall</strong> <strong>risk</strong> <strong>model</strong> <strong>II</strong> (HFRM <strong>II</strong>) has shown to<br />

have good predictive values with sensitivity <strong>of</strong> 74.9% <strong>an</strong>d<br />

specificity <strong>of</strong> 73.9% <strong>in</strong> <strong>the</strong> pilot study. Also <strong>the</strong> <strong>fall</strong> <strong>risk</strong><br />

factors <strong>in</strong>cluded <strong>in</strong> <strong>the</strong> tool show a statistically signific<strong>an</strong>t<br />

correlation with <strong>fall</strong>s.<br />

What this paper adds<br />

The orig<strong>in</strong>al version <strong>of</strong> <strong>Hendrich</strong> <strong>fall</strong> <strong>risk</strong> <strong>model</strong> <strong>II</strong> was<br />

tr<strong>an</strong>slated <strong>in</strong>to Itali<strong>an</strong>.<br />

The reliability, <strong>validity</strong> <strong>an</strong>d cl<strong>in</strong>ical feasibility <strong>of</strong> HFRM <strong>II</strong><br />

were tested <strong>an</strong>d evaluated <strong>in</strong> <strong>an</strong> Itali<strong>an</strong> geriatric unit.<br />

Our study confirms previous research <strong>in</strong>dicat<strong>in</strong>g that <strong>the</strong><br />

HFRM <strong>II</strong> is a reliable <strong>an</strong>d valid tool to screen elderly<br />

<strong>in</strong>patients at <strong>risk</strong> <strong>of</strong> <strong>fall</strong><strong>in</strong>g.<br />

1. Introduction<br />

Falls are <strong>the</strong> most common adverse events reported <strong>in</strong><br />

<strong>acute</strong> care hospitals. Approximately 2–12% <strong>of</strong> patients<br />

experience at least one <strong>fall</strong> dur<strong>in</strong>g <strong>the</strong>ir hospital stay<br />

depend<strong>in</strong>g on ward type <strong>an</strong>d hospital sett<strong>in</strong>g <strong>an</strong>d population<br />

(Coussement et al., 2008). Literature report<strong>in</strong>g<br />

hospital <strong>fall</strong>s shows that older patients are <strong>the</strong> most likely<br />

to <strong>fall</strong> with great variability <strong>in</strong> <strong>the</strong> <strong>in</strong>cidence <strong>of</strong> <strong>fall</strong>s (2.2–<br />

17.1 <strong>fall</strong>s per 1000 patient days). In <strong>the</strong> elderly <strong>fall</strong>s c<strong>an</strong><br />

cause physical, psychological as well as social consequences.<br />

The most common physical consequences are<br />

bruises <strong>an</strong>d m<strong>in</strong>or <strong>in</strong>juries (28%), severe wounds <strong>of</strong> <strong>the</strong> s<strong>of</strong>t<br />

tissues (11.4%) <strong>an</strong>d bone fractures (5%) (K<strong>an</strong>nus et al.,<br />

2005). Moreover <strong>fall</strong>s may produce psychological <strong>an</strong>d<br />

social consequences such as <strong>an</strong>xiety, loss <strong>of</strong> confidence,<br />

impaired rehabilitation <strong>an</strong>d function, <strong>in</strong>creased costs for<br />

<strong>the</strong> healthcare system because <strong>of</strong> <strong>the</strong> prolonged patient<br />

stay <strong>an</strong>d <strong>of</strong> <strong>the</strong> treatments for <strong>the</strong> physical consequences<br />

(Rubenste<strong>in</strong> <strong>an</strong>d Josephson, 2001; Oliver et al., 2004).<br />

In addition, <strong>in</strong>patients <strong>fall</strong>s may result <strong>in</strong> feel<strong>in</strong>gs <strong>of</strong><br />

guilt <strong>an</strong>d <strong>an</strong>xiety for healthcare personnel, compla<strong>in</strong>t or<br />

litigation from patients’ relatives who feel that <strong>fall</strong>s are<br />

unacceptable <strong>in</strong> a sett<strong>in</strong>g that should be safe for <strong>the</strong>ir<br />

family members (Oliver, 2007).<br />

The <strong>risk</strong> <strong>of</strong> <strong>fall</strong><strong>in</strong>g c<strong>an</strong>not be completely elim<strong>in</strong>ated <strong>in</strong><br />

<strong>acute</strong> care sett<strong>in</strong>gs, but it c<strong>an</strong> be reduced through <strong>the</strong><br />

implementation <strong>of</strong> effective <strong>fall</strong> prevention programs<br />

(Gillespie et al., 2003; Rubenste<strong>in</strong>, 2006). A major strategy<br />

<strong>of</strong> <strong>the</strong> <strong>fall</strong> prevention programs supported by evidence has<br />

been <strong>the</strong> use <strong>of</strong> a <strong>fall</strong>-<strong>risk</strong> assessment tool to identify<br />

patients at high <strong>risk</strong> <strong>of</strong> <strong>fall</strong><strong>in</strong>g on which to allocate <strong>the</strong><br />

resources <strong>an</strong>d concentrate <strong>the</strong> healthcare personnel<br />

preventive efforts (Rubenste<strong>in</strong> <strong>an</strong>d Josephson, 2001;<br />

D. Ivziku et al. / International Journal <strong>of</strong> Nurs<strong>in</strong>g Studies 48 (2011) 468–474 469<br />

Gillespie et al., 2003). Such assessment tools typically<br />

consist <strong>of</strong> a rat<strong>in</strong>g or scor<strong>in</strong>g system designed to reflect <strong>the</strong><br />

cumulative effect <strong>of</strong> known <strong>risk</strong> factors (Scott et al., 2007).<br />

Several tools have been developed <strong>an</strong>d tested <strong>in</strong><br />

hospital sett<strong>in</strong>gs <strong>in</strong> <strong>the</strong> last years. Often <strong>the</strong> choice <strong>of</strong><br />

which is left to <strong>the</strong> nurs<strong>in</strong>g personnel who will use it <strong>in</strong> <strong>the</strong><br />

cl<strong>in</strong>ical practice. It is import<strong>an</strong>t that nurses select <strong>the</strong> most<br />

appropriate <strong>fall</strong>-<strong>risk</strong> assessment tool for <strong>the</strong> patients <strong>in</strong><br />

<strong>the</strong>ir sett<strong>in</strong>gs as <strong>the</strong> lack <strong>of</strong> accuracy <strong>of</strong> such tool c<strong>an</strong> lead to<br />

<strong>in</strong>appropriate distribution <strong>of</strong> <strong>fall</strong> prevention resources,<br />

contribut<strong>in</strong>g to failure <strong>of</strong> <strong>fall</strong> prevention programs (Oliver,<br />

2007; Perrell et al., 2001).<br />

Perrell et al. believe that <strong>the</strong> <strong>risk</strong> assessment tools<br />

should be selected on <strong>the</strong> basis <strong>of</strong> certa<strong>in</strong> criteria: have<br />

good psychometric properties (identify correctly high <strong>risk</strong><br />

population/true positive <strong>an</strong>d not at <strong>risk</strong> population-true<br />

negative), should be tested <strong>in</strong> a similar population <strong>in</strong> which<br />

it is <strong>in</strong>tended to be used, require not much time for <strong>the</strong><br />

adm<strong>in</strong>istration <strong>an</strong>d should have a cut<strong>of</strong>f score <strong>in</strong>dicat<strong>in</strong>g<br />

<strong>the</strong> need for <strong>in</strong>tervention (Perrell et al., 2001).<br />

A literature research on Medl<strong>in</strong>e <strong>an</strong>d CINHAL databases,<br />

us<strong>in</strong>g <strong>the</strong> search terms ‘‘accidental <strong>fall</strong>s, <strong>risk</strong> assessment,<br />

tools or scales, hospital or <strong>in</strong>patients, older adult <strong>an</strong>d<br />

validation study’’, has allowed <strong>the</strong> identification <strong>of</strong> 4<br />

literature reviews (Perrell et al., 2001; Myers, 2003; Oliver<br />

et al., 2004; Scott et al., 2007) which compared <strong>the</strong><br />

reliability <strong>an</strong>d <strong>validity</strong> <strong>of</strong> screen<strong>in</strong>g <strong>fall</strong> <strong>risk</strong> tools tested <strong>in</strong><br />

<strong>acute</strong> care sett<strong>in</strong>gs <strong>in</strong> order to assist cl<strong>in</strong>ical nurses <strong>in</strong><br />

select<strong>in</strong>g <strong>the</strong> most appropriate assessment tools for <strong>the</strong><br />

<strong>risk</strong> pr<strong>of</strong>ile on <strong>the</strong> <strong>in</strong>tended population.<br />

Perrell et al. recognized <strong>in</strong> <strong>the</strong>ir review 14 assessment<br />

tools tested <strong>in</strong> <strong>acute</strong> care sett<strong>in</strong>gs, but only two <strong>of</strong> <strong>the</strong>m, <strong>the</strong><br />

STRATIFY <strong>an</strong>d <strong>the</strong> Schmid, presented good sensitivity <strong>an</strong>d<br />

specificity values, however none <strong>of</strong> <strong>the</strong>m has been tested<br />

so far <strong>in</strong> o<strong>the</strong>r publications (Perrell et al., 2001).<br />

Likewise Myers, who <strong>an</strong>alyzed 47 articles published<br />

from 1981 to 2001 test<strong>in</strong>g more th<strong>an</strong> 30 different <strong>fall</strong>s <strong>risk</strong><br />

assessment tools, arrived to <strong>the</strong> conclusions that although<br />

m<strong>an</strong>y tools have been developed, few have undergone<br />

<strong>validity</strong> <strong>an</strong>d reliability test<strong>in</strong>g, <strong>an</strong>d even <strong>the</strong> most<br />

promis<strong>in</strong>g tools when tested by o<strong>the</strong>r researchers <strong>in</strong><br />

different cl<strong>in</strong>ical sett<strong>in</strong>gs showed a decreased <strong>in</strong> specificity<br />

(Myers, 2003).<br />

Oliver et al. <strong>in</strong> <strong>the</strong> exam<strong>in</strong>ed literature found only two<br />

<strong>risk</strong> assessment tools (Morse <strong>fall</strong> scale <strong>an</strong>d STRATIFY) that<br />

had undergone a rigorous prospective validation study<br />

(Oliver et al., 2004).<br />

Scott et al. came to <strong>the</strong> same conclusion that <strong>the</strong>re is no<br />

tool which c<strong>an</strong> be applied reliably across different sett<strong>in</strong>gs<br />

to predict <strong>risk</strong> <strong>of</strong> <strong>fall</strong><strong>in</strong>g <strong>in</strong> <strong>the</strong> elderly as <strong>the</strong>y have not been<br />

validated <strong>in</strong> more th<strong>an</strong> one sett<strong>in</strong>g <strong>an</strong>d have no strong<br />

predictive values <strong>an</strong>d recommend fur<strong>the</strong>r research to<br />

develop new valid <strong>an</strong>d reliable tools (Scott et al., 2007).<br />

It follows that at present <strong>the</strong>re are no valid <strong>an</strong>d reliable<br />

tools which c<strong>an</strong> be recommended <strong>in</strong> a hospital sett<strong>in</strong>g for<br />

elderly patients.<br />

Recently a new promis<strong>in</strong>g tool has been developed, <strong>the</strong><br />

<strong>Hendrich</strong> <strong>fall</strong> <strong>risk</strong> <strong>model</strong> <strong>II</strong> (HFRM <strong>II</strong>), a modified version <strong>of</strong><br />

a previous tool developed by <strong>the</strong> same author <strong>in</strong> 1995. It<br />

has been shown to have good predictive values with<br />

sensitivity <strong>of</strong> 74.9% <strong>an</strong>d specificity <strong>of</strong> 73.9% <strong>in</strong> <strong>the</strong>


470<br />

developmental study (<strong>Hendrich</strong> et al., 2003). In a follow<strong>in</strong>g<br />

study Kim <strong>an</strong>d colleagues compared it with o<strong>the</strong>r two <strong>risk</strong><br />

assessment tools (Morse <strong>fall</strong> scale <strong>an</strong>d STRATIFY) <strong>an</strong>d<br />

found that <strong>the</strong> HFRM <strong>II</strong> had a higher values <strong>of</strong> sensibility<br />

<strong>an</strong>d specificity (respectively 70% <strong>an</strong>d 61.5%) th<strong>an</strong> <strong>the</strong> o<strong>the</strong>r<br />

two tools (Kim et al., 2007).<br />

The <strong>risk</strong> factors <strong>in</strong>cluded <strong>in</strong> this tool are particularly<br />

signific<strong>an</strong>t for hospitalized older adults: <strong>in</strong> fact <strong>the</strong> <strong>risk</strong> <strong>of</strong><br />

<strong>fall</strong><strong>in</strong>g is greatly <strong>in</strong>fluenced by <strong>acute</strong> illnesses that <strong>of</strong>ten<br />

have, albeit temporary, <strong>an</strong> impact on physical <strong>an</strong>d<br />

cognitive functions, cause <strong>in</strong>cont<strong>in</strong>ence or require use <strong>of</strong><br />

drugs, such as <strong>the</strong> psychotropics (Scott et al., 2007).<br />

The HFRM <strong>II</strong> has not been tested specifically on geriatric<br />

population so far, but it was applied on general <strong>in</strong>patients<br />

population (medical–surgical, oncology, orthopedic <strong>an</strong>d<br />

gynecology units). We do not know if it c<strong>an</strong> be considered a<br />

valid <strong>an</strong>d reliable tool for <strong>the</strong> <strong>fall</strong> <strong>risk</strong> assessment <strong>of</strong> elderly<br />

<strong>in</strong>patients <strong>an</strong>d if its use c<strong>an</strong> be recommended <strong>in</strong> geriatric<br />

care units to screen elderly <strong>in</strong>patients at <strong>risk</strong> <strong>of</strong> <strong>fall</strong><strong>in</strong>g.<br />

As widely suggested by literature, we decided to test<br />

<strong>the</strong> predictive <strong>validity</strong> (psychometric values), reliability,<br />

<strong>an</strong>d feasibility <strong>of</strong> <strong>the</strong> HFRM <strong>II</strong>, before <strong>in</strong>troduc<strong>in</strong>g this tool<br />

<strong>in</strong> <strong>the</strong> rout<strong>in</strong>e cl<strong>in</strong>ical practice <strong>of</strong> a geriatric <strong>acute</strong> care unit<br />

<strong>of</strong> <strong>an</strong> Itali<strong>an</strong> Teach<strong>in</strong>g Hospital. We decided not to compare<br />

it with o<strong>the</strong>r exist<strong>in</strong>g tools as no one <strong>of</strong> those tested so far<br />

had proved to be valid <strong>an</strong>d reliable so that it c<strong>an</strong> be<br />

considered as gold st<strong>an</strong>dard.<br />

2. Methods<br />

2.1. Study design<br />

To evaluate <strong>the</strong> psychometric properties <strong>of</strong> <strong>the</strong> tool we<br />

used a descriptive prospective study, as it is <strong>the</strong><br />

qu<strong>an</strong>titative methodology employed for <strong>the</strong> validation <strong>of</strong><br />

a tool. The study went on from June 1, 2008 to J<strong>an</strong>uary 31,<br />

2009.<br />

2.2. Instruments<br />

As <strong>the</strong> orig<strong>in</strong>al version <strong>of</strong> HFRM <strong>II</strong> was <strong>in</strong> English, <strong>an</strong>d no<br />

<strong>of</strong>ficial Itali<strong>an</strong> version was available so far, we tr<strong>an</strong>slated it<br />

<strong>in</strong> Itali<strong>an</strong>. We requested <strong>the</strong> authorization for <strong>the</strong> use as<br />

well for <strong>the</strong> tr<strong>an</strong>slation to <strong>the</strong> author, Ann <strong>Hendrich</strong>, who<br />

also gave us detailed <strong>in</strong>structions regard<strong>in</strong>g its use <strong>an</strong>d<br />

nurse tra<strong>in</strong><strong>in</strong>g. We followed <strong>the</strong> forward–backward<br />

tr<strong>an</strong>slation method: <strong>the</strong> tool was tr<strong>an</strong>slated <strong>in</strong> Itali<strong>an</strong> by<br />

two tr<strong>an</strong>slators whose mo<strong>the</strong>r tongue was Itali<strong>an</strong> but were<br />

fluent <strong>in</strong> English. These two versions were <strong>the</strong>n merged<br />

<strong>in</strong>to a first consensus version. The back tr<strong>an</strong>slation from<br />

Itali<strong>an</strong> to English was made by a third person who was<br />

fluent <strong>in</strong> English as well as <strong>in</strong> Itali<strong>an</strong>, <strong>an</strong>d this version was<br />

sent to Ann <strong>Hendrich</strong> who approved <strong>the</strong> back tr<strong>an</strong>slation.<br />

The face <strong>validity</strong> <strong>of</strong> <strong>the</strong> Itali<strong>an</strong> version was verified by a<br />

staff nurse, a nurse researcher <strong>an</strong>d a physici<strong>an</strong>; consensus<br />

on word<strong>in</strong>g was achieved.<br />

The orig<strong>in</strong>al HFRM <strong>II</strong>, <strong>an</strong>d its Itali<strong>an</strong> tr<strong>an</strong>slation, consists<br />

<strong>of</strong> eight items: confusion/disorientation/impulsivity,<br />

symptomatic depression, altered elim<strong>in</strong>ation, dizz<strong>in</strong>ess<br />

or vertigo, male sex, prescribed <strong>an</strong>tiepileptics, prescribed<br />

benzodiazep<strong>in</strong>es, <strong>an</strong>d ‘‘get up <strong>an</strong>d go’’ test, assess<strong>in</strong>g <strong>the</strong><br />

D. Ivziku et al. / International Journal <strong>of</strong> Nurs<strong>in</strong>g Studies 48 (2011) 468–474<br />

ability to st<strong>an</strong>d up from a sitt<strong>in</strong>g position to a st<strong>an</strong>d<strong>in</strong>g one.<br />

Each item is assigned a specific score <strong>an</strong>d <strong>the</strong> items are<br />

weighted <strong>in</strong> different way accord<strong>in</strong>g to different likelihood<br />

<strong>of</strong> each <strong>of</strong> <strong>the</strong>m to cause a <strong>fall</strong>. The score r<strong>an</strong>ges from 0 to<br />

16, where 16 represents <strong>the</strong> highest <strong>risk</strong>. The patient is<br />

considered at high <strong>risk</strong> <strong>of</strong> <strong>fall</strong><strong>in</strong>g if <strong>the</strong> score is 5 or higher<br />

(<strong>Hendrich</strong>, 2007). To facilitate <strong>the</strong> compilation for <strong>the</strong><br />

Itali<strong>an</strong> nurses, we listed <strong>the</strong> trade name <strong>of</strong> <strong>the</strong> most used<br />

<strong>an</strong>tiepileptic <strong>an</strong>d benzodiazep<strong>in</strong>e drugs <strong>in</strong>stead <strong>of</strong> <strong>the</strong><br />

subst<strong>an</strong>ce names, as <strong>in</strong> Itali<strong>an</strong> hospital <strong>the</strong> trade names are<br />

more commonly used to identify <strong>the</strong> drug prescriptions.<br />

To register <strong>the</strong> <strong>fall</strong> dur<strong>in</strong>g <strong>the</strong> patient hospital stay a<br />

patient <strong>in</strong>cident report form was <strong>in</strong>troduced <strong>in</strong> which we<br />

requested nurses to report <strong>in</strong>formation regard<strong>in</strong>g all <strong>the</strong><br />

<strong>fall</strong>s occurred <strong>in</strong> <strong>the</strong> unit (time <strong>an</strong>d place <strong>of</strong> <strong>fall</strong>, <strong>fall</strong><br />

dynamic, consequences, days <strong>of</strong> patient hospital stay<br />

before <strong>fall</strong><strong>in</strong>g, etc.), as <strong>in</strong> <strong>the</strong> Teach<strong>in</strong>g Hospital <strong>the</strong> <strong>fall</strong><br />

event was usually reported only if it caused physical<br />

consequences. In this way it was possible to learn <strong>of</strong> all <strong>the</strong><br />

occurred <strong>fall</strong> events <strong>an</strong>d relate <strong>the</strong>m to <strong>the</strong> patient’s <strong>risk</strong><br />

scores.<br />

2.3. Sett<strong>in</strong>g <strong>an</strong>d population<br />

The study was carried out at a geriatric unit <strong>of</strong> a<br />

Teach<strong>in</strong>g Hospital located <strong>in</strong> Rome. The geriatric unit had<br />

12 beds reserved to patients over 65 years. The geriatric<br />

patients admitted were treated for <strong>acute</strong> illnesses that had<br />

caused <strong>the</strong> hospitalization. All <strong>the</strong> nurses employed <strong>in</strong> <strong>the</strong><br />

unit were qualified nurses with a bachelor degree <strong>in</strong><br />

Nurs<strong>in</strong>g. The nurs<strong>in</strong>g care delivery <strong>model</strong> used <strong>in</strong> <strong>the</strong> unit<br />

was <strong>the</strong> total patient care <strong>model</strong> (Barros et al., 2007) <strong>an</strong>d<br />

each registered nurse took care daily <strong>of</strong> 6–8 patients.<br />

All <strong>the</strong> patients aged 65 years or over, with or without<br />

cognitive impairment, admitted to <strong>the</strong> geriatric unit dur<strong>in</strong>g<br />

<strong>the</strong> study period were <strong>in</strong>cluded <strong>in</strong>to <strong>the</strong> study. We<br />

<strong>in</strong>cluded also cognitive impairment patients because <strong>the</strong><br />

data could be collected easily through medical records or<br />

patient relatives always present at <strong>the</strong> admission. We<br />

excluded only <strong>the</strong> patients that were unconscious or<br />

conf<strong>in</strong>ed to bed as <strong>the</strong> full assessment with <strong>the</strong> tool could<br />

not be completed (i.e. <strong>the</strong> get up <strong>an</strong>d go test).<br />

2.4. Data collection<br />

All <strong>the</strong> 12 qualified nurses work<strong>in</strong>g <strong>in</strong> <strong>the</strong> unit were<br />

<strong>in</strong>volved <strong>in</strong> <strong>the</strong> study as each <strong>of</strong> <strong>the</strong>m could assess patients<br />

at <strong>the</strong> admission <strong>an</strong>d <strong>the</strong> tool form was <strong>in</strong>cluded <strong>in</strong> <strong>the</strong><br />

nurs<strong>in</strong>g assessment record <strong>of</strong> all geriatric patients. Specific<br />

tra<strong>in</strong><strong>in</strong>g <strong>of</strong> <strong>the</strong> nurses was carried out by <strong>the</strong> pr<strong>in</strong>cipal<br />

<strong>in</strong>vestigator who worked as cl<strong>in</strong>ical nurse specialist <strong>in</strong> <strong>the</strong><br />

unit. The tra<strong>in</strong><strong>in</strong>g consisted <strong>in</strong> <strong>the</strong> expl<strong>an</strong>ations <strong>of</strong> <strong>the</strong><br />

study aim, <strong>the</strong> me<strong>an</strong><strong>in</strong>g <strong>of</strong> each item <strong>an</strong>d <strong>the</strong> score system,<br />

accord<strong>in</strong>g to <strong>the</strong> written <strong>in</strong>structions provided by <strong>the</strong> tool<br />

author. The use <strong>of</strong> <strong>the</strong> <strong>fall</strong> <strong>in</strong>cident report form that had to<br />

be filled <strong>in</strong> after each patients’ <strong>fall</strong> was illustrated as well.<br />

The pr<strong>in</strong>cipal <strong>in</strong>vestigator was present a few hours daily<br />

<strong>in</strong> <strong>the</strong> unit dur<strong>in</strong>g <strong>the</strong> period <strong>of</strong> <strong>the</strong> research to clarify <strong>an</strong>d<br />

discuss <strong>an</strong>y doubt <strong>an</strong>d collect <strong>the</strong> HFRM <strong>an</strong>d <strong>the</strong> <strong>fall</strong><br />

<strong>in</strong>cident report forms from <strong>the</strong> nurs<strong>in</strong>g record once <strong>the</strong>y<br />

were filled <strong>in</strong>. As <strong>the</strong> pr<strong>in</strong>cipal <strong>in</strong>vestigator moved <strong>in</strong>


<strong>an</strong>o<strong>the</strong>r geriatric unit <strong>of</strong> <strong>the</strong> Teach<strong>in</strong>g Hospital at <strong>the</strong> end <strong>of</strong><br />

J<strong>an</strong>uary <strong>an</strong>d <strong>the</strong> research protocol could not be followed as<br />

previously decided, <strong>the</strong> study stopped after 8 months, even<br />

if a longer survey period had been pl<strong>an</strong>ned.<br />

The patients were screened with HFRM <strong>II</strong> at <strong>the</strong><br />

moment <strong>of</strong>, or at <strong>the</strong> most with<strong>in</strong> 24 h upon, admission<br />

at <strong>the</strong> geriatric unit by <strong>the</strong> tra<strong>in</strong>ed nurses.<br />

The patients were followed-up from <strong>the</strong>ir admission<br />

until <strong>the</strong>ir first <strong>fall</strong>, discharge, death or tr<strong>an</strong>sfer to <strong>an</strong>o<strong>the</strong>r<br />

unit, <strong>an</strong>d <strong>fall</strong>s were reported on <strong>the</strong> appropriate <strong>fall</strong><br />

<strong>in</strong>cident report form. We def<strong>in</strong>ed a <strong>fall</strong> as ‘‘<strong>an</strong> event which<br />

results <strong>in</strong> a person com<strong>in</strong>g to rest <strong>in</strong>advertently on <strong>the</strong><br />

ground or floor or o<strong>the</strong>r lower level’’ (Hauer et al., 2003).<br />

The <strong>in</strong>ter-rater reliability was evaluated <strong>in</strong> <strong>the</strong> first<br />

period <strong>of</strong> <strong>the</strong> research. Two nurses applied consequently<br />

<strong>an</strong>d <strong>in</strong>dependently <strong>the</strong> <strong>Hendrich</strong> <strong>II</strong> Model to a convenience<br />

sample <strong>of</strong> older patients admitted to <strong>the</strong> unit dur<strong>in</strong>g <strong>the</strong><br />

first 2 weeks <strong>of</strong> <strong>the</strong> study.<br />

The time <strong>of</strong> adm<strong>in</strong>istration was evaluated ask<strong>in</strong>g all<br />

nurses to estimate <strong>the</strong> me<strong>an</strong> time needed to fill <strong>in</strong> <strong>the</strong> <strong>risk</strong><br />

assessment tool after <strong>the</strong> rout<strong>in</strong>e assessment <strong>of</strong> <strong>the</strong><br />

patients at <strong>the</strong> admission.<br />

2.5. Statistic <strong>an</strong>alysis<br />

Descriptive statistics were used for demographic data.<br />

To measure <strong>the</strong> reproducibility <strong>of</strong> results by more th<strong>an</strong> one<br />

rater, <strong>the</strong> <strong>in</strong>ter-rater agreement was calculated us<strong>in</strong>g<br />

kappa <strong>in</strong>dex at 95% CI. The likelihood <strong>of</strong> older patients to<br />

<strong>fall</strong> was exam<strong>in</strong>ed creat<strong>in</strong>g a 2 2 table to record patients<br />

with high <strong>an</strong>d low <strong>risk</strong> who fell or did not <strong>fall</strong> <strong>an</strong>d <strong>the</strong><br />

predictive <strong>validity</strong> was tested calculat<strong>in</strong>g sensitivity,<br />

specificity, predictive positive (PPV) <strong>an</strong>d negative values<br />

(NPV). The sensitivity was calculated divid<strong>in</strong>g <strong>the</strong> numbers<br />

<strong>of</strong> patients with high <strong>risk</strong> scores who fell by <strong>the</strong> total<br />

number <strong>of</strong> patients who fell, <strong>an</strong>d specificity divid<strong>in</strong>g <strong>the</strong><br />

numbers <strong>of</strong> patients with low <strong>risk</strong> scores who did not <strong>fall</strong><br />

by <strong>the</strong> total number <strong>of</strong> patients who did not experience a<br />

<strong>fall</strong>. The PPV was calculated divid<strong>in</strong>g <strong>the</strong> number <strong>of</strong> older<br />

patients with high <strong>risk</strong> score by <strong>the</strong> total number <strong>of</strong><br />

patients with high <strong>risk</strong> scores, while <strong>the</strong> NPV divid<strong>in</strong>g <strong>the</strong><br />

number <strong>of</strong> patients with low-<strong>risk</strong> scores who did not <strong>fall</strong> by<br />

<strong>the</strong> number <strong>of</strong> patients with low <strong>risk</strong> score. Associated 95%<br />

CIs were also reported.<br />

A receiver operat<strong>in</strong>g characteristic (ROC) <strong>an</strong>alysis was<br />

also carried out to exam<strong>in</strong>e <strong>the</strong> relationship between<br />

sensitivity <strong>an</strong>d specificity <strong>of</strong> <strong>the</strong> tool for different cut po<strong>in</strong>ts<br />

<strong>in</strong> order to determ<strong>in</strong>e <strong>the</strong> optimal cut<strong>of</strong>f po<strong>in</strong>t. Moreover<br />

we calculated <strong>the</strong> <strong>in</strong>cidence rate ratio dur<strong>in</strong>g <strong>the</strong> period <strong>of</strong><br />

study, <strong>an</strong>d <strong>the</strong> <strong>fall</strong> <strong>in</strong>dex <strong>in</strong>cidence ratio for days <strong>of</strong> hospital<br />

stay; to evaluate <strong>the</strong> <strong>risk</strong> factors that ma<strong>in</strong>ly affected <strong>the</strong><br />

<strong>fall</strong>s we calculated <strong>the</strong> odds ratio for each <strong>risk</strong> factor<br />

considered <strong>in</strong> <strong>the</strong> tool.<br />

The data was <strong>an</strong>alyzed us<strong>in</strong>g SAS V9.0 for W<strong>in</strong>dows<br />

(SAS Inc., Cary, NC, USA) <strong>an</strong>d P < 0.05 was considered<br />

statistically signific<strong>an</strong>t.<br />

2.6. Ethical considerations<br />

We asked <strong>the</strong> authorization to perform <strong>the</strong> study to <strong>the</strong><br />

Teach<strong>in</strong>g Hospital General M<strong>an</strong>ager. The study protocol<br />

D. Ivziku et al. / International Journal <strong>of</strong> Nurs<strong>in</strong>g Studies 48 (2011) 468–474 471<br />

was reviewed <strong>an</strong>d approved by <strong>the</strong> University Hospital<br />

Review Board. At admission nurses gave patients, or <strong>the</strong>ir<br />

relatives if <strong>the</strong> patients were unable to decide for<br />

<strong>the</strong>mselves, a brief description <strong>of</strong> <strong>the</strong> aim <strong>of</strong> <strong>the</strong> study,<br />

its <strong>risk</strong> <strong>an</strong>d benefits, assur<strong>in</strong>g that, <strong>in</strong>dependently <strong>of</strong><br />

participation consent or tool scores, <strong>the</strong> best nurs<strong>in</strong>g care<br />

was go<strong>in</strong>g to be provided dur<strong>in</strong>g <strong>the</strong>ir hospital stay. As <strong>the</strong><br />

ma<strong>in</strong> aim <strong>of</strong> <strong>the</strong> study was a tool validation <strong>an</strong>d posed only<br />

m<strong>in</strong>imal <strong>risk</strong> for patients only oral consent was requested,<br />

as approved by review board. Anonymity <strong>an</strong>d confidentiality<br />

was guar<strong>an</strong>teed, all <strong>the</strong> patients’ forms were retrieved<br />

<strong>in</strong> <strong>the</strong> unit daily by pr<strong>in</strong>cipal researcher <strong>an</strong>d stored <strong>in</strong> a<br />

closed box. Dur<strong>in</strong>g <strong>the</strong> data <strong>an</strong>alysis each patient was<br />

identified with a progressive number <strong>an</strong>d only <strong>the</strong> ma<strong>in</strong><br />

researcher could go back to <strong>the</strong> identification <strong>of</strong> <strong>the</strong><br />

patients.<br />

3. Results<br />

3.1. Inter-rater reliability<br />

Dur<strong>in</strong>g <strong>the</strong> first 2 weeks <strong>of</strong> <strong>the</strong> study 24 elderly patients<br />

were admitted <strong>an</strong>d <strong>the</strong> <strong>in</strong>ter-rater reliability was estimated<br />

on <strong>the</strong>m. The kappa <strong>in</strong>dex was 0.87 (95% CI 0.71–<br />

1.00).<br />

Disagreements ma<strong>in</strong>ly concerned <strong>the</strong> classification <strong>of</strong><br />

patients as depressed, <strong>the</strong> presence <strong>of</strong> dizz<strong>in</strong>ess, <strong>an</strong>d <strong>the</strong><br />

use <strong>of</strong> benzodiazep<strong>in</strong>es (used at home, but not dur<strong>in</strong>g <strong>the</strong><br />

first 24 h <strong>of</strong> hospital stay).<br />

3.2. Time <strong>of</strong> adm<strong>in</strong>istration<br />

The average time needed to collect <strong>the</strong> data to fill <strong>in</strong> <strong>the</strong><br />

tool was about 1 m<strong>in</strong>, as estimated by each nurse: <strong>in</strong> fact,<br />

some <strong>in</strong>formation could be retrieved easily from <strong>the</strong><br />

cl<strong>in</strong>ical record or ask<strong>in</strong>g <strong>the</strong> patients or relatives dur<strong>in</strong>g <strong>the</strong><br />

nurs<strong>in</strong>g assessment at <strong>the</strong> admission. The time needed to<br />

perform <strong>the</strong> get up <strong>an</strong>d go test was variable, depend<strong>in</strong>g on<br />

<strong>the</strong> cl<strong>in</strong>ical general conditions <strong>of</strong> <strong>the</strong> patients <strong>an</strong>d<br />

associated diseases. Sometimes was not performed specifically,<br />

because <strong>the</strong> nurse observed <strong>the</strong> patients dur<strong>in</strong>g <strong>the</strong><br />

exam<strong>in</strong>ation <strong>an</strong>d how she/he moves <strong>in</strong> <strong>the</strong> room.<br />

3.3. Population<br />

A total <strong>of</strong> 179 patients met <strong>the</strong> <strong>in</strong>clusion criteria <strong>an</strong>d<br />

gave consent to participate dur<strong>in</strong>g <strong>the</strong> 8 months <strong>of</strong> <strong>the</strong><br />

study. Of <strong>the</strong> 179 patients, 74 were male <strong>an</strong>d 105 female.<br />

The me<strong>an</strong> age was 79.47 years (SD 9.5), with female older<br />

th<strong>an</strong> male (81.7 vs 79.8).<br />

3.4. Validity<br />

A total <strong>of</strong> 14 <strong>fall</strong>s were reported on 179 patients, with a<br />

cumulative <strong>in</strong>cidence <strong>of</strong> 7.8%, <strong>an</strong>d a <strong>fall</strong> <strong>in</strong>dex <strong>of</strong> 7.5 per<br />

1000 days <strong>of</strong> hospital stay.<br />

The me<strong>an</strong> score <strong>of</strong> <strong>the</strong> HFRM <strong>II</strong> was 5.78 (SD 3.52, r<strong>an</strong>ge<br />

0–15). Among <strong>the</strong> <strong>risk</strong> factors evaluated by <strong>the</strong> tool, vertigo<br />

(49%), <strong>in</strong>cont<strong>in</strong>ence (48%), depression (46%) <strong>an</strong>d confusion<br />

(32%) were <strong>the</strong> most prevalent <strong>risk</strong> factors screened on <strong>the</strong><br />

elderly (Table 1), consistently with <strong>the</strong> results <strong>of</strong> o<strong>the</strong>r


472<br />

Table 1<br />

Frequency <strong>of</strong> <strong>risk</strong> factors on <strong>the</strong> studied population.<br />

Items N %<br />

Vertigo 87 49<br />

Incont<strong>in</strong>ence 86 48<br />

Depression 82 46<br />

Sex (male) 74 41<br />

Confusion 58 32<br />

Benzodiazep<strong>in</strong>es 50 28<br />

Get up <strong>an</strong>d go (score 3) 36 20<br />

Antiepileptics 13 0.7<br />

Table 2<br />

Psychometric properties <strong>of</strong> HFRM <strong>II</strong>.<br />

Values CI 95%<br />

Sensitivity 0.86 0.67–1.04<br />

Specificity 0.43 0.34–0.51<br />

PPV 0.11 0.051–0.17<br />

NPV 0.97 0.94–1.01<br />

studies that reported <strong>the</strong>se factors more prevalent <strong>in</strong> <strong>the</strong><br />

hospitalized elderly population (Oliver et al., 2004).<br />

Of 179 patients <strong>in</strong>cluded <strong>in</strong> <strong>the</strong> study, 106 were<br />

classified at <strong>risk</strong> (HFRM <strong>II</strong> 5) <strong>an</strong>d 73 not at <strong>risk</strong> <strong>of</strong> <strong>fall</strong><strong>in</strong>g.<br />

Of 106 patients classified at <strong>risk</strong> 12 fell (11%), <strong>an</strong>d <strong>of</strong> 73<br />

classified not at <strong>risk</strong> 2 older people fell (2.7%).<br />

87.5% patients fell with<strong>in</strong> <strong>the</strong> first 10 days <strong>of</strong><br />

hospitalization, <strong>in</strong>dicat<strong>in</strong>g that <strong>the</strong> elderly recover<strong>in</strong>g from<br />

<strong>acute</strong> illnesses are more frail <strong>an</strong>d subject to <strong>fall</strong>-prone <strong>in</strong><br />

<strong>the</strong> first days <strong>of</strong> <strong>the</strong> hospitalization.<br />

The me<strong>an</strong> age <strong>of</strong> <strong>the</strong> <strong>fall</strong>ers was 81 (SD 8.5); <strong>the</strong> ratio <strong>of</strong><br />

males <strong>an</strong>d females was equal <strong>in</strong> <strong>the</strong> <strong>fall</strong>ers (7 females <strong>an</strong>d 7<br />

males) with a quite similar me<strong>an</strong> age (males 81.14 <strong>an</strong>d<br />

females 80.7).<br />

The sensitivity <strong>of</strong> HFRM <strong>II</strong> was 86% <strong>an</strong>d <strong>the</strong> specificity<br />

43%. The positive predictive value was 11% identify<strong>in</strong>g 12<br />

patients that fell on 106 at <strong>risk</strong> patients. The negative<br />

predictive value was 97.26% <strong>an</strong>d allowed to identify 71/73<br />

<strong>of</strong> <strong>the</strong> patients that did not <strong>fall</strong>. The 95% confidence<br />

<strong>in</strong>tervals showed a narrower r<strong>an</strong>ge for <strong>the</strong> specificity<br />

(0.34–0.51) <strong>an</strong>d a broader r<strong>an</strong>ge for sensitivity (0.67–1.04).<br />

In Table 2 <strong>the</strong> psychometric properties <strong>of</strong> <strong>the</strong> <strong>Hendrich</strong> <strong>II</strong><br />

<strong>model</strong> are described <strong>in</strong> detail.<br />

The <strong>an</strong>alysis <strong>of</strong> ROC curve has been carried out to f<strong>in</strong>d <strong>the</strong><br />

best cut<strong>of</strong>f <strong>an</strong>d best sensitivity <strong>an</strong>d specificity values. The<br />

best cut<strong>of</strong>f po<strong>in</strong>t was found for values equal or higher th<strong>an</strong> 5,<br />

comparable to that <strong>in</strong>dicated <strong>in</strong> <strong>the</strong> development study<br />

(<strong>Hendrich</strong> et al., 2003) <strong>an</strong>d <strong>in</strong> Kim’s study (Kim et al., 2007).<br />

The area under <strong>the</strong> curve (AUC) was 0.71 (95% CI 0.60–<br />

0.85), show<strong>in</strong>g a moderate discrim<strong>in</strong>at<strong>in</strong>g power <strong>of</strong> <strong>the</strong><br />

tool (Fig. 1), similarly to <strong>the</strong> values found <strong>in</strong> Kim et al.’s<br />

study (0.73, 95% CI 67–80).<br />

3.5. Risk factors <strong>in</strong> hospitalized elderly<br />

To evaluate <strong>the</strong> <strong>risk</strong> factors that affected <strong>the</strong> <strong>fall</strong>s <strong>in</strong> our<br />

population we calculated <strong>the</strong> odds ratio for each <strong>risk</strong> factor<br />

(Table 3).<br />

The only two <strong>risk</strong> factors that were signific<strong>an</strong>tly related<br />

to <strong>fall</strong>s <strong>in</strong> our study were confusion (OR: 4.26; 95% CI 1.35–<br />

D. Ivziku et al. / International Journal <strong>of</strong> Nurs<strong>in</strong>g Studies 48 (2011) 468–474<br />

13.36) <strong>an</strong>d depression (OR: 3.22; 95% CI 0.97–10.71),<br />

consistently with weight attributed to <strong>the</strong>se <strong>risk</strong> factors <strong>in</strong><br />

<strong>the</strong> tool: <strong>in</strong> fact <strong>Hendrich</strong> recognized a score <strong>of</strong> 4 to <strong>the</strong><br />

confusion <strong>an</strong>d <strong>of</strong> 2 to <strong>the</strong> depression.<br />

4. Discussion<br />

In <strong>the</strong> present study <strong>the</strong> predictive properties as well as<br />

reliability <strong>an</strong>d feasibility <strong>of</strong> <strong>the</strong> HFRM <strong>II</strong> were assessed <strong>in</strong> a<br />

geriatric unit <strong>of</strong> a Teach<strong>in</strong>g Hospital.<br />

Our results showed that <strong>the</strong> time needed to complete<br />

<strong>the</strong> HFRM <strong>II</strong> was about 1 m<strong>in</strong>, as <strong>in</strong>dicated by <strong>Hendrich</strong><br />

(2007). The nurses found it easy <strong>an</strong>d quick to use because<br />

no additional data <strong>an</strong>d time were needed to assess <strong>the</strong> <strong>risk</strong><br />

at <strong>the</strong> patients admission: <strong>the</strong> tool could be compiled us<strong>in</strong>g<br />

<strong>the</strong> data collected at <strong>the</strong> moment <strong>of</strong> admission <strong>in</strong> <strong>the</strong><br />

nurs<strong>in</strong>g assessment record <strong>an</strong>d observ<strong>in</strong>g <strong>the</strong> patient<br />

movements <strong>in</strong> <strong>the</strong> room, not <strong>in</strong>creas<strong>in</strong>g <strong>the</strong> nurs<strong>in</strong>g<br />

workload, already heavy <strong>in</strong> geriatric units, <strong>an</strong>d not add<strong>in</strong>g<br />

burden to <strong>the</strong> patient. In <strong>acute</strong> care hospitals <strong>the</strong>se factors<br />

are import<strong>an</strong>t if we w<strong>an</strong>t that <strong>fall</strong> <strong>risk</strong> assessment tools be<br />

extensively used <strong>in</strong> cl<strong>in</strong>ical practice, as <strong>the</strong> time dedicated<br />

to <strong>the</strong> patient assessment is affected by severity <strong>of</strong> patients<br />

admitted to <strong>the</strong> unit, number <strong>of</strong> nurses <strong>in</strong> staff <strong>an</strong>d<br />

complexity <strong>of</strong> nurs<strong>in</strong>g adm<strong>in</strong>istration duties, such as <strong>the</strong><br />

bulk <strong>of</strong> nurs<strong>in</strong>g records <strong>an</strong>d o<strong>the</strong>r documentations to write<br />

out (Dempsey, 2004).<br />

Compared to <strong>Hendrich</strong> et al. (2003) <strong>an</strong>d Kim studies<br />

(2007), we found higher values <strong>of</strong> sensitivity (86% vs. 74.9%<br />

<strong>an</strong>d 70%) <strong>an</strong>d lower values <strong>of</strong> specificity (43% vs. 73.9% <strong>an</strong>d<br />

61%) (Table 4).<br />

Table 3<br />

Relative <strong>risk</strong>s <strong>of</strong> <strong>the</strong> <strong>risk</strong> factors.<br />

Fig. 1. ROC curve.<br />

Risk factors OR CI P value<br />

Confusion 4.26 1.35–13.36 0.009<br />

Depression 3.22 0.97–10.71 0.03<br />

Incont<strong>in</strong>ence 1.08 0.36–3.24 0.21<br />

Vertigo 0.77 0.25–2.34 0.19<br />

Sex (male) 1.46 0.49–4.36 0.17<br />

Benzodiazep<strong>in</strong>es 1.03 0.30–3.46 0.23<br />

Antiepileptics 0.98 0.11–8.14 0.39<br />

Get up <strong>an</strong>d Go (score 3) 1.95 0.64–5.87 0.10


Table 4<br />

Psychometric values <strong>of</strong> <strong>Hendrich</strong> <strong>II</strong> Model <strong>in</strong> different studies.<br />

Authors <strong>Hendrich</strong><br />

et al. (2003)<br />

Kim<br />

et al. (2007)<br />

Sensitivity 0.75 0.70 0.86<br />

Specificity 0.74 0.61 0.43<br />

PPV ne 0.02 0.11<br />

NPV<br />

ne, not evaluated.<br />

ne 0.95 0.97<br />

Our higher sensitivity could be related to <strong>the</strong> fact that<br />

<strong>the</strong> <strong>risk</strong> factors <strong>in</strong>cluded <strong>in</strong> <strong>the</strong> <strong>Hendrich</strong> <strong>fall</strong> <strong>risk</strong> <strong>model</strong> are<br />

highly relev<strong>an</strong>t for <strong>the</strong> elderly compar<strong>in</strong>g to a general<br />

hospitalized population admitted to medical–surgical<br />

units or persons younger th<strong>an</strong> 65 years old. In fact giv<strong>in</strong>g<br />

higher scores to confusion <strong>an</strong>d depression (4 <strong>an</strong>d 2<br />

respectively), c<strong>an</strong> help to predict <strong>fall</strong>s <strong>in</strong> geriatric patients<br />

as <strong>the</strong>se conditions are more frequent <strong>in</strong> elderly admitted<br />

to hospital <strong>an</strong>d are recognized as import<strong>an</strong>t <strong>risk</strong> factors for<br />

hospitalized elderly patients (Rubenste<strong>in</strong>, 2006; Scott<br />

et al., 2007).<br />

This study was <strong>the</strong> first one to test this assessment tool<br />

specifically on geriatric patients so far <strong>an</strong>d we could not<br />

know if this discrim<strong>in</strong>ative value depends on characteristics<br />

<strong>of</strong> population admitted to our unit.<br />

Compared to a relatively high specificity <strong>of</strong> <strong>the</strong><br />

<strong>Hendrich</strong> study, <strong>in</strong> our study <strong>the</strong> specificity was quite<br />

low, with proportion <strong>of</strong> false-positive <strong>fall</strong>ers (<strong>risk</strong>-score<br />

patients who did not <strong>fall</strong>) <strong>of</strong> 57%. This was not completely<br />

unexpected s<strong>in</strong>ce lower specificity values have been found<br />

frequently by researchers o<strong>the</strong>r th<strong>an</strong> those who developed<br />

<strong>the</strong> <strong>risk</strong> assessment tools because <strong>of</strong> sett<strong>in</strong>gs <strong>an</strong>d population<br />

ch<strong>an</strong>ges (Oliver et al., 2004).<br />

Accord<strong>in</strong>g to Myers, on <strong>the</strong> accuracy calculations two<br />

confounders c<strong>an</strong> have impact: treatment paradox <strong>an</strong>d<br />

ward prevention measures. Treatment paradox occurs<br />

when nurses are aware <strong>of</strong> <strong>the</strong> <strong>risk</strong> scores <strong>an</strong>d implement<br />

<strong>fall</strong> prevention measures for high <strong>risk</strong> patients <strong>an</strong>d not for<br />

low <strong>risk</strong> patients. For this reason it is import<strong>an</strong>t that nurses<br />

rema<strong>in</strong> bl<strong>in</strong>d to <strong>the</strong> results <strong>of</strong> <strong>the</strong> assessment when test<strong>in</strong>g<br />

<strong>the</strong> accuracy <strong>of</strong> a tool. Even if nurses are bl<strong>in</strong>d to <strong>the</strong> <strong>risk</strong><br />

assessment it is likely that some type <strong>of</strong> <strong>fall</strong> prevention<br />

protocol is <strong>in</strong> place <strong>in</strong> <strong>the</strong> hospital sett<strong>in</strong>g. Fall might<br />

<strong>the</strong>refore be prevented by normal ward practices. This<br />

issue is difficult to counter as it would be unethical to ask<br />

nurs<strong>in</strong>g staff not to implement <strong>fall</strong> prevention measures<br />

(Myers, 2003).<br />

This could be occurred also <strong>in</strong> our study as, even if <strong>in</strong> <strong>the</strong><br />

geriatric unit do not exist a formal protocol for prevent<strong>in</strong>g<br />

<strong>fall</strong>s, <strong>the</strong> nurses pl<strong>an</strong> <strong>an</strong>d implement <strong>fall</strong> preventive<br />

<strong>in</strong>terventions when <strong>the</strong>y judge that a patient is at high<br />

<strong>risk</strong> on <strong>the</strong> basis <strong>of</strong> <strong>the</strong>ir cl<strong>in</strong>ical nurs<strong>in</strong>g assessment at <strong>the</strong><br />

patient admission. For example, if <strong>the</strong> older patient is<br />

confused or agitated <strong>the</strong>y usually ask one <strong>of</strong> <strong>the</strong> relatives to<br />

stay by <strong>the</strong> older patients dur<strong>in</strong>g <strong>the</strong> day <strong>an</strong>d/or <strong>the</strong> night;<br />

<strong>the</strong> nurses check more <strong>an</strong>d more times patients considered<br />

at <strong>risk</strong> <strong>of</strong> <strong>fall</strong><strong>in</strong>g dur<strong>in</strong>g <strong>the</strong>ir shifts; moreover <strong>the</strong> relatives<br />

employ family assist<strong>an</strong>ts to help <strong>the</strong>ir elderly dur<strong>in</strong>g <strong>the</strong><br />

hospital stay whe<strong>the</strong>r <strong>the</strong>y have some physical limitations.<br />

These <strong>in</strong>terventions c<strong>an</strong> be effective <strong>an</strong>d reduce <strong>the</strong> <strong>risk</strong> <strong>of</strong><br />

<strong>fall</strong><strong>in</strong>g <strong>in</strong> some patients at <strong>risk</strong>.<br />

D. Ivziku et al. / International Journal <strong>of</strong> Nurs<strong>in</strong>g Studies 48 (2011) 468–474 473<br />

Ivziku et al.<br />

(current study)<br />

One more expl<strong>an</strong>ation could be that severely impaired<br />

patient <strong>an</strong>d patient’s family may become more aware <strong>of</strong><br />

<strong>the</strong> <strong>risk</strong> <strong>of</strong> <strong>fall</strong><strong>in</strong>g <strong>in</strong> hospital sett<strong>in</strong>gs <strong>an</strong>d consequently<br />

better protected those at <strong>risk</strong> apply<strong>in</strong>g some precautions.<br />

In addition, <strong>the</strong> patient health conditions c<strong>an</strong> improve<br />

dur<strong>in</strong>g <strong>the</strong> hospital stay <strong>an</strong>d consequently <strong>the</strong> <strong>risk</strong> scores<br />

c<strong>an</strong> ch<strong>an</strong>ge, so <strong>the</strong> admission score, that we used <strong>in</strong> our<br />

research to assess <strong>the</strong> <strong>risk</strong>, might not represent <strong>the</strong> <strong>risk</strong> <strong>of</strong><br />

<strong>the</strong> patients dur<strong>in</strong>g his/her hospital stay.<br />

The weak specificity <strong>of</strong> a <strong>fall</strong> <strong>risk</strong> assessment tool is <strong>of</strong><br />

some relev<strong>an</strong>t concern when evaluat<strong>in</strong>g its cl<strong>in</strong>ical utility,<br />

because m<strong>an</strong>y patients who do not <strong>fall</strong> are identified at<br />

high <strong>risk</strong>. This has implications for <strong>the</strong> implementation <strong>of</strong><br />

<strong>fall</strong> prevention <strong>in</strong>terventions that should be ma<strong>in</strong>ly<br />

targeted at those at high <strong>risk</strong>. Fall prevention programs<br />

may lose some <strong>of</strong> <strong>the</strong>ir signific<strong>an</strong>ce if staff perceives that<br />

too m<strong>an</strong>y patients are identified at high <strong>risk</strong> for <strong>fall</strong>s.<br />

We found <strong>an</strong> <strong>in</strong>ter-rater reliability very similar to that<br />

calculated <strong>in</strong> <strong>the</strong> Kim et al.‘s study (k = 0.81 vs 0.87). The<br />

<strong>an</strong>alysis <strong>of</strong> <strong>the</strong> reasons <strong>of</strong> rater disagreement <strong>in</strong>dicated <strong>the</strong><br />

need to <strong>in</strong>clude <strong>in</strong> <strong>the</strong> tra<strong>in</strong><strong>in</strong>g program more examples <strong>an</strong>d<br />

expl<strong>an</strong>ations about particular cl<strong>in</strong>ical situations (for example<br />

how to score <strong>the</strong> patient with prescription <strong>of</strong> benzodiazep<strong>in</strong>e<br />

at occurrence, patients with cognitive<br />

impairment, temporary or perm<strong>an</strong>ent vertigo at admission).<br />

5. Study limitations<br />

Even though <strong>the</strong> <strong>in</strong>ter-rater reliability <strong>in</strong> our study was<br />

quite high, <strong>the</strong> r<strong>an</strong>ge <strong>of</strong> CI at 95% <strong>of</strong> 0.71–1.00 <strong>in</strong>dicated<br />

that it should have been necessary to test a higher sample<br />

size <strong>in</strong> order to have a power at least <strong>of</strong> 0.80 with <strong>an</strong> alpha<br />

<strong>of</strong> 0.05 as <strong>the</strong> literature suggests (Papaio<strong>an</strong>nou et al., 2004).<br />

Moreover this study presents a low number <strong>of</strong> patients<br />

studied due to <strong>the</strong> small number <strong>of</strong> beds <strong>in</strong> our geriatric<br />

unit <strong>an</strong>d to <strong>the</strong> short period <strong>of</strong> study. Even if <strong>the</strong> total <strong>fall</strong><br />

rate <strong>of</strong> 7.5 per 1000 patient days is consistent with <strong>the</strong><br />

r<strong>an</strong>ge <strong>of</strong> <strong>the</strong> rates reported <strong>in</strong> <strong>the</strong> literature, <strong>the</strong> number <strong>of</strong><br />

<strong>fall</strong>s recorded (n = 14) is very limited <strong>an</strong>d do not permit to<br />

generalize our results. In addition, as <strong>the</strong> research was<br />

carried out <strong>in</strong> one s<strong>in</strong>gle geriatric unit, fur<strong>the</strong>r validation<br />

studies will be necessary to extend <strong>the</strong> use <strong>in</strong> o<strong>the</strong>r<br />

geriatric units or on <strong>the</strong> general elderly population<br />

admitted to hospital.<br />

We did not reassess <strong>the</strong> patients when <strong>the</strong> cl<strong>in</strong>ical<br />

conditions ch<strong>an</strong>ged to not burden <strong>the</strong> nurses work<strong>in</strong>g <strong>in</strong><br />

<strong>the</strong> unit. We do not know if <strong>the</strong> <strong>fall</strong> <strong>risk</strong> score rema<strong>in</strong>ed <strong>the</strong><br />

same or ch<strong>an</strong>ged just prior to <strong>the</strong> <strong>fall</strong>. Elderly patients<br />

should be reassessed dur<strong>in</strong>g <strong>the</strong>ir hospital stay as <strong>the</strong>ir<br />

health conditions c<strong>an</strong> ch<strong>an</strong>ge rapidly, <strong>an</strong>d new medications<br />

c<strong>an</strong> be prescribed (<strong>Hendrich</strong> et al., 2003).<br />

We did not compare <strong>the</strong> HFRM with o<strong>the</strong>r <strong>fall</strong> <strong>risk</strong><br />

assessment tools to evaluate <strong>the</strong> different discrim<strong>in</strong>ative<br />

power <strong>an</strong>d <strong>the</strong> effectiveness <strong>of</strong> different tools. A comparison<br />

with o<strong>the</strong>r tools could be useful to verify <strong>the</strong> power <strong>of</strong><br />

o<strong>the</strong>r <strong>risk</strong> factors <strong>an</strong>d tools <strong>in</strong> our population.<br />

6. Conclusions<br />

The use <strong>of</strong> quick, reliable <strong>an</strong>d valid <strong>fall</strong> <strong>risk</strong> tools to<br />

identify high <strong>risk</strong> patients <strong>an</strong>d to elicit fur<strong>the</strong>r <strong>fall</strong> related


474<br />

assessments <strong>an</strong>d <strong>in</strong>terventions is recognized import<strong>an</strong>t <strong>in</strong><br />

all cl<strong>in</strong>ical practice sett<strong>in</strong>gs. The <strong>in</strong>ternational research has<br />

not identified one optimal <strong>fall</strong> <strong>risk</strong> assessment tool for <strong>the</strong><br />

<strong>acute</strong> care sett<strong>in</strong>gs, <strong>an</strong>d <strong>in</strong> particular for elderly <strong>in</strong>patients.<br />

We aimed with our research to contribute to <strong>the</strong> search<br />

<strong>of</strong> a valid <strong>an</strong>d reliable <strong>risk</strong> assessment tool by evaluat<strong>in</strong>g<br />

<strong>the</strong> predictive <strong>validity</strong> <strong>of</strong> <strong>the</strong> HFRM <strong>II</strong> <strong>in</strong> a geriatric unit. We<br />

found that this tool is easy to apply, <strong>the</strong> data c<strong>an</strong> be<br />

collected simply, <strong>the</strong> score is quick to calculate, <strong>an</strong>d has<br />

good sensitivity but low specificity.<br />

Hence we c<strong>an</strong> moderately recommend <strong>the</strong> rout<strong>in</strong>e use<br />

<strong>of</strong> HFRM <strong>II</strong> to assess <strong>the</strong> <strong>fall</strong> <strong>risk</strong> <strong>in</strong> <strong>the</strong> geriatric unit <strong>of</strong> our<br />

Teach<strong>in</strong>g Hospital.<br />

Acknowledgements<br />

The authors wish to acknowledge <strong>the</strong> nurs<strong>in</strong>g staff <strong>of</strong><br />

<strong>the</strong> Geriatric Unit <strong>of</strong> <strong>the</strong> Campus Bio-Medico University<br />

Hospital for <strong>the</strong> collaboration. The authors also extend<br />

<strong>the</strong>ir acknowledgements to Ann <strong>Hendrich</strong>, PhD, author <strong>of</strong><br />

<strong>the</strong> <strong>Hendrich</strong> <strong>II</strong> Fall Risk Model ß , for her <strong>in</strong>valuable advice<br />

<strong>an</strong>d support.<br />

Conflict <strong>of</strong> <strong>in</strong>terest: None declared.<br />

Fund<strong>in</strong>g: We do not have <strong>an</strong>y sources <strong>of</strong> fund<strong>in</strong>g for our<br />

research.<br />

Ethical approval: This study was approved by <strong>the</strong> ethical<br />

Committee <strong>of</strong> <strong>the</strong> Campus Bio-Medico University Hospital.<br />

References<br />

Barros, C., De Mar<strong>in</strong>is, M.G., Matarese, M., Murgese, S., Tartagl<strong>in</strong>i, D., 2007.<br />

Un <strong>model</strong>lo di org<strong>an</strong>izzazione dell’attività assistenziale <strong>in</strong>fermieristica<br />

che metta al centro il paziente ricoverato: l’esperienza del<br />

policl<strong>in</strong>ico Campus Bio-medico di Roma. Medic 15 (2), 92–97.<br />

Coussement, J., De Paepe, L., Schwendim<strong>an</strong>n, R., Denhaerynck, K., Dejaeger,<br />

E., Milisen, K., 2008. Interventions for prevent<strong>in</strong>g <strong>fall</strong>s <strong>in</strong> <strong>acute</strong>-<br />

D. Ivziku et al. / International Journal <strong>of</strong> Nurs<strong>in</strong>g Studies 48 (2011) 468–474<br />

<strong>an</strong>d chronic-care hospitals: a systematic review <strong>an</strong>d meta-<strong>an</strong>alysis.<br />

Journal <strong>of</strong> Americ<strong>an</strong> Geriatric Society 56 (1), 29–36.<br />

Dempsey, J., 2004. Falls prevention revisited: a call for a new approach.<br />

Journal <strong>of</strong> Cl<strong>in</strong>ical Nurs<strong>in</strong>g 13 (4), 479–485.<br />

Gillespie, L.D., Gillespie, W.J., Robertson, M.C., Lamb, S.E., Cumm<strong>in</strong>g, R.,<br />

Rowe, B.H., 2003. Interventions for prevent<strong>in</strong>g <strong>fall</strong>s <strong>in</strong> elderly people<br />

(Cochr<strong>an</strong>e Review). The Cochr<strong>an</strong>e Library 4, 3.<br />

<strong>Hendrich</strong>, A.L., Bender, P.S., Nyhuis, A., 2003. Validation <strong>of</strong> <strong>the</strong> <strong>Hendrich</strong> <strong>II</strong><br />

Fall Risk <strong>model</strong>: a large concurrent case/control study <strong>of</strong> hospitalized<br />

patients. Applied Nurs<strong>in</strong>g Research 16 (1), 9–21.<br />

<strong>Hendrich</strong>, A., 2007. How to try this: predict<strong>in</strong>g patient <strong>fall</strong>s. Us<strong>in</strong>g <strong>the</strong><br />

<strong>Hendrich</strong> <strong>II</strong> Fall Risk Model <strong>in</strong> cl<strong>in</strong>ical practice. Americ<strong>an</strong> Journal <strong>of</strong><br />

Nurs<strong>in</strong>g 107 (11), 50–58.<br />

Hauer, K., Lamb, S., Jorstad, E.C., Todd, C., Becker, C., 2003. Systematic<br />

review <strong>of</strong> def<strong>in</strong>itions <strong>an</strong>d methods <strong>of</strong> measur<strong>in</strong>g <strong>fall</strong>s <strong>in</strong> r<strong>an</strong>domised<br />

controlled <strong>fall</strong> prevention trials. Age <strong>an</strong>d Age<strong>in</strong>g 35, 5–10.<br />

K<strong>an</strong>nus, P., Siev<strong>an</strong>en, H., Palv<strong>an</strong>en, M., Järv<strong>in</strong>en, T., Parkkari, J., 2005.<br />

Prevention <strong>of</strong> <strong>fall</strong>s <strong>an</strong>d consequent <strong>in</strong>juries <strong>in</strong> elderly people. L<strong>an</strong>cet<br />

366 (9500), 1885–1893.<br />

Kim, E.A., Mordiff, S.Z., Bee, W.H., Devi, K., Ev<strong>an</strong>s, D., 2007. Evaluation <strong>of</strong><br />

three <strong>fall</strong> <strong>risk</strong> assessment tools <strong>in</strong> <strong>an</strong> <strong>acute</strong> care sett<strong>in</strong>g. Journal <strong>of</strong><br />

Adv<strong>an</strong>ced Nurs<strong>in</strong>g 60 (4), 427–435.<br />

Myers, H., 2003. Hospital <strong>fall</strong> <strong>risk</strong> assessment tools: a critique <strong>of</strong> <strong>the</strong><br />

literature. International Journal <strong>of</strong> Nurs<strong>in</strong>g Practice 9 (4), 223–<br />

225.<br />

Oliver, D., Daly, F., Mart<strong>in</strong>, F.C., McMurdo, M.E., 2004. Risk factors <strong>an</strong>d <strong>risk</strong><br />

assessment tools for <strong>fall</strong>s <strong>in</strong> hospital <strong>in</strong>-patients: a systematic review.<br />

Age <strong>an</strong>d Age<strong>in</strong>g 33 (2), 122–130.<br />

Oliver, D., 2007. Older people who <strong>fall</strong>: why <strong>the</strong>y matter <strong>an</strong>d what you c<strong>an</strong><br />

do. British Journal <strong>of</strong> Community Nurs<strong>in</strong>g 12 (11), 500–507.<br />

Papaio<strong>an</strong>nou, A., Park<strong>in</strong>son, W., Cook, R., Ferko, N., Coker, E., D’Adachi, J.,<br />

2004. Prediction <strong>of</strong> <strong>fall</strong>s us<strong>in</strong>g a <strong>risk</strong> assessment tool <strong>in</strong> <strong>the</strong> <strong>acute</strong> care<br />

sett<strong>in</strong>g. Biomed Central Medic<strong>in</strong>e 2, 1–7.<br />

Perrell, K.L., Nelson, A., Goldm<strong>an</strong>, R.L., Lu<strong>the</strong>r, S.L., Prieto-Lewis, N.,<br />

Rubenste<strong>in</strong>, L.Z., 2001. Fall <strong>risk</strong> assessment measures: <strong>an</strong> <strong>an</strong>alytic<br />

review. Journal <strong>of</strong> Gerontology 50 (12), M761–M766.<br />

Rubenste<strong>in</strong>, L.Z., Josephson, K.R., 2001. Guidel<strong>in</strong>es for prevention <strong>of</strong> <strong>fall</strong>s<br />

<strong>in</strong> older persons. Journal <strong>of</strong> Americ<strong>an</strong> Geriatric Society 49,<br />

664–672.<br />

Rubenste<strong>in</strong>, L.Z., 2006. Falls <strong>in</strong> older people: epidemiology, <strong>risk</strong> factors<br />

<strong>an</strong>d strategies for prevention. Age <strong>an</strong>d Age<strong>in</strong>g 35 S2, ii34–ii41.<br />

Scott, V., Votova, K., Sc<strong>an</strong>l<strong>an</strong>, A., Close, J., 2007. Multifactorial <strong>an</strong>d functional<br />

mobility assessment tools for <strong>fall</strong>s <strong>risk</strong> among older adults <strong>in</strong><br />

<strong>the</strong> community, home-support, long-term care <strong>an</strong>d <strong>acute</strong> sett<strong>in</strong>gs.<br />

Age <strong>an</strong>d Age<strong>in</strong>g 36 (2), 130–140.

Hooray! Your file is uploaded and ready to be published.

Saved successfully!

Ooh no, something went wrong!