Show your impact

Whakaaturia ngā hua kua puta

Using evaluation to guide your activity

Knowing the difference you’re making enables you to continually refine and reframe your approach. As well as helping to ensure you’re on the right track, having evidence that you are making a difference can help you secure ongoing funding and support.

All Right? has been annually evaluated - this has taken two forms, a quantitative survey and a process evaluation. The survey has measured reach and impact, while the process evaluation has focused on specific population groups or aspects of the campaign.

Ka mua ka muri Walking backwards into the future - moving forward with lessons learnt from the past.
allright_chc_dm0062_edit.jpg
Ka mua ka muri Walking backwards into the future - moving forward with lessons learnt from the past.
Top tip
Do what you can to find out what impact you’re having - whether that’s by chatting to community leaders, looking at web traffic stats, or just getting out and asking questions. And if there are organisations carrying out their own research, don’t be afraid to offer up some questions they could ask on your behalf…

Steps to consider

Steps to consider

Setting objectives

Knowing your objectives helps you to clarify what you'd like to achieve and be able to measure/evaluate. Who do you want to communicate with? What do you want people to do once you’ve got their attention? What levels of awareness or behaviour change are you aspiring to achieve? The clearer your objectives, the easier it is to measure your success.

Using market research

Market research simply involves getting feedback from a subset of your target audience about your actual or possible activities. Using an independent company to do it can provide high quality, independent insights. It’s possible though to do it on a small budget - run a focus group, ask questions on social media, create an online survey, or just ask an auntie!

Embracing other qualitative measures

When it comes to evaluation, your audience comprises two main groups – those who are aware of what you’ve done, and those who aren’t! For those who are aware it’s good to ask where they saw/heard it, whether they deemed it useful, and if they did anything as result. For those who aren’t aware it’s good to know where they get their information so you can adjust your approach in the future. And it’s also good to show them what you’ve done and get their perspectives.

Evaluation in action

A comprehensive evaluation programme has enabled the All Right? campaign to continually refine its approach in order to meet community needs.
01
02
03
04
05

Evaluation in action

01
02
03
04
05
A comprehensive evaluation programme has enabled the All Right? campaign to continually refine its approach in order to meet community needs.
Te Waioratanga

All Right’s first research with Māori was conducted in 2013. A clear finding of the focus groups was that the campaign as it was at the time, did not resonate as much with Māori. This led to the eventual development of the Te Waioratanga workstream.

Te Waioratanga has used a variety of approaches to foster greater appreciation of Māori concepts of health and wellbeing. This has included supporting Te Matatini in 2015, implementing specific campaigns promoting kapa haka and te reo as central tenets of wellbeing, the development of ‘Whānau Effect’ activity cards, and the creation and expansion of Hikitia te Hā.

It's all right to love your Pacific culture

Our research and evaluation with Pacific communities indicated that All Right’s 'mainstream’ campaign did not resonate as much with Pacific people, and a different approach was required which reflected Pacific values and showcased Pacific approaches to promoting wellbeing.

This gave rise to several Pacific- focused campaigns which celebrated Pacific culture and explored concepts of identity and wellbeing. It also led to the development of our Pacifically Speaking resource which comprised of 60 cards of family fun activities and conversation starters.

Tangata whaiora

This evaluation sought to understand the reach and impact of the All Right? campaign specifically for tangata whaiora / people with experience of mental illness.

The evaluation found that the All Right? campaign was valued by tangata whaiora / mental health service users for its positive effects on wellbeing with one respondent describing the campaign as ‘almost a secondary treatment for me, ‘cos every time I see them it reminds me to think about myself and how I’m doing’ and for its contribution to reducing the stigma of mental illness, ‘I think that through the All Right? campaign there is more awareness of mental illness…’.

Click here to read the full evaluation of our impact with tangata whaiora

Social media evaluation

Our social media evaluation found that the majority of survey respondents agreed the Facebook page was helpful (98%), gave people ideas of things they can do to help themselves (96%), and made people think about their wellbeing (93%).

Impressively, 85% of respondents had done activities as a result of what they saw on the All Right? Facebook page.

Read the full evaluation of the social media component of the All Right? campaign here

Rainbow research

The All Right? Campaign is currently undertaking a piece of research into the wellbeing of the Rainbow community in Christchurch.

The research looks to investigate what LGBTQIA+ people identify as their strengths, what changes the community would still like to see, and to hear about any emerging issues which impact on the wellbeing of the community.

As with the campaign's other targeted research pieces, this research includes an evaluation component to consider how the All Right? campaign could positively contribute.

Practical Tools

All Right? campaign evaluation

The All Right? campaign is frequently evaluated for effectiveness to ensure it is on the right track. Evaluation reports, including a 2013 Stakeholder Evaluation, can be found on the All Right? website.

Planning your evaluation

Here's a few of the early planning documents for the All Right? campaign's evaluation component

Gathering feedback

A spreadsheet template you can use for recording useful feedback along the way.

Publications

Evaluations of the All Right? campaign have been published in international academic journals, including;

  • Kristi Calder, Lucy D’Aeth, Sue Turner, Annabel Begg, Ekant Veer, Jo Scott, Ciarán Fox (2019) Evaluation of the All Right? Campaign’s Facebook intervention post-disaster in Canterbury, New Zealand, Health Promotion International, day106, https://doi.org/10.1093/heapro/day106 (original document)
  • Kristi Calder, Lucy D’Aeth, Sue Turner, Ciarán Fox, Annabel Begg (2016) Evaluation of a well-being campaign following a natural disaster in Christchurch, New Zealand, International Journal of Mental Health Promotion, 18:4, 222-233, DOI: 10.1080/14623730.2016.1210531 (original document)
Anticipate the journey
The stages that typically follow a disaster.
DSC00241-2.jpg

Anticipate the journey

Whakaneineitia te anga whakamua

Stages of recovery

Recovering from a disaster takes time (experts suggest five to ten years) and it's important to say right up front that it’s not a straight forward process. It’s very normal for things to feel “two steps forward - one step back” — but research suggests there are some common phases communities go through.

He whare ka āta whakaritea he whare tū tonu A house carefully built is a house that will withstand all storms.
DSC00241-2.jpg
He whare ka āta whakaritea he whare tū tonu A house carefully built is a house that will withstand all storms.
Top tip
Early on, an event or shock can create a common bond that connects your community, but over time, as people's personal situations become more varied, it’s likely your community will be staggered across several different phases. It’s important to make sure your actions evolve to reflect this, so that nobody feels left behind.
Understand wellbeing
Wellbeing and how this can be challenged post-disaster.
AllRight_CHC_DM0458_RMB.jpg

Understand wellbeing

Te māramatanga o te hauora

Why it matters

Mental wellbeing is all about feeling good and functioning well. Mental health is something we all have, and just like our physical health, our mental health is something we can look after and strengthen.

Tama tū tama ora, tama noho tama mate He who is active finds purpose, he who is complacent perishes.
AllRight_CHC_DM0458_RMB.jpg
Tama tū tama ora, tama noho tama mate He who is active finds purpose, he who is complacent perishes.
Top tip
Spending time doing the things that keep us well will help us cope, boost our mood and build positive mental health. Better skills and awareness around this makes us more resilient. It helps to build our adaptive buffers so when times do get tough, we’re able to adapt more quickly.
Seek to understand
Using research to meet people's needs.
AllRight_CHC_DM0961_edit.jpg

Seek to understand

Whāia te māramatanga

Using research to meet people's needs

Before you do anything, it's important to get a sense of where people are at, and how they are doing. Whatever your budget, asking questions and seeking to understand is the perfect place to start (and continue!).

Mā te ara tika koe e whai māramatanga ai By way of the right process you will find understanding.
AllRight_CHC_DM0961_edit.jpg
Mā te ara tika koe e whai māramatanga ai By way of the right process you will find understanding.
Top tip
When it comes to research, our top tip is to be curious. If you can’t afford an independent researcher, just do what you can to find out how people are doing, whether that’s by chatting to community leaders, creating your own surveys, or just getting out and asking questions. Remember that the simple act of asking people how are they are doing, and listening attentively to the responses, can make a big difference in itself, helping people to feel valued and validated.
Building the foundations
Getting (and keeping!) wellbeing on the agenda
AllRight_CHC_DM0896.jpg

Building the foundations

Te hanga tūāpapa

Getting (and keeping!) wellbeing on the agenda

Whether you're working in a recovery space or are wanting to foster greater wellbeing in your community, it’s important to work closely with potential allies who can help. You don’t have to do it alone – and even if you could, the end result is always better with a little help from your friends.

He waka whakaaro kotahi, he waka hoe tahi A vessel with a shared vision is a vessel with synchronised rhythm
AllRight_CHC_DM0896.jpg
He waka whakaaro kotahi, he waka hoe tahi A vessel with a shared vision is a vessel with synchronised rhythm
Top tip
Having the right people around the table helps ensure there is clarity over who is doing what when it comes to recovery. You don’t need to do it all, but it is important that you define the space you are working in.
Amplify the message
How to gain advocates and boost your impact.
AllRight_CHC_DM0706.jpg

Amplify the message

Ko te whakapāho o te karere

Share your message through a variety of channels

Regardless of your budget or the type of work you’re hoping to do, you can achieve much more by working in partnership with others in your community.

He ringa raupā, he ringa hoe waka Allow the experienced of your community to help row the vessel (of communication)
AllRight_CHC_DM0706.jpg
He ringa raupā, he ringa hoe waka Allow the experienced of your community to help row the vessel (of communication)
Top tip
You can exponentially increase your impact by fostering a sense of shared ownership. Working in partnership and providing opportunities to influence your direction increases the likelihood of your stakeholders becoming your champions.
Engage and empower
Supporting people to take more control of their wellbeing.
AllRight_CHC_DM1399_edit.jpg

Engage and empower

Me whakawhanaunga, me whakamana

Best practice health promotion

Mental health promotion supports people to have more awareness of and control over what helps them feel good and function well. Raising emotional and wellbeing literacy can reduce worries or concerns over troubling experiences and emotions, bringing people’s natural coping mechanisms to the fore, improve quality of life, raise awareness of issues early and reduce the need for service-level care.

He aha te mea nui o te ao? He tangata, he tangata, he tangata What is the most important thing? It is people, it is people, it is people
AllRight_CHC_DM1399_edit.jpg
He aha te mea nui o te ao? He tangata, he tangata, he tangata
Top tip
While most people won’t need to access specialist mental health services after an event, everybody can benefit from support to build knowledge and skills to take charge of their own mental health and wellbeing.
Form your team
Specialists, trust and why collaboration makes all the difference
AllRight_CHC_DM1138.jpg

Form your team

Whakaritea tō tira whakahaere

Embracing a multidisciplinary approach

Having a team with a wide range of backgrounds and specialities can deliver the best results. Team up with people who specialise in the things you don’t and foster a culture built on trust, where it's okay to disagree, have different opinions and throw ideas around.

Ehara taku toa i te toa takitahi engari taku toa he toa takitini My success should not be bestowed onto me alone, as it was not individual success but the success of a collective.
AllRight_CHC_DM1138.jpg
Ehara taku toa i te toa takitahi engari taku toa he toa takitini My success should not be bestowed onto me alone, as it was not individual success but the success of a collective.
Top tip
Building a high performing team doesn’t happen overnight, and when you have people from a wide variety of backgrounds the challenge can be even greater. Starting each week with whanaungatanga can be a great way to build camaraderie and trust – your team will also be going through the stages of recovery, not to mention life’s ups and downs.
Get creative
How to create resources that engage and hit their mark.
Allright_chc_dm0574.jpg

Get creative

Whakamahia tō ringa auaha

Resources that engage and hit the mark

Whether you're creating resources, giving talks or planning an event, creativity and thinking outside the square can really help you generate some buzz and engage your audience. Getting specialist help with visual communication can be a big help!

Mā te huruhuru te manu ka rere With feathers allows a bird to fly - with the right tools anything is possible.
Allright_chc_dm0574.jpg
Mā te huruhuru te manu ka rere With feathers allows a bird to fly - with the right tools anything is possible.
Top tip
Interactive resources and activities are best. The goal is to activate the evidence-based actions that improve mental wellbeing. Find ways to make your activity stand out - whether that's developing an innovative concept, using a novel delivery method (e.g. flags in road cones) or developing something tactile (people love things they can play with!). Have fun, be inclusive, and look to connect with your audience.
Show your impact
The benefits of evaluation and sharing your impact.
allright_chc_dm0062_edit.jpg

Show your impact

Whakaaturia ngā hua kua puta

Using evaluation to guide your activity

Knowing the difference you’re making enables you to continually refine and reframe your approach. As well as helping to ensure you’re on the right track, having evidence that you are making a difference can help you secure ongoing funding and support.

All Right? has been annually evaluated - this has taken two forms, a quantitative survey and a process evaluation. The survey has measured reach and impact, while the process evaluation has focused on specific population groups or aspects of the campaign.

Ka mua ka muri Walking backwards into the future - moving forward with lessons learnt from the past.
allright_chc_dm0062_edit.jpg
Ka mua ka muri Walking backwards into the future - moving forward with lessons learnt from the past.
Top tip
Do what you can to find out what impact you’re having - whether that’s by chatting to community leaders, looking at web traffic stats, or just getting out and asking questions. And if there are organisations carrying out their own research, don’t be afraid to offer up some questions they could ask on your behalf…
Find us at:
allright.org.nz
Facebook
Instagram
Twitter