Bridging the Gap Both-Ways: Enhancing Evaluation Quality and Utilisation in a Study of Remote Community Safety and Wellbeing with Indigenous Australians (original) (raw)

Working Both-Ways: Using Participatory and Standardised Methodologies with Indigenous Australians in a Study of Remote Community Safety and Wellbeing

Evaluation Journal of Australasia, 2016

This paper offers reflections on our experience and learning arising from implementing a study design that used evaluation research to pursue multiple benefits. The Community Safety and Wellbeing Study adopted a mixed methods approach, referred to as a ‘both-ways’ (or two-ways) research model, that addressed decision maker's needs and heard the people's voice. The study design was inspired by a both-ways learning model and attempted to address both needs together. The aim of the study was to involve local people in communities and encourage them to share their views about changes in community safety. Through systematic research it provided a voice for Indigenous Australians affected by the Northern Territory Emergency Response (NTER), often called ‘the intervention’. Regardless of views about the intervention, this paper aims to share the lessons learned from conducting this study. The mixed method approach involved a community based standardised survey and qualitative data ...

How can academia contribute to participatory methodologies for community engagement in the diverse cultural contexts of remote Australia?

This paper was prepared in conjunction with a presentation to an Australasian Evaluation Society seminar in Darwin during February 2015. Participatory, developmental and empowering approaches to evaluation are favoured by many evaluators who work in contexts where programs and people face challenges associated with inequity, disempowerment, exclusion, or injustice. For many, the task of evaluation research is not a dispassionate objective process designed simply to find out if or how well something works, or even what could make it better. Many evaluators see themselves as part of the process of uncovering solutions. There is considerable literature about Indigenous methodologies and some good theorising in this space. But what (if any) theoretical foundations can a non-Indigenous evaluator/researcher base their practice on if they wish to do their work ethically, with integrity, while at the same time supporting participatory approaches in remote communities? There are plenty of guidelines and principles non-Indigenous researchers and evaluators can draw on, but what foundation do these have in theory and philosophy? This presentation is an attempt by one non-Indigenous researcher/evaluator to tease out what these might be.

Partnering with Aboriginal and Torres Strait Islander Peoples: An Evaluation Study Protocol to Strengthen a Comprehensive Multi-Scale Evaluation Framework for Participatory Systems Modelling through Indigenous Paradigms and Methodologies

International Journal of Environmental Research and Public Health

The social and emotional wellbeing of young Aboriginal and Torres Strait Islander peoples should be supported through an Indigenous-led and community empowering approach. Applying systems thinking via participatory approaches is aligned with Aboriginal and Torres Strait Islander research paradigms and can be an effective method to deliver a decision support tool for mental health systems planning for Indigenous communities. Evaluations are necessary to understand the effectiveness and value of such methods, uncover protective and healing factors of social and emotional wellbeing, as well as to promote Aboriginal and Torres Strait Islander self-determination over allocation of funding and resources. This paper presents modifications to a published evaluation protocol for participatory systems modelling to align with critical Aboriginal and Torres Strait Islander guidelines and recommendations to support the social and emotional wellbeing of young people. This paper also presents a cu...

Beyond the rhetoric of participatory research in indigenous communities: advances in Australia over the last decade

Qualitative health research, 2011

Evidence-based approaches to health care have been difficult to achieve in Indigenous populations across the world, a situation which has contributed to the significant health disparities found in this group. One reason for the inadequacy of evidence-based health interventions is that empirical knowledge tends to be organized around professional disciplines that are grounded in Western ways of knowing. In this article we describe events that have led to more appropriate research methods in Australia, and the resulting changes in the research community. The principles that have guided Australian research policy development might not yet be fully matured, but the improvements we have experienced over the last several decades have gone a long way toward acknowledging the significant disparities that affect Indigenous people and the role of researchers in addressing this issue.

Northern Territory Domestic and Family Violence policy and practice: engagement through evaluation

THE AUSTRALASIAN JOURNAL OF UNIVERSITY COMMUNITY ENGAGEMENT, 2007

Evaluations have traditionally been used by funding bodies and others to justify the acquittal of funds at the conclusion of a project or to assess the project in terms of meeting a program’s objectives. An alternative view is of evaluations as participative processes. Through the participation, the direction of project activities can be influenced, good practices can be supported and promoted and the ongoing development of strategic policy can be informed. This is the approach being used by Charles Darwin University in the Northern Territory to evaluate Domestic and Family Violence policies and strategies. The paper’s authors have been directly involved in the design and implementation of the evaluations, which are in various stages of progress. This paper explores the methodological basis for this approach, drawing on relevant evaluation literature. It briefly reviews the processes used for these projects, which include an evaluation of a ‘whole of government’ strategies and a suite of interventions designed to address family and domestic violence in several remote Indigenous contexts across the Northern Territory. One of the primary concerns of the whole of government evaluation was to consider how government communicates across agencies and how it engages with non-government organisations providing services to clients and vice versa. The focus of the suite of projects is to trial and develop practices that contribute to good outcomes for families and children at risk of family violence. The University’s involvement is both as an objective observer and an engaged participant in the processes. Traditionally the capacity to be both objective and engaged is seen as being impossible, undesirable or somehow unethical, a position this paper discusses and takes issue with. The paper will consider how one university has engaged with community stakeholders at a variety of levels: Commonwealth and Territory government agency representatives; non-government organisations providing services; representatives from communities and clients. The paper will conclude with an assessment of how effective the University has been: a) in engaging meaningfully with these stakeholder groups; b) in influencing the course of strategy and policy according the needs of the various stakeholder groups; and c) in managing the dual role of objective observer/researcher and engaged participant. The paper will provide insights for other research practitioners who may be considering participative approaches to evaluations. It will also be of particular use to organisations and communities that want to build evaluation into their program development.

The Indigenous Resiliency Project: a worked example of community-based participatory research

New South Wales Public Health Bulletin, 2009

Community-based participatory research (CBPR) is often cited as a suitable methodological approach for academic researchers wanting to work collaboratively with Indigenous communities. This paper describes the Indigenous Resiliency Project currently being conducted in Redfern, Townsville and Perth. This case study is used to demonstrate how a group of university-based researchers and Aboriginal Community Controlled Health Services have used CBPR to work with young Indigenous Australians to explore young people"s perspectives on resilience in relation to bloodborne viruses and sexually transmissible infections. This paper also describes some initial benefits gained through the process of developing the Indigenous Resiliency CBPR Project, such as: developing research capacity; establishing relationships between community organisations and research institutions; and prioritising ethical and social considerations in the conduct of research. A community commentary on the experience of one health worker involved in the project accompanies the paper.

A partnership approach to transitioning policy change in Aboriginal Australian communities

Abstract Aboriginal Australian communities are subjected to frequent government policy changes. Partnerships developed in a Community-based Participatory Research (CBPR) approach can assist communities to lead these changes in ways that value local knowledge and lived experiences, hold community benefits and position them as equal partners. A partnership model used a CBPR approach to support locally-driven action in two projects. The process findings revealed that CBPR processes hold a place of significance in supporting communities to achieve their goals by adding value to what people are already doing and providing a structured framework from which work. Concluded was that Community-driven participatory action research (CDPAR) vis-à-vis CBPR should be contemplated in the future. CDPAR should be conducted in a partnership framework that considers ethics and the power relationships of the working environment; multiple levels of participation in group membership; holistic structured ...

Demonstrating Impact: Lessons Learned from the Queensland Aboriginal and Islander Health Council’s AOD-Our-Way Program

International Journal of Environmental Research and Public Health

In this paper, we describe the innovative way in which the Queensland Aboriginal and Islander Health Council uses "clicker technology" to gather data to report on the key performance indicators of its "AOD-our-way" program, and how, with the subsequent combination of those data with other performance measures, it was possible to go beyond the initial evaluation. The paper also illustrates how the application of survey research methods could further enable enhanced reporting of program outcomes and impacts in an Indigenous context where Indigenous community controlled organisations want to build the evidence base for the issues they care about and ultimately drive their own research agendas.

Researching the safety of children and youth in urban communities: An Indigenous perspective

This paper explores some of the issues and challenges researching communities, neighbourhoods and families by drawing on the experiences of an Indigenous led multidisciplinary research team during the first phase of a community based intervention research project. The project, Safe Koori Kids: Community based approaches to Indigenous injury prevention, targets Aboriginal children, youth and families in urban communities in South Western Sydney. Currently in its pilot stage, the project brings together researchers with disciplinary backgrounds in anthropology, epidemiology, public health, health promotion and community development. In addition to the multi-disciplinary orientation the research is undertaken within the context of Indigenous research paradigm. The discussion focuses on four central issues: firstly, the challenges faced in doing research within Aboriginal communities and families in urban neighbourhoods; secondly, the challenges and issues in interdisciplinary research approach; and thirdly, the strengths and benefits of an Indigenous research paradigm. The paper also highlights the important role of qualitative research methods in public health intervention research.

Aboriginal people 'talking back' to policy in rural Australia

2014

How does a geographically remote Australian Aboriginal community ensure that culturally and locally important priorities are recognised in policy? This paper discusses a case study of Indigenous community engagement in policy making, revealing some of the challenges community leaders face and the strategies they implement in their struggle for a strong say and hand in designing appropriate policy responses to local problems. The case study community is Walgett, a remote New South Wales community with a large Aboriginal population, distinguished in history for its part in the 1965 Freedom Ride which highlighted racial segregation and discrimination across outback Australia. Today Walgett ranks as one of Australia’s most disadvantaged communities (Vinson, 2007), and hence was chosen as one of 29 priority remote Aboriginal communities to be the focus of the Australian Government’s Remote Service Delivery commitment, part of the Closing the Gap agenda.