ACODE benchmarks for e-learning in universities

ACODE, the Australasian Council on Open, Distance and E-Learning, has funded the development of benchmarks for the use of technology in learning and teaching.

The benchmarks were developed as part of an ACODE funded project, initiated in 2004. They were developed collaboratively by representatives of a number of universities (Monash University; RMIT University; University of Melbourne; University of Queensland; University of Southern Queensland; University of Tasmania; Victoria University of Technology), they have been piloted in universities and have been independently reviewed (by Paul Bacsich).

The purpose of the benchmarks is to support continuous quality improvement in e-learning. The approach reflects an enterprise perspective, integrating the key issue of pedagogy with institutional dimensions such as planning, staff development and infrastructure provision. The benchmarks have been developed for use at the enterprise level or by the organisational areas responsible for the provision of leadership and services in this area. Each benchmark area is discrete and can be used alone or in combination with others. Benchmarks can be used for self assessment purposes (in one or several areas), or as part of a collaborative benchmarking exercise.

The benchmarks cover the following eight separate topic areas which have been internationally reviewed:

1. Institution policy and governance for technology supported learning and teaching
2. Planning for, and quality improvement of the integration of technologies for learning and teaching
3. Information technology infrastructure to support learning and teaching
4. Pedagogical application of information and communication technology
5. Professional/staff development for the effective use of technologies for learning and teaching
6. Staff support for the use of technologies for learning and teaching
7. Student training for the effective use of technologies for learning
8. Student support for the use of technologies for learning

Each includes a Scoping Statement, a Good Practice Statement and a summary list of general Performance Indicators (PIs). Institutions can customise the benchmarks by replacing or adding to these Local Performance Indicators (LPIs).

Each Performance Indicator then comprises Performance Measures. Each measure is rated on a 5 point scale (where level 5 indicates good practice). There are five statements that represent progress toward good practice (as represented by an indicator), with some represented as a matrix. Service areas or units within universities can complete a self-assessment of current practice using these indicators, noting that it is not necessary to aspire to best practice on all.

For more details see http://www.acode.edu.au/benchmarks.php. On this website the benchmarks can be downloaded as well as guidelines for use.

Status

A case study on how the ACODE benchmarks were used (in 2007) by the Innovative Research Universities of Australia (IRUA) can be found on the ACODE website.

A more recent example of the use of ACODE benchmarks can be found here at the University of New England, Australia who used them to conduct a self-assessment of technology use at the university (2010).

eMM and ACODE

Within Australasia there are two major, different, but complementary benchmarking tools in use: the ACODE benchmarks for e-learning in universities and the E-Learning Maturity Model (eMM).

The eMM is widely used in the New Zealand context and has largely been funded by government agencies. The ACODE benchmarks have had greater use in Australia and have been focused on institutional self-assessment.

Both these methodologies were early developments and have been used to considerable effect across the higher education sectors in both New Zealand and Australia (Keppell, M. e.a., 2011, p.21).

An analysis of the similarities and differences in topic coverage between the ACODE Benchmarks and version 2.3 of the eMM was made by Stephen Marshall (2009).

References

Marshall, S. (2009) ACODE Benchmarks - eMM version 2.3 Concordance. Report to the Australasian Council of Open and Distance Education. Wellington, NZ, Victoria University of Wellington.

Keppell, M., Suddaby, G., Hard, N. (2011) Good practice report: technology-enhanced learning and teaching. Australian Learning & Teaching Council.