This page provides an overview of metrics and indicators of success that can possibly be used to evaluate GLAM-Wiki cooperations. A large part of this information was gathered during a GLAM-Wiki evaluation workshop at Wikimania 2013.
Please be aware that using quantitative methods is meaningful only in the case of relatively large numbers. For example, a comparison of retention statistics for two workshops with 25 participants each is very unlikely to yield a statistically significant result. Furthermore, measuring certain aspects may be more or less costly or more or less difficult. Indicators of success should therefore be chosen carefully on a case by case basis.
The number of files is given as a default information on category pages; alternatively, the GLAMorous tool also indicates the number of photos contained in child-categories. Use a dedicated Commons category to mark pictures of interest.
Count of the number of pictures uploaded by a given user / group of users within a given time frame
In order to include a category in BaGLAMa, you need to make a service request on the JIRA tool. As of fall 2013, it appears from discussions on Magnus' talk page that the data used for the analysis is not 100% reliable.
Number of page views of the articles containing the uploaded pictures / media files
By comparing this indicator to the length of an event or its financial cost, the "efficiency" of the event itself in terms of content production can be measured. User names of participants need to be collected.
Indicators related to contributors
Number of new contributors that remain active over a certain time period
Number of contributors who edit articles in a given topic area they would otherwise not have contributed to
Survey among participating Wikipedians
Indicators related to GLAM-WIKI interaction
Number of successful interactions between GLAM staff and Wikipedians (e.g. number of feedbacks given and taken into account, number of requested media files that were provided by the institution, number of requested pieces of information that were delivered, etc.)
Use a wiki page to register and track requests or feedback by Wikipedians
Alternatively: keep a work log on the staff side.
Satisfaction of the GLAM regarding feedback quality
Interview(s) with GLAM staff
Satisfaction of the Wikipedia/Wikimedia community regarding the GLAM's feedback quality and/or the GLAM's responsiveness
Number of edits from accounts used by GLAM staff during their working time
This is most easily done based on a participants' list containing user names. Depending on what type of contribution is to be measured, other methods may be applied (e.g. self-declaration, inspection of contribution logs etc.)
Indicators related to public relations
Number of media reports mentioning a particular event / the cooperation
Type/scope/depth of media coverage
Number media reports about a particular event / the cooperation mentioning the chapter name (or any other important information)
Can be applied to any other important piece of information that one intends to convey to a larger public.
Number of contributions on the GLAM web page or in GLAM social media channels referring to a particular event or to the cooperation as such
Inspection of the GLAM web site and social media channels
Interview with / documentation from the GLAM's communications manager
Indicators related to visitors
Number of visits/visitors to the partner GLAM's website (pre/post)
Web analytics tool of the partner GLAM
Number of visits/visitors to the partner GLAM's physical premises (pre/post)
The QRpedia statistics doesn't seem to allow for a differentiation with regard to a particular QRcode display (if the same article is addressed via QRcodes in different locations, they will show up in the same statistics)
Number of visitors that explain Wikipedia content (e.g. accessible via QRpedia code) to children during their visit to the GLAM
Interviews with visitors; observation
Indicators related to resource spending
Financial report of the project / Analytical accounting
Amount of donated resources
Number of staff hours spent
Number of volunteer hours spent
Indicators related to multiplication
The extent to which the project was further elaborated / expanded after a given instance
Number of new GLAM partnerships initiated thanks to the cooperation or to a particular event (presentation/course/workshop)
Monitoring of GLAM-WIKI partnerships
Number of participants becoming organizers of future events
Number of joint applications for external funding
Number of applications / number of money gained for the movement
This will likely happen many months after the original project / event.