Education/Surveys/2016 survey goals assessment

Methods

Eight education program surveys were submitted from various program leaders ( Thank you!! ). With the available information, the surveys and questions were categorized based on:

1. whether the surveys were for students or educators
2. whether the education program was online/offline
3. what area of the program the questions focused on
4. what kind of data the question asked (attitude, attribute, behavior)

Since this is the first time we are creating survey templates for the education program, we are focusing only create one survey template that is for educators and one survey template for students. We did not use the online/offline distinction since many of the questions are likely relevant for both spaces. Program leaders would be able to pick and choose which questions are best for their program.

Area of programs

There were 6 different areas of the programs that surveys focused on:

• Activity/Output - Questions that ask about things that happen during a program (e.g. languages edited)
• Learning outcome - Questions that ask what people learned (e.g. what they learned from using Wikipedia in the classroom)
• Behavior outcome - Questions that ask what people do, or aim to do, after the program (e.g. whether they plan to edit in the future)
• Program design - Questions that are feedback about their experience in the program (e.g. best parts or worst parts about program)
• Non-program Personal - Questions that are about the person, not related to the program (e.g. username, name, gender)
• Non-program Environmental - Questions about the person's environment, not related to the program (e.g. how teachers view wikipedia at school)

Survey Goals Analysis

Below you will find the most important goals for Education Program surveys.

• Do these survey goals cover the most important data you need from a survey? Is there anything important missing?
• Which survey goals are the most important for you? Why?
• How do you use the data from your surveys?

Share your thoughts with Edward on the talk page by March 23, 2016!

To view all the questions in the surveys, jump to the All questions section.

Educator Survey

Activity/Output

• To learn educator's editing activity during an event
• To learn which resources educators used for their classroom

Learning Outcome

• To learn educator's understanding/perception of wikimedia culture
• To learn educator's understanding/perception about the applications of Wikimedia in the classroom

Behavior Outcome

• To learn educator's intent to use Wikipedia in the classroom
• To learn about educator's interest to participate in community outreach
• To learn about educator's interest to repeat/return to course/program

Program design

• To learn whether the content of a training fit the educator's expectations/needs
• To learn feedback about logistics and process of educator's course
• To learn about educator's overall experience
• To learn feedback about educator's available resources and support
• To learn feedback about educator's available software and tools

Information about the educator (non-program)

• To learn the educator's personal information

Information about the educator's environment (non-program)

• To learn the educator's classroom demographics

Student Survey

Activity/Output

• To learn student's editing activity during program (language, projects, etc.)
• To learn student's expectations/motivations with program

Learning Outcome

• To learn student's opinion about writing Wikipedia articles in the classroom

Behavior Outcome

• To learn student's interest in editing in the future
• To learn whether student's interest in repeating course with Wikipedia

Program design

• To learn student's overall experience with program
• To learn whether program content fit student's needs
• To learn student's experiences with software & tools
• To learn student's experience with Wiki culture

Information about the student (non-program)

• To learn student's use of Wikimedia prior to program (edits, language, software)
• To learn student's personal information (name, hometown, gender)
• To learn student's perception about Wikipedia
• To learn student's awareness of WM organization

Information about the student's environment (non-program)

• To learn the student's teacher's opinion about Wikipedia in the classroom

Additional Synthesis

This table below shows the number of questions total in each area. This aggregation show which areas of the program were most important for program leaders to assess. The main findings are:

• The areas that had the most questions across all surveys were program design followed by Non-personal program information.
• Questions for educators focused the most around program design followed by behavior outcomes (or what actions educators take with what they learned).
• Questions for students focused the most around non-program personal information (e.g. experience with wikipedia, name/username), followed by program design feedback.

	Activity/Output	Behavior outcome	Learning outcome	Non-program Environmental	Non-program Personal	Program design	Grand Total
Educators	4	10	6	1	2	27	50
Students	4	6	4	4	21	12	46
Grand Total	8	16	10	5	23	39	101

All Questions

All questions

The survey numbers in the table below correspond to each of the following surveys: 1. https://outreach.wikimedia.org/wiki/Education/Surveys/Argentina_online_course_survey 2. https://s.qualtrics.com/jfe5/preview/SV_6DoU3EEOXmIe885 3. https://outreach.wikimedia.org/wiki/Education/Surveys/Argentina_education_hackathon_survey 4. https://outreach.wikimedia.org/wiki/Education/Surveys/Catalonia_Viquimodernisme_survey 5. https://outreach.wikimedia.org/wiki/Education/Surveys/Palestine_survey 6. https://outreach.wikimedia.org/wiki/Education/Surveys/Bulgaria_education_survey_WWT_2013-2014 7. https://outreach.wikimedia.org/wiki/Education/Surveys/Bulgaria_education_survey_OMPR_2012-2013 8. https://outreach.wikimedia.org/wiki/Education/Surveys/Argentina_volunteer_meeting_survey Survey Question Target audience Type of program Area Topic Type 1 Of all the Wikimedia projects that met through the course what you were the most used? (wikipedia, commons, etc.) Educators Online Activity/Output Editing activity Behavior 1 During course development activity: Did you make editing Wikipedia? Educators Online Activity/Output Editing activity Behavior 2 Which of the following resources did your students use when completing the assignment? Educators Offline Activity/Output Resources Behavior 2 Did you instruct your students to use VisualEditor? Educators Offline Activity/Output Resources Behavior 3 Would you use Wikipedia in your school projects or educational? * Educators Offline Behavior outcome Classroom application Behavior 3 Do you think you'll work with your students than the notion of "verifiable information"? * Educators Offline Behavior outcome Classroom application Behavior 3 Do you think you're going to implement some of the activities that you have just created in Hackathon? * Educators Offline Behavior outcome Classroom application Behavior 2 Do you plan to teach with Wikipedia again? Educators Offline Behavior outcome Classroom application Behavior 1 Do you want to continue editing? Educators Online Behavior outcome Editing activity Attitude 2 Would you be interested in helping us connect your institution with a Visiting Scholar? Educators Offline Behavior outcome Engagement/outreach Attitude 2 Would you be willing to recruit a colleague to teach with Wikipedia next term? Educators Offline Behavior outcome Engagement/outreach Attitude 2 The Wiki Education Foundation is dedicated to sharing stories about successful Wikipedia assignments. May we contact you about sharing your story? Educators Offline Behavior outcome Engagement/outreach Attitude 1 Would you do the course again? Educators Online Behavior outcome Return to course/program Attitude 2 Briefly describe why you taught with Wikipedia again this term. Educators Offline Behavior outcome Return to course/program Attitude 2 How would you compare your Wikipedia assignment with a traditional assignment (such as a term paper) in achieving the following student learning objectives? Educators Offline Learning outcome Classroom application Attitude 3 Did it change your perception about Wikipedia as an educator after this experience? * Educators Offline Learning outcome Classroom application Attitude 3 Did it change your perception on the use of data in education? * Educators Offline Learning outcome Classroom application Attitude 1 In education: Do you think that any of the Wikimedia projects, and Wikipedia in particular, they can be useful as a teaching resource? Educators Online Learning outcome Classroom application Attitude 1 What were the ideas and projects Wikipedia changed after the course and its educational application? Educators Online Learning outcome Classroom application Attitude 1 Your knowledge of free culture, will it improved? Educators Online Learning outcome Wikimedia awareness Attitude 1 Could you express in one sentence what the course meant for you? Educators Online Program design Overall experience Attitude 2 Wiki Ed is interested in demographic information about the students we support. Please provide your best estimate for the following: (percentage of demographics) Educators Offline Non-program Environmental Classroom demographics Attribute 1 Name and surname Educators Online Non-program Personal Personal information Attribute 1 Wikipedia User Educators Online Non-program Personal Personal information Attribute 3 What is your opinion about the choice of the general theme of Educational Hackathon (Big Data, Digital Sources, Free culture)? * Regular Good Very good Excellent Educators Offline Program design Content & Fit Attitude 3 Did the tour of the art show Big Bang Data feel like a contribution to the creative process? * Educators Offline Program design Content & Fit Attitude 3 What other subject or problem you interested in an upcoming event like this? * Educators Offline Program design Content & Fit Attitude 1 Once you completed the course, how would you rate the following quality characteristics that we present below (Clarity, Quality, Innovation) Educators Online Program design Content & Fit Attitude 1 What other topics would you like to see / deeper? Educators Online Program design Content & Fit Attitude 3 What is your opinion about the dynamics of work at the tables (with different colleagues)? * Regular Good Very good Excellent Educators Offline Program design Logistics & Process Attitude 1 The length of the course "bridges between educational, digital and free culture" has been the right one? Educators Online Program design Logistics & Process Attitude 1 The length of weekly classes was the right one? Educators Online Program design Logistics & Process Attitude 1 According to the development of the course and your participation on it, how would you rate the development of proposals for activities? (please score with: Very appropriate, Appropriate, Unsuitable or Nothing inappropriate) (Sense training, Implementation, complexity, Teacher Support Team, Consistency in workshops, Time for activities) Educators Online Program design Logistics & Process Attitude 1 According to the development of the classes, what is your opinion about them?(please score with: Very appropriate, Appropriate, Unsuitable or Nothing inappropriate) (Relevance of materials, Extension Classes, Analysis of experience in the Wikimedia projects) Educators Online Program design Logistics & Process Attitude 1 How would you describe your overall experience with the campus (accessibility, navigability, technical support)? Educators Online Program design Logistics & Process Attitude 1 What are the three main issues you believe require improvements in the course and what you propose? Educators Online Program design Overall experience Attitude 2 Do you have any additional comments about your Wikipedia assignment or for us at the Wiki Education Foundation? Educators Offline Program design Overall feedback Attitude 2 How useful did they find each resource? Educators Offline Program design Resources & Support Attitude 2 What other types of information and tools would you find helpful in teaching with Wikipedia? Educators Offline Program design Resources & Support Attitude 2 Did you feel that the Wiki Ed team communicated with you sufficiently throughout the term? Educators Offline Program design Resources & Support Attitude 2 Were you satisfied with your Classroom Program Manager (Helaine)? Educators Offline Program design Resources & Support Attitude 2 Did your Wikipedia Content Expert provide your students with feedback? Educators Offline Program design Resources & Support Attitude 2 Please describe other types of staff support you would find helpful in creating and running your assignment. Educators Offline Program design Resources & Support Attitude 2 How did your students find working with VisualEditor versus wikicode? Educators Offline Program design Software & Tools Attitude 2 How would you rate your experience with VisualEditor? Educators Offline Program design Software & Tools Attitude 2 Please evaluate how useful your students found the Dashboard for the following tasks Educators Offline Program design Software & Tools Attitude 2 What additional Dashboard features would your students find helpful? Educators Offline Program design Software & Tools Attitude 2 How effective was the Dashboard in meeting your needs? Educators Offline Program design Software & Tools Attitude 2 What would help the Dashboard meet your needs better? Educators Offline Program design Software & Tools Attitude 1 How easy or difficult consider to edit in Wikipedia? Educators Online Program design Software & Tools Attitude 4 How would you describe your way of working of the article you responsible? * Students Offline Activity/Output Editing activity Behavior 4 The language wiki articles * Students Offline Activity/Output Editing activity Behavior 4 In addition to the relevant article of viquiprojecte, has published other articles or have participated in other Wikimedia projects? * Students Offline Behavior outcome Editing activity Behavior 4 Back to participate in a similar experience? (scale: Certainly not to I'm sure) Students Offline Behavior outcome Return to course/program Behavior 5 How likely are you to recommend such a course to other students? On a scale of 1-5, 5 being extremely likely and 1 being extremely unlikely Students Offline Behavior outcome Return to course/program Attitude 5 How likely are you to continue editing Wikipedia after the end of this course? On a scale of 1-5, 5 being extremely likely and 1 being extremely unlikely Students Offline Behavior outcome Editing activity Attitude 5 If offered, would you elect to take another course with Wikipedia assignments? Yes/No/Wikipedia assignments are not a factor Students Offline Behavior outcome Return to course/program Attitude 4 What do you think Wikipedia edit rather than a traditional schoolwork? (choose from list) (We would like to know the first feeling you had when you were explaining the "newness") Students Offline Learning outcome Classroom application Attitude 4 All critical opinion on the draft proposal ... will be welcome! Students Offline Program design Overall experience Attitude 5 How would you rate your overall assessment of the Wikipedia assignments? On a scale of 1-5, 5 being excellent, and 1 being very bad Students Offline Program design Overall experience Attitude 4 What is your relationship with Wikipedia before participating in the viquiprojecte? (choose from list) Students Offline Non-program Personal WP use Attitude 5 Name (optional) Students Offline Non-program Personal Personal information Attribute 5 Wikipedia userame (optional) Students Offline Non-program Personal Personal information Attribute 5 What language did you mainly edit in? Arabic/English Students Offline Non-program Personal WP use, language Attribute 4 The introductory sessions to Wikipedia and viquiprojecte of Alex and Esther ... * Students Offline Program design Content & Fit Attitude 4 The use of brackets for links, quotes for bold, system headers, templates ... (difficult, easy, other) Students Offline Program design Software & Tools Attitude 4 The images and the use of wikimedia commons * You have trouble loading images commons? You have problems with the use of the licenses? How can we improve it? (open) Students Offline Program design Software & Tools Attitude 4 On the other Wikipedians who occasionally also publishes article working (ways interacted with communities) Students Offline Program design WikiCulture Attitude 4 Whether your users as working article (On using user pages) Students Offline Program design WikCulture Attitude 4 Which highlight the positive aspects of the experience of viquiprojecte? (open) Students Offline Program design Overall experience Attitude 4 And what negative? * We want to fix it! (open) Students Offline Program design Overall experience Attitude 5 What did you like best about the Wikipedia assignments in this course? Students Offline Program design Overall experience Attitude 5 What did you like least about the Wikipedia assignments in this course? Students Offline Program design Overall experience Attitude 5 If you could do something differently, what would it be? Students Offline Program design Overall experience Attitude 6 What motivated you to join the course? Students Online Activity/Output Expectations Attitude 6 Do you think the course will be: Students Online Activity/Output Expectations Attitude 6 In what ways do you think you would mostly contribute? Students Online Behavior outcome Editing activity Behavior 7 What would motivate you to get involved in the WEP project OMPR? Students Online Learning outcome Classroom application Attribute 7 Do you think that participating in the project by writing new articles in Wikipedia... Students Online Learning outcome Classroom application Attitude 7 Do you like the idea of such a learning project? Students Online Learning outcome Classroom application Attitude 7 In your academic practice so far, have you encountered questions, related to: Students Online Non-program Environmental WP in academia Attitude 7 How have the rest of your teachers addressed to issue of using Wikipedia in the learning process (general trend)? Students Online Non-program Environmental WP in academia Attitude 6 From your previous academic experience, have you ever faced issues related to: Students Online Non-program Environmental WP in academia Attribute 6 How do your teachers consider using Wikipedia in the learning process? Students Online Non-program Environmental WP in academia Attitude 7 Have you used Wikipedia so far and for what? Students Online Non-program Personal WP use Behavior 7 Which language version do you use predominantly? Students Online Non-program Personal WP use, language Behavior 7 How do you find the information in Wikipedia? Students Online Non-program Personal WP use Behavior 7 Complete the sentence with your own words: "For me, Wikipedia is ..." Students Online Non-program Personal WP perception Attitude 7 Gender Students Online Non-program Personal Personal information Attribute 7 Year of birth: Students Online Non-program Personal Personal information Attribute 6 Have you used wiki software so far, and for what? Students Online Non-program Personal WP use, software Behavior 6 Have you ever Wikipedia and for what purposes? Students Online Non-program Personal WP use Behavior 6 How do you use the content of Wikipedia? Students Online Non-program Personal WP use Behavior 6 Which language version of Wikipedia are you using (most often)? Students Online Non-program Personal WP use, language Behavior 6 How well do you know Wikipedia and wiki technology? Students Online Non-program Personal WP use, software Attitude 6 Complete the sentence: "For me Wikipedia is... " (please, don't write "an encyclopedia" :) ) Students Online Non-program Personal WP perception Attitude 8 Username of Wikipedia Volunteers Offline Non-program Personal Personal information Attribute 8 Hometown (specify province) Volunteers Offline Non-program Personal Personal information Attitude 8 What is your main activity on Wikipedia? Volunteers Offline Non-program Personal WP use Behavior 8 How often you edit Wikipedia? Volunteers Offline Non-program Personal WP use Behavior 8 Do you know the work of Wikimedia Argentina? Volunteers Offline Non-program Personal WP awareness Attitude