LIF Mobile Learning Project Evaluation Survey
Executive Summary
Students participating in the mobile learning projects were given an opportunity to take a survey regarding their experiences. The primary goal of the survey was to answer the question; Did the students perceive the mobile learning activities to be engaging and worthwhile? Responses to the survey varied among the different classes and activities. Overall the results of the survey indicated that students found the activities to be both engaging and worthwhile. Other aspects of the survey focused on access to mobile device and previous experience with mobile devices.
Survey Participation
The survey was administered through an anonymous survey tool on Blackboard. A total of 141 students participated in the survey out of possible 335 for a rate of 42.1%. Participation varied between the classes ranging from a low of 6.7% participation to a high of 76.5%. Variation in student participation may be partially attributed a grade rewarded by some instructors for completion of the survey.
Mobile Use Experience (Q1-5)
Over 60% of participants indicated that they had a mobile device while only 33% used their mobile device to complete the activity. Possibly students did not use a mobile device to completed the activity or they used a device supplied by their instructor. In other classes students were required to use a device and/or a specific app on a device while others were given a situated learning activity and then presented with the option of using a mobile device. 60% of the student had not used a mobile device for learning in the past. The results for Q14 show that 43% of students did not use a tablet or smart phone to complete the activity while 51% did. The other 6% with a neutral response may have used a mobile device other than a smart phone or a tablet, such as a net book, or a digital camera.
Confidence with Mobile Devices (Q6-7)
Approximately 50% of the survey participants were either not confident or neutral with respect to their confidence in using mobile device while 50% were confident in their abilities to use the devices.
Perceived Engagement (Q8-10)
Over 50% of the survey participants found the activity to be enjoyable and interesting while just over 1/3 of the students found the activity to enhance their interest or connect with the material
Quality (Q11-12)
Most students found that the purpose of and instructions for the activities were clear.
Technology (Q13-17)
Only 20% of survey participants were not able to access a mobile device to complete the activity. Overall the devices and the apps were reliable and no problems arose. As well, the cost of completing the activity was acceptable.
Perceived Satisfaction (Q18-21)
With respect to perceived satisfaction with the activity over 75% of survey responses indicated that they were neutral or satisfied with the activity and would take another course which used mobile learning activities and/or recommend such a class to friend.
Additional Comments (Q22)
Additional comments were left by 63 of the survey participants. Comments varied depending on the activity and the requirement for completion of the activity. Comments ranged from “I don’t like nor recommend mobile devices as teaching tools.” to “I found this mobile learning activity very interesting, would recommend it to anyone taking this class and should be offered in more classes.”
Table 1
Strongly Disagree |
Disagree |
Neutral |
Agree |
Strongly Agree |
|
Mobile Device Experience |
|||||
Q1: I have a mobile device (tablet, smart phone) |
22% |
12% |
4% |
20% |
42% |
Q2: I used my mobile device complete the activity |
37% |
22% |
8% |
13% |
20% |
Q3: I used a mobile device supplied by my instructor/department to complete the activity |
54% |
23% |
9% |
7% |
7% |
Q4: I have a great deal of experience with mobile devices |
7% |
15% |
30% |
31% |
18% |
Q5: I have used mobile devices for learning in the past |
28% |
32% |
10% |
19% |
11% |
Confidence with Mobile Devices |
|||||
Q6: I feel confident using a mobile device for learning |
9% |
12% |
28% |
35% |
16% |
Q7: I feel confident using the app(s) on a mobile device for learning |
9% |
18% |
24% |
34% |
15% |
Q8: The mobile activity allowed me to connect with the material |
12% |
14% |
36% |
29% |
9% |
Perceived Engagement |
|||||
Q9: The mobile learning activity enhanced my interest in the subject matter |
6% |
18% |
42% |
26% |
9% |
Q10: The mobile learning activity was enjoyable and interesting |
6% |
7% |
36% |
35% |
16% |
Quality |
|||||
Q11: The purpose of the mobile learning activity was clear |
4% |
4% |
28% |
39% |
26% |
Q12: The instructions for the mobile learning activity were clear |
1% |
4% |
23% |
48% |
23% |
Technology |
|||||
Q13: I was able to easily access a mobile device for this activity |
7% |
13% |
24% |
32% |
25% |
Q14: I used a tablet or smart phone to complete the activity |
24% |
19% |
6% |
23% |
28% |
Q15: The mobile device was reliable and no technological problems arose |
7% |
12% |
31% |
31% |
20% |
Q16: The apps on the mobile device were reliable and no technological problems arose |
6% |
12% |
40% |
24% |
18% |
Q17: The cost of engaging in the mobile activity was acceptable |
4% |
9% |
31% |
32% |
23% |
Perceived Satisfaction |
|||||
Q18: I am satisfied with the mobile learning activity as a learning tool |
7% |
9% |
34% |
34% |
15% |
Q19: The mobility offered by the devices enhanced learning of course material |
7% |
15% |
42% |
26% |
9% |
Q20: I would take another course which included a mobile learning activity |
12% |
10% |
34% |
28% |
15% |
Q21: I would recommend a course with mobile learning activities to a friend |
9% |
13% |
41% |
27% |
9% |