We dabbled with the idea of moving our project in a direction of system change of framing certain aspects of learning into a scaffolding system. We envisioned our research questions as the following:
Our research question: How do we design a feedback system that guides middle school and elementary level students in giving more extensive and comprehensive feedback to their peers in the realm of Scratch and computer science?
Novice Programmers Talking about Projects: What Automated Text Analysis Reveals about Online Scratch Users’ Comments
We found some evidence in some research papers such as this one: http://ieeexplore.ieee.org/document/6758806/
- “ Higher specificity could demonstrate a high quality of feedback on others’ projects, such as in constructive praise or criticism “
- Emotive words (negative ones) tend to lead to comments and feedback of lower quality
- *comments should help generate a positive online environment
- Comments geared toward the author or anything besides the project are not as good
Words like cool and good are not as effective, having questions like “why do you think its cool?”
Our Design Intervention
More inDepth Look
Our system will have two main components: A time based feedback system + questions that help user construct useful feedback system.
To begin with, we will make a platform in the existing place of Scratch to allow for constructive feedback fore students. This will be done in the following way of adding a section on the page.
Time Based Commenting
Often times, it’s the process that need feedback for students to improve on their work. If the student wishes to upload their work in the feedback community, they have the option of making their process of thinking through their scratch to be video recorded.
This allows other members of the community to give feedback on the users
In relation to our vision for peer feedback in Scratch, we wonder if we can do more than create a mold for the comments to be like, but instead scaffold how the Scratch users give feedback to each other.
We envision a text box that will pop a message to encourage the user to move a certain direction based off what they have typed in so far. Another idea is to highlight words like “good” or “cool” and ask the user to extrapolate: “what do you think makes it cool?”. In order to keep the community free of negative influencers, negative emotive words could be detected and a message could appear to discourage the comment.
We will use a similar system as PeerStudio in which the users are guided with the questions.
In Velasquez et al’s study “Novice Programmers Talking about Projects…”,
comments on Scratch projects were shown to be more extensive content versus comments on various other topics (the user, general talk, etc). These comments on Scratch projects contribute to the community with feedback but also with ‘pleasantness’. What this study also finds is that the comments on project tend to mold to a similar format, through data mining they see that most project comments are not qualitatively different.
In relation to our vision for peer feedback in Scratch, we wonder if we can do more than create a mold for the comments to be like, but instead scaffold how the Scratch users give feedback to each other. While providing a system for users to give feedback is valuable, we think that there is a potential to do more. If there is currently a mold that Scratch users fill into for providing feedback, we want to shape that mold in our system. With richer comments and feedback, there is a potential for better revisions and more motivation.
To shape user feedback, we propose that we scaffold users in providing feedback. Like in PeerStudio, we want to have questions to prompt the user to think more deeply about what they are reviewing.
Examples of Comments that generate a positive community
- What about this project appeals to you the most?
- Give 3 observations you made that were well-made in this project?
- What is this project’s biggest success?
- What did you like about this project?
- Is there something this project can improve on?
- What made the experience difficult for you?
- What is something that you can add to this?
We will continue to user test with our system.