Tag Archives: instructive feedback

10.29.13 — Supervisory Notes: Providing written feedback

I know many, many SLPs who are ‘blank sheet of paper’ data collectors — they can walk in a session with just a notebook, and write down notes or tallies as they go.  I am not that sort of SLP.  Whether it’s just my strong preference for structure, or my fears of forgetting something important, I have always liked setting up data collection sheets which provide both some space for specific targets (outlined according to the goals), and some space for writing down subjective impressions or notes for consideration.  When I started working as an instructor for clinical practicum experiences (aka, “supervisor”), I found it was no different:  I greatly benefit from having key points or skills designated.

McCrea & Brasseur, discuss Observing in the Supervisory Process in Chapter 6 of The Supervisory Process in Speech-Language Pathology and Audiology (2003), and specifically lend insight into different methods of data collection (p. 166 – 171).   My own “take-away” thoughts from their discussion included, “The understanding and appropriate use of systematic observation and data collection methods by supervisors is important for establishing supervision as a thoughtful, scientific, and validated process.  Supervisors need to be skilled observers, but more than that, they must also develop efficient, practical procedures for recording their observations for later use.” (p. 166).

This also meant that I had set up the opportunity to model:

— the value of data collection — I’m not a fan of “do as I say, not as I do.”  If I tell the students that it is critically important for them to take notes and keep track of learning trends, I think it is just as important that I am also doing so as a means of informing my own teaching,

— at least one example of how data collection can be structured.  We talk about how this is a very personalized endeavor and what works for one person may not work for another; that whatever the method of data collection/coding/tallies is, it should have low cognitive demands (if I have to think to much about my system of note-taking, it means I am distracted from my teaching and at risk for inaccuracy).

— a shared sense of expectations.  When we review my note-taking tools, I talk about what I will be looking for in their conduct, and the rationale.  We discuss how some learners may be curious about the notes they take, and that it can be an opportunity to engage them in self-monitoring.  Others may be distracted by the side activity or wonder about how they are performing, and so these are important considerations to take into account.  If, for whatever reason, it was not appropriate to directly share my  data, I always used to say, “I take notes to help me remember everything I’m learning about you.”

The SOAP format always basically made sense to me, and I designed the sheet that I use to include that structure  as well as the key points required in the grading rubric we use for either intervention or assessment.  I print two copies of the form and use carbon paper — the graduate student clinician gets the top copy (immediately following the session), and I keep the carbon version.   I do have a rating scale at the bottom and I need to track down where specifically I found these categories — they are not mine, but I am using them for now as a means of gauging my presence in the clinical process, how much influence or instruction was imparted for those areas.  I’m not convinced this is meaningful for me, but I’m giving it a try for a bit longer.

Although their particular tool didn’t quite work for me (see also, “data collection is very personal…”), I hope that it reflects the findings discussed in Wilson, D. & Emm, M. (April 2013).  Opportunity for Effective Feedback:  A Supervision Tool.  Perspectives on Administration and Supervision:  28-34.

Specifically, in brief:

(1) “Tracy, Van Dusen, and Robinson (1987) state that effective feedback needs to provide the recipient with knowledge and rationales for improvement.” (p. 28)
(2) balance with positive reinforcement and corrective feedback; “Supervisors are encouraged to be respectful, goal-based, non-judgmental, specific, and focused on behaviors, and to give the right amount of feedback and suggestions for improvement.” (p. 28)
(3) Be mindful of types of feedback:  vague-positive, specific-positive, vague-corrective, specific-corrective.  This is also consistent with McCrea & Brasseur, who cautioned about overuse of “…evaluative statements reflecting their perceptions of the appropriateness of the behaviors in the treatment or assessment session as they view it; for example, “Your directions were too difficult for the client” (p. 167).  They caution that although these kinds of statements may be needed at times, they should be associated with immediate plans for learning more effective strategies and self-evaluation.  That “it is these active, direct behaviors of the supervisor that do not encourage, in fact probably discourage, self-analysis and creative thinking on the part of supervises.” (p. 168).

(4) Finally, for Wilson, D. & Emm, M. (April 2013):  “The observation record was a single sheet form containing identifying information, a list of possible focus areas, and narrative space for both positive and corrective feedback comments.” (p. 29)

Over time, I have modified the forms I use based on feedback from the students, my experience with using it, and trying to apply principles of andragogy (how adults learn), as described in  Gordon-Pershey, M. & Walden, P. (April 2013).  Supervisor and Supervisee Perceptions of an Adult Learning Model of Graduate Student Supervision.  Perspectives on Administration and Supervision:  12-27.  Specifically, that my feedback is hopefully consistent with:  “The hallmarks of reflective practice are conscious thought about clinical situations, critical evaluation of possible solutions in clinical situations, and self-reflective assessment of the outcomes of one’s clinical actions (Jarvis, 1987; Schon, 1990; Walden, 2011).” (p. 13)

These are all under Resources (“m4ter14ls”), and should be findable with the search term “SOAP” but the one for intervention is not coming up for me unless I use the search term “observing”.  I don’t know why that is.  There is a series of supervision SOAP notes for assessments which follow the different phases of the model we use for AAC assessments at PSU.

End blip.

09.21.13 — Talking about positive reinforcement, instructive feedback, and creative ways to praise

I think most of the students I have worked with for clinical practicum are on board with the value of positive reinforcement (and appreciate receiving it themselves), but I have some particular opinions on what I consider to be truly helpful in promoting skill learning and productive behavior. For one, I’m not a huge fan of generic and/or constant praise — to me, it seems insincere and weird to say things like, “Nice looking” or “Good talking.” There are certainly situations where a clinician needs to focus on whatever positives are available to help promote a better rapport/atmosphere at that time, but I start to get worried if I hear a regular stream of this kind of praise without actually examining if it is in fact (a) true, (b) actually a distraction from learning or adjusting the teaching/situation to get more authentic intervention, or even (c) helpful. Sometimes it feels a lot to me like chatter…just more noise the learner has to navigate through to figure out why they are there. If this is really the best/only praise a clinician can offer, it is time to seriously look at whether or not the goals are appropriate, the teaching has been presented to be well matched to the student need, and the environment has been structured to promote focus and success, etc.

The following is a set of information I organized to emphasize my own belief in the value of instructive feedback — anchoring the praise with the skill and/or why the skill is relevant. With instructive feedback, positive reinforcement can include re-stating the rationale (“You are working hard to learn to read!”), and/or the strategy (“Wow! You looked at each letter and thought of the sound it makes.”). That’s not to say these features would need to be present every trial, but they do keep the presence of why they are working with you, and what they do which promotes their success. This distinguishes what we as SLPs do as unique from praise they may receive elsewhere (it orients the individual to his/her communication or literacy), raises metacognitive awareness to promote self-monitoring, and provides the structure for corrective feedback in a non-threatening way. That is, if the client gets something wrong, the feedback is provided in the same way: “Remember, look at each letter and think about the sound it makes.” is, in my opinion, infinitely more helpful and less threatening than, “No. Try again.”

I would also say that it’s helpful, whenever possible, to keep it sincere and fun.

This is an example of a simple way to have a small gesture of phonological awareness is to match a praise comment with the initial phoneme associated in the task. For example, if a student found the letter /i/ in a letter-sound-correspondence (LSC) activity on the keyboard, to say, “Incredible!” The following try to keep with that principle, but I wouldn’t consider it exhaustive or perfect. In any case, strategies like these should be what you are personally comfortable with.

Absolutely, Amazing,
Beautiful
Cool
Dynamite
Excellent
Fantastic
Great, good (for you), gorgeous
Hooray, holy cow
Incredible!
Joy! Jinkies! just like that,

Kiss your brain!, keep it up!

Lovely, Lookin’ good!

Magnificent, Marvelous
Neat, Nice one/job
Outstanding, Oh my gosh
Perfect, pat yourself on the back, powerful
Quite right
Right on!, Rockin’
Super, sweet, *
Terrific
Up, up and away — you are taking off!
Very nice, va-va-voom!
Wow, woah!, woo-hoo!, Working hard!
X-ray your brain: I need to look at all that learning!
Yahoo!, yipee, yay!, yes!, you got it!
Zoom! Zowie!

You can find more (with accompanying ‘cheers’ at http://www.drjean.org/html/monthly_act/act_2004/06_june/06_2004a.html — click on the links at the top or bottom of the page that say “Cards 4-6” etc.

*One cautionary note: Please avoid using the word “smart” with kids and parents. This word is remarkably entangled with emotions – not unlike “stupid” or “dumb.” Research has shown that kids who are praised for being smart are less likely to take learning risks than kids who are praised for their effort (Dweck, 2007). So if a situation is presented where they are not confident they can keep the “smart” label, they will withdraw and not try at all because they do not want to appear “not-smart.” Kids who were praised for perseverance and effort (regardless of accuracy), were more willing to try and/or ask questions even when they weren’t sure they knew the answer.