role play graphic
Assessment, Collaboration, Pedagogy, Teaching Advice

Role Play as a Learning Tool

[et_pb_section bb_built=”1″][et_pb_row][et_pb_column type=”4_4″][et_pb_text _builder_version=”3.21.4″ z_index_tablet=”500″]

I was inspired by a Faculty Focus article when creating this newsletter.  This article spoke about adding role playing activities to your teaching to act as practicum experience but I think you can take it further.  The article states, “Role play can be implemented by college instructors and professors as an additional way to increase practice of skills within the confines of a college classroom among peers.”  Staying within these constraints, this strategy can be used in almost any discipline.  It’s just a matter of creating a scenario or roles/characters and having your students submerge themselves into the activity.  Hopefully, during this submersion, they will get to experience a practical skill or what it’s like to be in a specific scenario.

[/et_pb_text][et_pb_text _builder_version=”3.21.4″ z_index_tablet=”500″]

HERE’S HOW IT WORKS:

[/et_pb_text][et_pb_text _builder_version=”3.21.4″ custom_padding=”10px|10px|10px|10px” border_radii=”on|5px|5px|5px|5px” border_width_all=”2px” box_shadow_style=”preset2″ z_index_tablet=”500″]

  1. Create your outcomes.  Write down the outcomes you wish to happen as a result of the activity.
  2. Write up debrief questions that will let you know if you met your outcomes.
  3. Create a scenario.  Examples include: “You are in a pub in Nazi Germany…,” “It’s Parent-Teacher Conference day…,” “You are a member of FEMA’s first responders after a hurricane disaster…,” “You are on a team of researchers who will look at the effects of exercise on…”
  4. Create the roles/characters.  On notecards, write up the different roles that the students will take on.  From the examples above they could by “SS, Jew, Woman, etc.,” “parents of a student with a learning disability, parent of an unengaged student, etc.,”
  5. During class, post the scenario on the screen.  Give each group a stack of role notecards.  The students are then given a minute to get familiar with their roles and jump into the scenario.
  6. Debrief. Set a specific time for the activity to take place then debrief with all the student groups.

[/et_pb_text][et_pb_text _builder_version=”3.21.4″ z_index_tablet=”500″]

Uses:

Just a few of the possible role playing opportunities are:

[/et_pb_text][/et_pb_column][/et_pb_row][et_pb_row _builder_version=”3.21.4″][et_pb_column type=”1_2″][et_pb_text _builder_version=”3.21.4″ z_index_tablet=”500″]

  • Classroom management,
  • Parent teacher conferences,
  • Student teacher conferences,
  • Mentoring,
  • Historical scenarios,
  • Exercise Science testing,
  • Disease containment,
  • Natural disaster recovery,
  • Interview with and Nutritional plan creation for a patient,
  • Interview with and Exercise plan creation for a patient.

These are only a few.  Let your imagination run wild.

[/et_pb_text][/et_pb_column][et_pb_column type=”1_2″][et_pb_image _builder_version=”3.21.4″ src=”https://blogs.charleston.edu/tlt/files/2019/08/role-play-1.jpg” z_index_tablet=”500″ /][/et_pb_column][/et_pb_row][/et_pb_section]

decorative
Assessment, Best Practices, Pedagogy

Top 5 Tips To Get Students To Read Your Feedback

[et_pb_section bb_built=”1″][et_pb_row][et_pb_column type=”4_4″][et_pb_text _builder_version=”3.21.4″ z_index_tablet=”500″]

WHY WON’T STUDENTS READ/USE THE FEEDBACK I GIVE?

A complaint I hear over and over again from faculty is “What can I do to make my students read and use the feedback I give them?”  Faculty and teachers spend so much time giving detailed feedback and notes on assignments only to find the returned work in the trash.  That’s because, to the students, the assignment is OVER.  They look at the assignment long enough to find out their grade then they are done.  To them, that assignment (and learning) is over and in the can, along with the graded assessment.

 

[/et_pb_text][et_pb_text _builder_version=”3.21.4″ header_text_shadow_style=”preset4″ header_text_shadow_horizontal_length=”0.18em” z_index_tablet=”500″ text_font_size=”41px” text_text_shadow_style=”preset4″ text_font=”Black Ops One||||||||” text_text_color=”#7cda24″]

SO WHAT CAN YOU DO?

[/et_pb_text][et_pb_text _builder_version=”3.21.4″ custom_padding=”10px|10px|10px|10px” border_radii=”on|5px|5px|5px|5px” border_width_all=”2px” border_color_all=”rgba(7,187,242,0.96)” box_shadow_style=”preset2″ z_index_tablet=”500″]

The most important thing is to determine WHY you are giving feedback.  

Is it to justify the grade you’ve given or to cover your hide (grade-centered approach) or is for the students to improve and learn (learning-centered approach).  Both are fine, but Grade-centered normally focuses retrospectively on the errors made and what was wrong with the assessment and therefore, a student is never going to read that or take anything away from that type of feedback.  Learning-centered feedback focuses on suggestions for future practice.  The other issue is that, even if we are giving future practice comments on a completed assignment, many times the student won’t need to apply that feedback until the next assessment which can be some time in the future.  By that time the feedback is out of the student’s mind.

Learning-centered feedback (formative) should be given DURING the assessment and the students should use it to BETTER their final assessment (summative).  During this process, the intense reading and markup is done at the formative stage.  For the final assessment, you, as the instructor, just read it and grade it.

[/et_pb_text][et_pb_text _builder_version=”3.21.4″ z_index_tablet=”500″]

In my research on this subject everyone seems to say the same thing over and over again.  The #1 way to get students to read their feedback is to

DELAY THE GRADE!

Whether is a draft or a final assignment, when you return them only give the feedback.  Don’t include a rubric or a checklist or grades.  Students are more likely to read the comments to try to discern their grade.  You will then release the grade at a later time.

This is only one method below are more you can try.

[/et_pb_text][et_pb_text _builder_version=”3.21.4″ custom_padding=”10px|10px|10px|10px” border_radii=”on|5px|5px|5px|5px” border_width_all=”2px” border_color_all=”rgba(7,187,242,0.96)” box_shadow_style=”preset2″ z_index_tablet=”500″]

Top 5 Strategies to Get Students to Read and Use Feedback

  1. Don’t provide a grade with your feedback.
    No rubrics, no checklists, no grades.  Only you’re commented feedback.   
     
  2. Explain the purpose of the feedback 
    Why do you give feedback and what is your expectation of them to read and use the feedback?  When they know why or how you expect them to use it they are more likely to read it.
     
  3. Build a connection from the feedback to the revision.
    Have the students read the feedback and make three observations and two questions based on your feedback.  You could also have them make the changes in the final assessment then write a brief paper of how using the feedback improved the final assessment or what they changed as a result of the feedback and what they learned from those changes.  You are basically requiring them to read and use the feedback as part of the process.
     
  4. Use a mix of feedback styles
    Try different feedback forms on different assignments such as text, audio, video, in person, interviews.  Mixing it up keeps the students on their toes.
     
  5. Prevent feedback overload.
    Don’t mark up every tiny thing that is wrong with a paper.  Focus on the most important things you want your students to glean and improve from your feedback (2-3 things) and mark only those.  Try the Sandwich technique: compliment; changes; compliment.

    If you’re giving multiple assignments where feedback will be given then consider scaffolding your method.  The first assignment, give the feedback but teach your students how to revise their work based on that feedback.  Then move to a place where you are leaving them on their own to fix it.  This is particularly important for younger students and college freshmen.

[/et_pb_text][/et_pb_column][/et_pb_row][/et_pb_section]

maze
Pedagogy, Research

Creating Personal Learning Paths with Symbaloo

In the early 2000s a popular lesson type was a webquest.  The goal of this was to create an inquiry-oriented lesson where all of the information comes from web-based resources.  This isn’t a newsletter on how to create a webquest.  There is tons of information on the web on how to do this, including an entire site dedicated to it at webquest.org.  This newsletter is about how to use Symbaloo to create these in a fast and easy way that includes student tracking.

Symbaloo is an amazing graphical bookmarking and web organization tool. I use it everyday and I love it.  Recently, they’ve expanded their offerings to add “Learning Paths.”  These paths take the user through the web resources in a sequence.  You can add almost any web resource as well as little quizzes and questions that can divert the uses onto a new path.  These are called branches.  This allows you to give students different content based on their knowledge but it also allows the user to choose the path in which they are most interested.

There is also a marketplace of Symbaloo Learning Paths created by other teachers that you can use for free!

HERE’S HOW IT WORKS

Start by going to http://learningpaths.symbaloo.com/

  • As a student, you type in a Session Code to begin
  • As an instructor, you log in after creating a free account

1 – Click Create a learning path
2 – Create a web tile (this can be audio, video, text, Google Drive files, etc.)
—- Title it with the Lesson title
—- Choose a web resource (this will include Google Drive files and sites)
—- Type in instructions or outcomes for that article or video
—- Click Save
3 – Create a new tile
—- Click one of the plus signs to add more resources or to put in a branch
4 – Create a quiz or question title
—- Click Create My Own Resource
—- Type in a title, ex. Quiz
—- Add all of the items indicated on the form

When you’re finished you can click the Play icon to preview it yourself
Then share it with your students

Screenshot of the Sharing Screen that is also pointing to the Reports icon in the upper right corner

Monitor your students’ progress in real-time.

SEE IT IN ACTION

Want to Learn More? Check out the Learning Paths Tutorials

Become a teaching superhero
Assessment, Best Practices, Collaboration, Distance Ed, Pedagogy

BECOME A TEACHING SUPERHERO WITH TLThd’S CLASS OBSERVATIONS

[et_pb_section bb_built=”1″][et_pb_row][et_pb_column type=”4_4″][et_pb_text _builder_version=”3.21.4″ z_index_tablet=”500″]

TLThd is launching a new service to all instructors at CofC…CLASS OBSERVATIONS

[/et_pb_text][/et_pb_column][/et_pb_row][et_pb_row][et_pb_column type=”2_3″][et_pb_text _builder_version=”3.21.4″ z_index_tablet=”500″]

These observations can be for your face-to-face or your online classes.  An instructional technologist will come to your class (or review your OAKS online class) and observe you and your students.  At the end of the observation we will provide you with a full report of everything that occurred during the class.  You can then use that information however you see fit! The important thing to remember is that this is just for you, no one else. We don’t mention it to your Chairs, Dean, or Colleagues nor will we conduct an observation at the request of anyone else. The only purpose of the observation is to give you the data to allow you to reflect on your teaching and your student interaction.

Currently we are offering In-class, Videotaped, and Student Focus Group observations for the face-to-face classes and a Module Review in the online classes.  We hope to expand our online offerings in December. 

[/et_pb_text][/et_pb_column][et_pb_column type=”1_3″][et_pb_image _builder_version=”3.21.4″ src=”https://blogs.charleston.edu/tlt/files/2019/08/large-Teaching-Observations-Logo-White-Square.png” z_index_tablet=”500″ /][/et_pb_column][/et_pb_row][et_pb_row][et_pb_column type=”4_4″][et_pb_button _builder_version=”3.21.4″ button_text=”Learn More and Sign Up for an Observation” button_url=”https://tlt.cofc.edu/teaching-and-course-observations/” z_index_tablet=”500″ /][/et_pb_column][/et_pb_row][/et_pb_section]

PLC Applications are now open
Collaboration, Pedagogy

Professional Learning Club Applications are OPEN!

The Professional Learning Club (PLC) applications are now open and will close on July 15th so APPLY TODAY!

A Professional Learning Club is a group of faculty that meets to collaboratively reflect on and improve their teaching practices. These learning clubs will consist of 4-6 faculty who will take the year to explore, implement, and reflect on specific, empirically-grounded instructional strategies.

The next round of PLCs take place during the 2019-2020 academic yearThe clubs will meet for the first time in late August and then every two weeks after that, throughout the entire academic year.  Applications close July 15 so don’t delay!

  • Combining Science, Technology, English, Art and Math
  • Flip the classroom with highly effective problem based learning
  • Process Oriented Guided Inquiry (POGIL)
  • Service Learning
  • Practicing the Science of Successful Learning
  • Focus on Assessment
  • Best Practices Through Teaching Observation

For a full description of the topics visit PLC Topic Descriptions (2019-2020)

 

APPLY FOR A 2019-20 PLC

Teaching team-based learning in large classrooms. TLThd Faculty Focus
Collaboration, Innovative Instruction, Pedagogy

Using Team-Based Learning in a Large, Fixed Seating Classroom

Do you teach in a large, fixed-seating classroom and think you can’t do group work successfully? Well think again!

Team-based Learning, or TBL, is a teaching strategy that is an “evidence based collaborative learning … strategy designed around units of instruction, known as “modules,” that are taught in a three-step cycle: preparation, in-class readiness assurance testing, and application-focused exercise.” (1)  It shares many of the same structures you see in a flipped classroom, problem-based learning, and active learning but the process is what sets it apart from these other strategies.

Graphic depicting the three step process

The Process:

  1. Pre-class preparation designed to give the students the appropriate background and understanding of the concept
  2. In-class readiness assurance testing as an individual and then in their group. This ensures that the student not only did the pre-class prep but understands it as well. Competing the assessment as a group allows an additional opportunity for misunderstandings and knowledge gaps to be rectified prior to the group exercise
  3. In-class application focused exercise is designed to apply and extend the knowledge from the pre-class prep material. It’s normally case or problem-based and the team must arrive at consensus on the best solution. This then leads to a class discussion to explore the topic between groups.

While this strategy works in many different disciplines, it’s perfect for science, exercise science and public health classes.  The problem is these are usually some of our largest classes and faculty worry that they can’t successfully conduct this type of team work in a large, fixed seating classroom.  The folks at the Faculty Innovation Center at The University of Texas at Austin would disagree.  Watch this video on how they have been successful using TBL in large classrooms

Team-Based Learning from Faculty Innovation Center on Vimeo.

Want to know more about TBL?  Visit the resources below.

1 Team-based Learning Collaborative: http://www.teambasedlearning.org/definition/

2 Team-based learning in large enrollment classes by Jonathan D. Kibble, Christine Bellew, Abdo Asmar, and Lisa Barkley  03 OCT 2016 https://physiology.org/doi/full/10.1152/advan.00095.2016

Image of students sitting around a table talking with the words Structured In-Class Discussion Formats Small Teaching Tip #16
Best Practices, discussion, Pedagogy, Small Teaching Tip, Teaching Advice

Small Teaching Tip #16: Structured Discussion Formats

“I’m tired of looking out at a sea of blank faces.”

“There’s nothing but crickets when I try to get a discussion going.”

“It’s like talking to a brick wall!”

How many times have you lamented the quality of discussions in your classes? Facilitating engaging conversations is one of the most challenging aspects of teaching.  Even the most brilliant lecturer can be stymied by an unresponsive class.

Often, class discussions fall flat because we fail to remember that students are academic novices. They are not subject matter experts and they are unfamiliar with academic discourse. When it comes to in-class discussions, students benefit from clearly stated instructions, explicit expectations, and structure. Here are a few popular structured discussion formats to try:

Think-pair-share
After lecturing, ask students to jot down their responses to a prompt you provide on scrap pieces of paper or in a Google Doc. After a few minutes, ask them to turn to their neighbors and share their ideas. Finally, bring the entire class together and have the pairs report what they discussed and use what arises as a jumping off point for an entire class discussion. This simple exercise gives students the chance to think and talk through their ideas before being put “on the spot” in front of the entire group. This is essential for students who struggle to participate in discussions because of introversion, social anxiety, or learning disabilities.

Fishbowl
In this exercise, instructors seat students in two concentric circles. The inner group of students discuss a topic while the outer group listens and take notes. Then, the groups switch roles and the outer group summarizes the inner group’s ideas and builds on them. This discussion format helps students practice active listening and argumentation. Another version of the fishbowl is problem-based, in which the central group is charged with solving a problem and the outer group listens and acts as researchers and advisors.

Gallery walk
Place large sheets of paper around the room each with a different prompt (e.g. question, problem, brainstorming task). Assign a few students to each sheet of paper.  Give the groups 5 minutes to respond to the prompt. The groups then rotate to a new sheet and build upon the previous group’s comments. After all the groups visit each sheet, everyone walks around the “gallery” to read all the responses. This can then serve as a springboard for a larger class discussion about conclusions and questions that arose.

Stand where you stand
This exercise works for discussions about questions that don’t have a single answer and, thus, can be debated. Assign a different theoretical or analytical perspective to each corner of the classroom. Ask students to stand in the corner of the room that represents their position on the issue.  As a small group, they should formulate evidence-based arguments to support their position that they think will convince others to agree with them. Each group then presents their arguments and students are given the opportunity to move to a different corner if they were convinced to change their mind. Students can articulate why the arguments did or did not change their opinion on the topic, which can lead to a discussion of effective argumentation and persuasion.

Jigsaw
This exercise is a great use of peer teaching. In preparation for class, each member of a small group completes a different reading on a particular topic (that they find themselves or that the instructor assigns). In class, each student shares a summary of their reading and his/her analysis with their team. During this “reporting out” and subsequent discussion, students become budding “experts” on a specific topic. After a period of time, each student then moves to a new group to teach their speciality to their classmates.

Instructors can also incorporate other sources of knowledge, such as student’s own experiences. For example, students could analyze how a recent experience aligns with or deviates from the theoretical perspective they examined or the results of the research they read.  Students could also complete a “webquest” by seeking examples online (e.g. memes, cartoons, quotes, video clips) and using them to supplement their small group discussion.

Collaborative autoethnography
Based on the qualitative research method designed by Heewon Chang, this exercise privileges students’ lived experiences and encourages significant self-reflection. Students use both their own stories and scholarly sources to analyze a larger societal context. This exercise could take multiple class periods, or could even become the overarching structure of a course. It involves 6 stages:

  1. Students collectively explore a particular phenomenon, problem, or question as a small research team. Based on research and their personal stories related to the phenomenon, students generate an initial set of questions to explore further.
  2. Students then individually reflect on these questions and write their own responses.
  3. They then share their reflections with their team, which collectively identifies commonalities, differences, and remaining questions.
  4. Those themes and questions are discussed in class, benefiting from the insights of classmates and instructor. What arises from those conversations becomes the next set of prompts for further research by the team.  
  5. This cycle of researching, reflecting, and sharing is repeated until no new discoveries occur (or the time allotted for the exercise runs out)
  6. The team then writes about their overall findings, often building models to explain the phenomenon explored.

These ideas are great for face-to-face classes and, with the help of technology and some creative thinking, a few could also be adapted for online courses. I also recommend the book Creating Engaging Discussions: Strategies for Avoiding Crickets in Any Size Classroom and Online by Jennifer Herman and Linda Nilson. And for more help improving discussions, check out these posts:

Do you have other suggestions for facilitating engaging class discussions?  Please share!

Image of a young person hidden behind a large stack of books with the heading What I Learned from Make it Stick. Practical applications from the science of learning.
Make It Stick Monday, Pedagogy, Small Teaching Tip, Teaching Advice

What I Learned from “Make it Stick”

Much of our understanding about how we learn is flawed.  The typical advice given to students is single-minded, focused repetition, reflecting the belief that if we expose ourselves to something enough, we can burn it into memory.  This is called “massed practice” by cognitive scientists and “cramming” by students. Given this advice, it should come as no surprise that one of college students’ most commonly reported study habits is to re-read their textbook or their notes.  Unfortunately, this and other forms of massed practice are some of the least-effective methods of learning!  As Brown, Roediger, and McDaniel write in their book Make it Stick: The Science of Successful Learning:

“The fact that you can repeat the phrases in a text or your lecture notes is no indication that you understand the significance of the precepts they describe, their application, or how they relate to what you already know about the subject” (p. 16).

However, despite the research demonstrating that simple repetition does not lead to long-term retention, we rely on massed practice because it can produce quick results. But it’s an illusion of mastery — the retention of information is short-lived and does not encourage the application of knowledge to novel situations.  Most students don’t know this, and many aren’t bothered by it as long as they can pass the exam. So it’s our responsibility to help students see the benefits of using the following research-supported techniques to improve their learning.

Spaced Practice

When faced with an exam, many students engage in cramming or pull “all-nighters.” While this practice may help some students pass, the information is quickly forgotten. In contrast, spaced practice divides studying into installments, allowing time to elapse in between.  One of the best ways for students to employ this technique is to study their notes and quiz themselves each week (not after every class or waiting until midterm time).  Why does this work? Embedding new information into long-term memory requires a process of consolidation, during which neural connections are progressively strengthened and new information is linked to prior knowledge.  Research indicates that allowing yourself a little time time “forget” is a good thing because it then requires extra effort to retrieve the piece of information from memory. And the more often you retrieve that information, the stronger those neural connections become.

Interleaved Practice

The typical way we teach is to cover one concept until most of the students have learned it, then move on to the next concept.  Consider the typical textbook — it is organized around massed practice, with each self-contained chapter dedicated to one concept.  But interleaved practice means you shift back and forth between different concepts or skills. For example, one week you learn how to find the volume of a spheroid; then the next week, you learn how to find the volume of a cone.  The week after that, you move onto another concept, eventually coming back to the spheroid.

Students may become frustrated by this alternation because they leave a concept before they’ve fully mastered it, only to return to it later.  Yes, it can feel messy; but the rewards are substantial. For example, one study found that while massed practice resulted in students scoring higher on tests taken immediately after learning a concept, interleaved practice resulted in significantly better performance weeks later, indicating long-term retention.

Varied Practice

Varied practice means employing multiple methods or approaches. For example, a baseball player uses varied practice to hone their batting skills by asking for random pitches, thus improving their ability to identify and respond to each pitch.  This is opposed to asking for 15 fastballs, then 15 curveballs, then 15 change-ups, which would be a form of massed practice. Neuroimaging studies suggest that different types of practice engage different parts of the brain and this encourages greater consolidation.  By using a variety of techniques, you are broadening your understanding of the concepts and the relationships between them.  For example, rather than self-quizzing yourself with flashcards that are always in the same order, shuffle them each time and then ask a friend to quiz you.

Although the research strongly supports spaced, interleaved, and varied practice, it’s important to recognize that they require significantly more effort and feel slower.  This can be frustrating to students and they may be tempted to go back to their “old ways” of massed practice. For example, research has demonstrated that even when participants have performed superiorly using spaced, interleaved, and varied methods, they still believe they learn better using massed practice!

So it’s important for teachers, coaches, and parents to share the research with students and spend time explaining the benefits of these approaches.  In Making it Stick, Brown, Roediger, and McDaniel suggest emphasizing the following fundamentals when talking with students about learning:

  • Some struggle is okay.  When learning requires effort, you’re actually learning more.
  • In contrast, when learning seems easy, it’s often superficial and soon forgotten.
  • Our intellectual abilities are not solely dependent on our genes.  When learning is effortful, it actually changes the brain, making new neural connections and increasing intellectual ability.
  • You learn better when you struggle a bit with a new problem, trying to solve it on your own before being shown the answer.
  • Failures are an essential part of learning.  It is through our mistakes and setbacks that we discover essential information about the concepts and ourselves, which help us to master the material.

Instructors can stress these fundamentals in their classes by incorporating “desirable difficulties.”  When learning is easy, students don’t retain information and are less able to apply that information to novel situations.  But designing your classes to be “trial by fire” swings too far in the other direction. Making a few small changes to your teaching can help you find that desirable midpoint, where greater effort leads to greater learning.  Give these strategies a try:

Incorporate frequent quizzing.  This requires students to continuously practice memory retrieval, which encourages greater consolidation, known as the “testing effect.”  But before you start quizzing your students, there are a few important stipulations.  First, make the quizzes count towards the course grade. While we would love our students to complete quizzes simply for the joy of learning, most require extra incentive.  That being said, the quizzes should be relatively low-stakes.  The purpose of these quizzes is to practice retrieval, not to have an anxiety attack each week.  Keep in mind that one need not use quizzes to achieve these goals.  Writing exercises, problem sets, and other forms of assessment can also be used.

Second, avoid the pop quiz.  Pop quizzes are only effective at intimidating students into coming to class.  For most students, they do not encourage actual learning. But quizzes that students know about in advance do.  Rest assured, these assessments do not need to be lengthy or require labor-intensive grading (there are countless instructional technologies that can help facilitate this process, including OAKS).  

Third, design quizzes to be at least partially cumulative.  This requires students to reach back to concepts covered earlier in the term, developing deeper understanding and more complex mental models.  Remember: greater retrieval efforts equal greater learning.

Finally, occasionally assign quizzes that students complete before they learn new material.  This may seem strange, but a pre-quiz encourages students to consult their previous knowledge to help them grapple with new ideas.

Encourage memory retrieval during class.  You don’t need to use daily or weekly quizzes to encourage memory retrieval and consolidation.  During lecture, every few minutes, ask students a question that requires them to connect the dots between a new concept and a previously learned one.  Their first instinct will be to consult their notes or flip through their textbook, but tell them to resist this urge and take a moment to think. It’s important that you actually give your students enough time to think and also ask them to write down their thoughts.  Does this mean you won’t cover the same amount of material in a single class period? Most likely. Does this mean you’ll have to prepare thoughtful, purposeful questions in advance? Yes. But you’ll be encouraging your students to actually learn, rather than sit passively like zombies. I think that’s a worthwhile exchange.

Another, more active, strategy is to ask a question you know students struggle with and often come up with competing answers.  Ask volunteers to write those answers on the board (maybe narrow them down to three options). Next, ask students to vote on the answer they think is correct by holding up that number of fingers.  Students then find someone who is holding up a different number of fingers and share how each arrived at their answers.  During that discussion, the students are encouraged to come to a consensus and be able to articulate why they think their answer is correct. This exercise encourages students to retrieve information learned from previous classes, practice metacognition, and engage in peer teaching.

Incorporate more metacognition activities.  Thinking about how we think is an essential component of learning.  Such reflection requires us to retrieve previous experiences and knowledge, connect them to new experiences, formulate alternative perspectives, and visualize outcomes.  All of these cognitive activities lead to stronger learning.  One simple way to incorporate metacognition into your classes is to ask students, after completing a major assignment, to write a paragraph about how they prepared and what they would do differently next time.  This process involves retrieval (What did I do? How did it work?) as well as generation (How could I do it better or differently next time?) and elaboration (How can I explain my thinking to another person?).

Provide practice tests.  Students can (and should) practice memory retrieval outside of class as well.  Self-testing is often disliked by students because it requires more effort than simply rereading the textbook or copying their notes over and over.  But the greater the effort, the deeper the learning. Encourage students to use the Leitner flashcard system, participate in a study group (that actually studies), and provide students with practice tests.  If you provide corrective feedback on these practice tests, even better. This allows students to identify gaps in their learning and prevents them from retaining incorrect information.  Practice tests are also a useful teaching tool because the results enable you to identify areas of struggle or misunderstanding.

I hope this post has illuminated the research on how we learn best and has provided at least one strategy that you can incorporate into your classes to achieve that “desirable difficulty” and improve student learning.  You don’t need to completely restructure your entire course to incorporate this information. As James Lang argues in his book Small Teaching, fundamental pedagogical improvement is possible through incremental change.

References

Brown, P. C., Roediger, H. L., & McDaniel, M. A. (2014). Make it stick: The science of successful learning. Cambridge, MA: The Belknap Press of Harvard University Press.

Butler, A. C., & Roediger, H. L. (2008). Feedback enhances the positive effects and reduces the negative effects of multiple-choice testing. Memory & Cognition, 36, 604-616.

Callender, A. A., & McDaniel, M. A. (2009). The limited benefits of rereading educational texts. Contemporary Educational Psychology, 34, 40-41.

Cepeda, N. J., Pashler, H., Vul, E., Wixted, J. T., & Rohrer, D. (2006). Distributed practice in verbal recall tests: A review and quantitative synthesis. Psychological Bulletin, 132, 354-380.

Gilovich, T. (1991). How we know what isn’t so: The fallibility of human reason in everyday life. New York: Free Press.

Goode, M. K., Geraci, L., & Roediger, H. L. (2008). Superiority of variable to repeated practice in transfer on anagram solution. Psychonomic Bulletin & Review, 15, 662-666.

Leeming, F. C. (2002). The exam-a-day procedure improves performance in psychology classes. Teaching of Psychology, 29, 210-212.

Lyle, K. B., & Crawford, N. A. (2011). Retrieving essential material at the end of lectures improves performance on statistics exams. Teaching of Psychology, 38, 94-97.

McCabe, J. (2010).  Metacognitive awareness of learning strategies in undergraduates. Memory & Cognition, 39, 462-476.

Richland, L. E., Kornell, N., & Kao, L. S. (2009). The pretesting effect: Do unsuccessful retrieval attempts enhance learning? Journal of Experimental Psychology: Applied, 15, 243-257.

Roediger, H. L., Agarwal, P. K., McDaniel, M. A., & McDermott, K. (2011). Test-enhanced learning in the classroom: Long-term improvements from quizzing. Journal of Experimental Psychology: Applied, 17, 382-395.

Roediger, H. L., & Karpicke, J. D. (2006). The power of testing memory: Basic research and implications for educational practice. Perspectives on Psychological Science, 1, 181-210.

Rohrer, D., & Taylor, K. (2007).  The shuffling of mathematics problems improves learning. Instructional Science, 35, 481-498.

 

Assessment, Make It Stick Monday, Pedagogy, TLTCon

Killing our Darlings

The following is the third post on the book Make It Stick by Brown, Roediger, and McDaniel.  Henry L. Roediger, III will be the keynote speaker at this year’s TLTCon, May 16-17, 2019, on the campus of the College of Charleston.  Attendees will receive a free copy of Make It Stick at a registration event on March 14, 2019 to promote Roediger’s visit and the learning experience. Click the hyperlinks to read blog posts on “effortful retrieval” and “varied practice” as learning strategies.

“In writing, you must kill all your darlings.”  That’s advice from William Faulkner where he is encouraging writers not to shy from deleting favorite but useless passages from manuscripts.  It may be helpful advice for teachers, too.   Few theories are as dear as learning styles theory (LST), which urges teachers to use a variety of presentation methods to meet preferred modes of learning.  If you believe the grammar of chapter six’s title “Get beyond Learning Styles” expresses the writers’ true feelings about LST, you’re correct.  Move past it.  Get over it.  Research suggests the theory is overrated at best and dispiriting at worst.

We shouldn’t be surprised at their argument, however, given LST’s “perverse effect” (148) of subordinating hard work to style preference.  Brown, Roediger, and McDaniel have made it abundantly clear that effort is key to learning.  That’s the one note they’ve been blowing all along. The sooner we jettison “easy learning is the best learning” the better.

That said, we should consider whether a chapter debunking learning style theory is nothing short of a “Get out of jail free” card for us instructors—i.e., we don’t have to worry about how we teach since learning is really up to the learner.  Such is not the case.  In a previous blog on “effortful retrieval” (ET) I highlighted the limitations of “dipstick testing”—i.e., testing that measures a student’s short-term memory.  These tests can also be called “static testing” because they measure a student’s learning at a specific time in the same way that a dipstick tells us where the oil level is while we’re at the BP on Highway 17 at 3:15 pm on Monday, November 26, 2018.  The information is helpful for the moment but could quickly become irrelevant if an engine valve is going out or the oil plug is faulty.  In short, there are more precise measurements to take if we really want to know how the Honda Accord is running.  Enter dynamic testing, a term we could have predicted.  Dynamic testing aims at

determining the state of one’s expertise; refocusing learning on areas of low performance; follow-up testing to measure the improvement and to refocus learning so as to keep raising expertise.  Thus, a test may assess a weakness, but rather than assuming that the weakness indicates a fixed inability, you interpret it as a lack of skill or knowledge than can be remedied (151).

If this description rings with Carol Dweck’s concept of a growth mindset, you’re right, and there are at least two important takeaways for instructors.  The first is represented directly from the above excerpt: offer testing regularly for students to assess their weaknesses.  They can redouble efforts to improve weak areas and check for improvement with subsequent testing.  Certain course formats are more suited for this type of testing and follow-up testing, gaming being perhaps the best.

The second takeaway is more applicable to a wider variety of course designs: clearly identify what skill(s) we are testing.  As teachers, we can too easily be guilty of giving tests that simply cover content areas.  Ill-defined testing yields useless information.  Call it non-information or—better yet—Statistically Hopeless Ill-defined Testing.  Would any one of us be satisfied by going to the doctor and having to sit through a barrage of tests only to be told we’re “sick” at the end of the appointment?  “Sick with what?” we demand.  That diagnosis isn’t good enough for you or the doctor, and more testing will ensue.  The same holds true in cases where Professor Z announces, “There will be a quiz on chapter 10, pages 253-75.”  What’s being measured?  Students who earn a D on a quiz so poorly defined only know that they are below average in chapter 10, pages 253-75.  That’s not helpful, and it’s not education.

Providing our students with clearly articulated objectives prior to testing is essential to dynamic testing.  The clarity lets the students know exactly what skill they are being tested on.  As instructors, we should be able to finish this statement for every graded assignment: “This [test, quiz, writing assignment, etc.] measures the student’s ability to . . .”  (Nota bene: I recommend Bloom’s Revised Taxonomy Action Verbs to formulate and scale objectives.) The student should be able to verbalize the objective(s) in return.  If we can’t say precisely what we are testing, let’s save ourselves the irritation when grading and students the bewilderment of blindly reading over information in hopes of reaching unforeseen goals.  That’s a darling everyone can do without.

Team-based Learning: a quick guide to understanding
Assessment, Best Practices, Collaboration, Innovative Instruction, Pedagogy

Team-Based Learning Quick Guide

[et_pb_section bb_built=”1″][et_pb_row][et_pb_column type=”4_4″][et_pb_text _builder_version=”3.0.101″ background_layout=”light”]

What is Team-Based Learning?

“Team-Based Learning is an evidence-based collaborative learning teaching strategy designed around units of instruction, known as “modules,” that are taught in a three-step cycle: preparation, in-class readiness assurance testing, and application-focused exercise. A class typically includes one module.” 1

[/et_pb_text][/et_pb_column][/et_pb_row][et_pb_row][et_pb_column type=”1_2″][et_pb_text _builder_version=”3.0.101″ background_layout=”light” border_radii=”on|7px|7px|7px|7px” border_width_all=”2px” border_color_all=”#b72d21″ box_shadow_style=”preset3″ custom_padding=”15px|15px|15px|15px”]

Why incorporate Team-based Learning?

TBL covers all types of learning:

  • rote and concept learning tested by the individual assurance testing (iRAT)
  • collaborative learning when discussing and coming to consensus on the team readiness assurance test (gRAT/tRAT)
  • application and creative learning during the team case portion

In addition, it also encourages additional skills necessary to succeed in work/life today, such as:

  • problem-solving
  • teamwork
  • consensus
  • cooperation
  • leadership
  • listening skills
  • collaboration

 

[/et_pb_text][/et_pb_column][et_pb_column type=”1_2″][et_pb_text _builder_version=”3.0.101″ background_layout=”light” custom_padding=”15px|15px|15px|15px” border_radii=”on|7px|7px|7px|7px” border_width_all=”2px” border_color_all=”#b72d21″ box_shadow_style=”preset3″]

When should you incorporate Team-based Learning?

TBL is most successful when used on a consistent basis throughout the semester.  This is because the critical component to TBL is the ongoing, consistent team!  CIEL at Vancouver University states, “Groups are collections of individuals. Teams are groups who have developed a shared purpose and sense of collective responsibility. Groups evolve into teams when an instructor creates the proper conditions for effective collaboration.” 2  In order for these teams to gel and be successful they need to meet and work together on a regular basis otherwise, it’s just in class group work.

TBL can be used in any discipline so don’t shy away from the idea because you don’t immediately see how this will work for you.   A little web research will show you many case studies and problems that you can use to teach your concepts.  When choosing a case or problem remember, the teamwork is most effective “when used with assignments where students are asked to converge their diverse thinking in making a single, collective decision, much like a deliberative body.”2

[/et_pb_text][/et_pb_column][/et_pb_row][et_pb_row _builder_version=”3.0.101″][et_pb_column type=”1_3″][et_pb_image _builder_version=”3.0.101″ src=”https://blogs.charleston.edu/tlt/files/2018/10/workplace-1245776_640-24ojw3x.jpg” show_in_lightbox=”off” url_new_window=”off” use_overlay=”off” always_center_on_mobile=”on” force_fullwidth=”off” show_bottom_space=”on” /][/et_pb_column][et_pb_column type=”2_3″][et_pb_text _builder_version=”3.0.101″ background_layout=”light”]

Creating the Teams

The teams are the most important part of TBL.  Here are a few rules to follow when making the groups:

  1. never use student-selected teams
  2. create diverse teams (balanced intellectual and personality resources)
  3. make the selection process transparent
  4. 5-7 students per team
  5. decide what criteria are important to the groups in your class, as well as detrimental.  Ex. had previous courses in the program.
  6. prioritize your criteria (good and bad)
  7. call out the first criteria and allow the students to self-determine if they meet the criteria or not

Learn more about creating your teams at Team Formation for TBL.

[/et_pb_text][/et_pb_column][/et_pb_row][et_pb_row _builder_version=”3.0.101″ border_radii=”on|7px|7px|7px|7px” border_width_all=”2px” border_color_all=”#b72d21″ box_shadow_style=”preset3″ custom_padding=”15px|15px|15px|15px” background_color_gradient_start=”rgba(183,45,33,0.79)” background_color_gradient_end=”rgba(96,7,31,0.3)”][et_pb_column type=”2_3″][et_pb_text _builder_version=”3.0.101″ background_layout=”light”]

The Process

Taught in modules (usually one per class) in three-step cycles: preparation, in-class readiness assurance testing, and application focused exercise.  

  • Student Preparation:
    • must be done before the class – watching, reading, completing a worksheet, etc.
    • some give a reading/watching guide of things to look for and vocab to know.
  • In-class Readiness Assessment Test (RAT):

Step 1:  Students complete an individual RAT (5-20 questions) and submit it (this is not on the if-at) a.k.a. iRAT
These questions are based on the reading(s) and shouldn’t be an easy yes/no answer.  They are multiple choice but should require some thought and application.

Step 2: Students get into their teams and take the same RAT together (uses if-at) a.k.a. tRAT or gRAT
All answers must be agreed upon by the entire team so if there is a discrepancy, the students have to try to convince the other students on the team until they come to a consensus.  This is the same test they took earlier as an individual.  

Team reads the question and discusses it.
They then scratch off the answer they agree upon on the If-At scratch-off.
If it is correct they see a star and get full points.
If it is incorrect they have to discuss again and give it another go.
They continue to scratch answers until they receive the correct one.  Their points decrease every time they incorrectly scratch.

Step 3: Teams are given the opportunity to appeal answers they got incorrect.  This is a formal process in writing where they state their Argument then provide Evidence with page numbers from the readings that back their argument.

Step 4: Professor conducts a clarifying lecture of what the students didn’t grasp, based on the RAT scores.

  • Application Exercise:
    • students are given a problem or challenge and they must come to a team consensus to choose the “best” solution.  These problems do not have one right answer.
    • the teams discuss their findings and solution with the class.

The application-based exercises are very case-based and should include the following:

  • Significant: demonstrates a concepts usefulness.
  • Specific choice: based on course concepts.  Ex which procedure is BEST to use and why.
  • Same problem: all teams receive the same problem.
  • Simultaneous report to the class in a discussion.

Scaffolding

  • Instructors can give a worksheet to the teams that teach them to think through a problem by walking them through the process, how to dissect a statement and make an argument.

[/et_pb_text][/et_pb_column][et_pb_column type=”1_3″][et_pb_image _builder_version=”3.0.101″ src=”https://blogs.charleston.edu/tlt/files/2018/10/6145799166_c7a48edd6d_b-r9208i.jpg” show_in_lightbox=”off” url_new_window=”off” use_overlay=”off” always_center_on_mobile=”on” force_fullwidth=”off” show_bottom_space=”on” /][et_pb_image _builder_version=”3.0.101″ src=”https://blogs.charleston.edu/tlt/files/2018/10/images-1-1e5f8in.jpeg” show_in_lightbox=”off” url_new_window=”off” use_overlay=”off” always_center_on_mobile=”on” force_fullwidth=”off” show_bottom_space=”on” /][et_pb_image _builder_version=”3.0.101″ src=”https://blogs.charleston.edu/tlt/files/2018/10/IF-AT-card-2bmh677.jpg” show_in_lightbox=”off” url_new_window=”off” use_overlay=”off” always_center_on_mobile=”on” force_fullwidth=”off” show_bottom_space=”on” /][/et_pb_column][/et_pb_row][et_pb_row][et_pb_column type=”4_4″][et_pb_text _builder_version=”3.0.101″ background_layout=”light”]

Student to Student feedback at midterm and final

This feedback is critical to the success of a long-term team so these evaluations are an important part of the process.  The feedback should be positive and constructive.  Here are some ideas for questions:

  • One thing they appreciate about this team member
  • One thing they request of this team member
  • Distribute points among the members
    • Look at Preparation, Contribution, Gatekeeping, Flexibility
  • Also, include what they appreciate/request about the instructor

[/et_pb_text][et_pb_divider _builder_version=”3.0.101″ show_divider=”on” color=”#b72d21″ divider_weight=”2″ /][et_pb_text _builder_version=”3.17.2″]

Sample Case Repositories

Public Health

Exercise Science

PEHD

 

COFC ONLY – Does this seem at all interesting?  If so, contact me and I’ll give you the IF-AT scratch-off cards to use in your class.  They include instructions and a test-maker!  This offer is first come, first serve so don’t wait!  Email benignim@cofc.edu using your CofC email to let me know you want them.

[/et_pb_text][et_pb_divider _builder_version=”3.0.101″ show_divider=”on” color=”#b72d21″ divider_weight=”2″ /][et_pb_text _builder_version=”3.17.2″ background_layout=”light”]

Resources:

Team-Based Learning Collaborative

Team-Based Learning Video

Yale Center for Teaching and Learning: Team-based Learning

What is Team-Based Learning? from the Center for Innovation and Excellence in Learning

 

 

 

[/et_pb_text][/et_pb_column][/et_pb_row][/et_pb_section]