Teacher and students engaged in discussion
Assessment, Best Practices, Pedagogy, Teaching Advice

The Essential Role of Memory Retrieval in Student Learning

Too often, at professional development workshops or on education blogs, there’s an emphasis on designing courses that encourage students to reach the summit of Bloom’s pyramid.  There’s absolutely nothing inadvisable about helping students analyze, evaluate, and explore.  But in our race to the top, we often overlook the importance of remembering, understanding, and even applying (especially in our upper-level courses).  According to cognitive psychologists, this is a mistake that can have damaging effects on student learning.  Without foundational knowledge, it is difficult, if not impossible, for students to demonstrate higher order levels of thinking.  According to cognitive psychologist Daniel Willingham:

“Thinking well requires knowing facts, and that’s true not simply because you need something to think about. The very processes that teachers care most about–critical thinking processes such as reasoning and problem-solving–are intimately intertwined with factual knowledge that is stored in long-term memory (not just found in the environment).” (quoted in Lang, 2016, p. 16)

Without a solid understanding of basic concepts, theories, and processes, a student cannot think creatively or critically about a discipline’s body of knowledge.  This academic groundwork allows students to integrate new knowledge in deeper ways and make more sophisticated connections.

Unfortunately, students often make poor choices when they attempt to learn new information.  Have you ever asked your students (maybe after the class did terribly on an exam) how they studied?  Often, students will say things like “I re-read my notes” or “I made flash cards and read them over and over again.”  Research has demonstrated that these are some of the least effective strategies for committing information to long-term memory.  Thus, if we care about our students’ learning, then we must design our courses in ways that actually help students learn, not simply cram and forget.  

Exams are considered by many to be the gold standard of measuring student learning.  However, most instructors are not familiar with the cognitive science literature and, therefore, do not design exams that actually result in student learning.  Better understanding the retrieval effect (sometimes called the testing effect) will help us to create more effective assessments.

How many times have you claimed your “brain is full” or “you can only remember so much”?  Our long-term memories are actually capable of holding quite a lot of information.  Cognitive psychologist Michelle Miller argues “the limiting factor is not storage capacity, but rather the ability to find what you need when you need it.  Long-term memory is rather like having a vast amount of closet space–it is easy to store many items, but it is difficult to retrieve the needed item in a timely fashion” (quoted in Lang, 2016, p. 28).  She explains that each time we recall a piece of information, we strengthen the neural pathways that move the information from our long-term memories to our working memories.  This is key.  The more times we retrieve the information, the better.

Book Small Teaching by James Lang

To encourage your students to practice retrieval, try these strategies from James Lang’s book Small Teaching:

The Retrieval Syllabus.  Most of us distribute our syllabi on the first day of class and never bring it up again, until a student violates a policy or makes a complaint.  Instead of thinking of your syllabus as a contract, envision it as a resource that is continuously referred to throughout the semester.  Fill out the course schedule with details that will help students see how the course will progress, how topics connect to one another, and how knowledge is organized in your discipline.  Then, during class, ask students to look at the document to orient themselves as well as remind them of what has been discussed thus far.

Warm-up Review.  In the first few minutes of class, ask students to write down on a scrap sheet of paper the topics that were covered the class period before or the main themes from the reading.  Ask students to share their “take aways”: What do they think was the most important point?  What struck them?  What piqued their interest?

I’ve done something similar with my students, but I simply asked the class to provide a review orally.  Typically, the same few students are the only ones who reply.  Thus, not everyone is encouraged to practice retrieval, so this method is less effective than asking all students to write down their recap.  This simple exercise has the added benefit of an intellectual “warm-up” — prepping students for learning and participating during class.

Exit Tickets.  Similarly, at the end of class, have students to complete an exit ticket.  For example, you could ask students to write down two things they learned and one question they still have.  This requires retrieval as well as provides valuable information about what students identify as important and what they are struggling with.  This can serve as a great jumping off point for the next class period.

What is absolutely essential for both warm-ups and exit tickets is that students are told not to consult their notes or textbook when responding.  If students look up the answers, they are not practicing retrieval.  It’s also important to explain to students the purpose of these exercises.  You’re not trying to test them or give them busy-work; you’re trying to help them learn more effectively.

Frequent Quizzing.  Frequent, low-stakes quizzes are one of the best ways for students to strengthen their retrieval muscles.  Remember that the more we recall information, the stronger the neural pathways between long-term and working memory.  When creating quizzes, it’s essential that they are not weighted heavily.  The point is to encourage retrieval, not stress students out.  It’s also important to include question types that will be similar to what students can expect on exams.  This allows students to familiarize themselves with those formats so the exam is a test of knowledge instead of exam-taking ability.

If you don’t have enough class time to devote to frequent quizzes, consider using online quizzes, such as through your Learning Management System (LMS).  Most textbook publishers provide gigantic test banks that provide more than enough questions to create multiple quizzes throughout the semester. These banks are designed to be quickly imported into your LMS and quizzes can be automatically-graded, making quiz creation and administration simple.  To ensure students are practicing retrieval, restrict the time limit so they don’t have the leeway to look up every answer in their notes or book (30-60 seconds per multiple choice question is advisable).

Space Out Due Dates.  Students should complete multiple smaller assessments throughout the semester (as opposed to only one midterm and one final exam).  Intersperse lower stakes assessments (e.g. weekly quizzes, practice problems, minute papers) with higher stakes assessments (e.g. exams, research papers, lab reports).  According to James Lang, “the more frequently that your students have to check in and offer some demonstration of their learning, the more often you are giving them retrieval practice” (2016, p. 36).

Providing frequent opportunities for retrieval will not only help your students remember important information, it will also open the door to higher levels of cognition.  I’ve shared simple but powerful ways to help your students learn that do not require extra preparation, overwhelming amounts of grading, or even that much class time.  Want more ideas?  Check out James Lang’s fantastic book Small Teaching and then ask yourself, “what small changes can I make to help my students learn?”

Best Practices, Pedagogy, Teaching Advice

Strategies for Unmotivated Students

As instructional technologists, we often get questions from faculty members about student motivation. What happens when you plan engaging lessons and your students still are not interested or participating in class? This is an area of concern for many faculty members, and unfortunately, there’s no one size fits all solution.

After getting a question about this in one of my recent sessions, I decided that I wanted to find out more about strategies concerning unmotivated students. I found a great article from Jennifer Gonzales at Cult of Pedagogy that addresses this topic and wanted to share it here.

According to Gonzales, current research about what motivates students says that:

  1. Having a positive relationship with one’s teacher can influence a student’s motivation.
  2. Students are more motivated when they are allowed to make choices related to learning and coursework.
  3. Contrary to popular belief, extrinsic rewards actually negatively affect student motivation.
  4. In order to be motivated, students must feel like there is room for improvement in a particular task.
  5. Students are more motivated to learn things that they believe are relevant to their lives.

Based on the research, here are some suggestions for unmotivated students:

  1. Use icebreakers, journals, and one-on-one conversations to build relationships with your students.
  2. Allow students to choose how they’d like to complete assignments when possible. Some students may prefer creating a multimedia project to writing a paper. Can a particular learning goal be met using different modalities? If so, allow students to choose how they’d like to show their knowledge.
  3. Focus on the value of a particular task. Explain how a student’s participation in the task will benefit the student outside of the classroom.
  4. Provide specific feedback on student work rather than generalized statements such as “needs improvement.”
  5. Make connections between classroom content and students’ lives or current events.

Gonzales included many more suggestions and resources for things that you can do to improve student motivation in your classroom, including questions to ask yourself about your own teaching, which can be found here
What are some ways that you plan to use these strategies in your classroom?

Best Practices, Collaboration, discussion, Distance Ed, Events, Information Session, Innovative Instruction, instructional technology, Mobile, Pedagogy, social networking, TLT, Training Opportunities

TLT’s Distance Education Resources Blog

TLT has a new resource available exclusively for our faculty who teach, or are interested in, online instruction!

http://blogs.charleston.edu/dereadiness/

There are two paths to choose from depending on your role:

Social-Media-2-1irk9m3-300x300 (1) Social-Media-23ptrpu-300x300

Choose this path if you:

  • Have never taught online before
  • Have taught online at another institution, but not CofC
  • Plan to teach online at CofC in the future

Start learning more about teaching online at CofC!

New to Distance Education

Choose this path if you:

  • Have completed the DE Readiness Course
  • Are currently teaching online at CofC
  • Are looking for resources related to online teaching and support

Explore more about online learning and support!

Currently Teaching Online

Make sure that you follow #CougarsOLI on all social media outlets to stay up to date on information and research pertaining to Online Learning Initiatives at College of Charleston

#CougarsOLI Logo (2)

Best Practices, Pedagogy

Energize In-Class Discussions

Last week, I was commiserating with an instructor about her struggle to engage students in discussion during class.  “Sometimes it’s like talking to a brick wall,” she lamented.  Facilitating lively conversations that require students to apply, synthesize, and evaluate their knowledge is one of the most challenging aspects of teaching.  Even the most brilliant lecturer can be stymied by an unresponsive class.  So these are my top tips for improving class discussions:

Plan your discussion prompts in advance.  Thought-provoking questions are challenging to come up with on the fly.  So when planning your lectures and in-class activities, craft prompts as well.  Without prior contemplation, we may resort to asking “any thoughts about that?” and be discouraged by the blank stares we receive.

Use hooks to launch the discussion.  Rather than starting a discussion with a single question, consider building up to that prompt with a hook to pique your students’ interest and start their thinking process.  For example, present a short case study, tell a story, recite a witty quote, show a video clip, or share a current event.  These serve as points of departure that contextualize your questions and give students the opportunity to apply their knowledge.

Ask better questions.  Often because we haven’t given them much thought in advance, our discussion prompts fall flat.  Our questions are too vague, too long-winded, or limited to yes-no answers.  Instead, make sure your questions are succinct, clear, and open-ended.  This may seem obvious, but I often ramble a bit when asking questions forcing students to inquire, “so what’s the question again?”  Some ideas for discussion prompts

  • Ask for students’ input: What should ___ have done? What would you do in this case?  Have you had a similar experience in your life?
  • Ask “how” and “why” questions: How might this argument be made more persuasive? Why do you think the author made this argument?  How does ___ compare to ____?
  • Ask evaluative questions: How compelling is the author’s argument?  What are the implications of ____?
  • Ask prediction questions: What will occur next?  What might happen if. . .?
  • Ask justification questions: What evidence led you to conclude that…? What is the reason…?

Give your students a chance to think.  Many of us are uncomfortable with silence, so when students don’t immediately respond to our questions, we continue talking.  It’s easy to forget that students are disciplinary novices who need greater time to ponder than we do.  So when asking a question, pause for a good 30 seconds before probing further.  Don’t surrender and answer the question for your students.  Force yourself to endure the silence.   

Think-pair-share.  Many faculty turn their noses up at strategies implemented in K-12 classrooms, but that’s where a majority of innovative pedagogy comes from.  Think-pair-share is a simple but brilliant way to encourage conversation. First, after presenting your hook and prompt, let students jot down their ideas on scrap pieces of paper.  Then, ask them to turn to their neighbors and share their ideas.  Finally, bring the entire class together and have the pairs report what they discussed.  This gives students the chance to think and talk through their ideas before being put “on the spot” in front of the entire group.

Use positive reinforcement.  When students contribute to class discussion in ways that demonstrate higher-order thinking, acknowledge it.  Saying, “that’s a great question” or “good point” is an effective start, but be more specific with your feedback.  For example, “Sam makes an excellent point. I appreciate how you supported your claim with evidence from the reading.”  This demonstrates to students what a “good” response sounds like, providing a model they can all use.

Ask follow-up questions. When students respond with brief or incomplete answers, don’t miss the opportunity to ask a follow-up question such as, “Could you tell me more?” or “Why do you say that?” or “How did you come to that conclusion?”  You can also pull in other students to contribute: “Let’s help Jamie out, why might we reach the conclusion that. . .?”

End discussions purposefully.  Before moving on to the next lecture topic or question, summarize what was discussed or ask a student to do so.  This helps students to synthesize new information and integrate it with existing knowledge.  You could also consider ending your class with some type of “exit ticket” such as a minute paper or Poll Everywhere poll (which is a free tool for CofC students and faculty).  Exit tickets are a quick and easy method to help students solidify their understanding as well as communicate to the instructor what they still have questions about.

Do you have other suggestions for facilitating engaging class discussions?  Please share!

For help improving discussions in your online course, check out this post written by my colleague, Mendi: http://blogs.charleston.edu/tlt/2015/10/28/tips-for-more-effective-online-discussions/

https://flic.kr/p/dhf3T6
Events, Facilities, instructional technology, Pedagogy, TLT, Training Opportunities

Upcoming Fall Events in TLT

Faculty Open House

Faculty Open House
Faculty Open House 9/25 at 2 pm

Friday, September 25

2-4 pm – Stop by anytime!

TLT Suite on JC Long 3rd Floor

Come enjoy light refreshments and enter for your chance to win fabulous prizes while also learning more about what TLT has to offer!

Join us as TLT’s Instructional Technologists showcase our services and demonstrate the latest and greatest educational technology tools. You will have the chance to experience Kahoot! and learn how you can utilize our 3D printer.

We hope to see you there! It’s a great opportunity to interact with people from across campus.


Fall Training Camp

Fall Training Camp
Fall Training Camp 10/19-10/20

October 19 and 20 (Fall Break)

Sessions offered all day

As you make your plans for the rest of the semester, keep in mind that TLT will be hosting Fall Training Camp over Fall Break. We will have two days of training sessions that focus on both teaching strategies and educational technology.

We will be offering 16 unique sessions in a flexible, conference-style schedule so that you can attend the sessions that interest you while still enjoying fall break! Each morning there will be online sessions you can participate in from the comfort of your living room. If you can make it to campus, you can join us for three additional face-to-face sessions each day. During the time slots, two training sessions will run concurrently, meaning that you have even more flexibility and choice in finding a topic relevant to your teaching needs. Session topics vary from demonstrating how to use technologies, including Blendspace and Evernote, to how to enhance your current teaching practices with new strategies, like gamification and concept mapping.

Lastly, don’t forget! We will be having another exciting school competition this fall! You may recall that the School of Sciences and Mathematics won the trophy for Spring Training earlier this year. It was a very close battle with the School of Education, Health, and Human Performance. Your attendance will help your school earn points in the competition. The school with the most points will win a trophy and other great prizes!

Visit http://tlt.eventbrite.com for a full list of sessions and descriptions. Space is limited so make sure you register soon to secure your spot.

 

Best Practices, Pedagogy, Teaching Advice

Making the Most of The First Day of Class

The countdown to the fall semester has begun.  I’ll give you a moment to sob or stomp your feet…

Despite our wish for a never-ending summer (perhaps without the humidity), the reality is classes begin soon.  As you work on your syllabi and OAKS courses, give some thought to how you approach the first day of class.  Do you read the syllabus to your students line-by-line?  Do you have students play an icebreaker game that makes them sigh and roll their eyes?  Or do you simply introduce yourself, tell students which textbook to buy, then let them go after 5 minutes?

When I first began teaching, I admit to doing all three of these.  I was young and nervous and awkward.  But in the years since, I’ve learned to embrace the awkwardness of the first day and use that class period to set the tone for the rest of the semester.  So I challenge you to give more thought to what you do on the first day of class to set expectations and start building your classroom culture.

In a previous post, I discussed why you shouldn’t treat your first day as “syllabus day” so I won’t belabor those points here.  But I will offer a few additional suggestions:

Introduce yourself as a human being.  If students are so inclined, they can look up your bio on the department’s webpage.  They can Google you.  So instead of telling your academic story, consider telling a more personal story.  Share your hobbies and passions or something students would never guess based on their first impressions of you.  This is more than being personable; it’s about being authentic.  When I introduce myself to the class, I share quirks and pet peeves.  These usually get a chuckle and make me seem like a human being rather than a lecturing and grading robot.  I once had a professor who played a piece of music he wrote as a way to introduce himself.  I still remember him vividly 12 years later.

Find an icebreaker that isn’t trite.  I know, I know.  Icebreakers are awkward and many of them are incredibly boring.  But there are ways to encourage your students to get to know one another that don’t make them want to gouge their eyes out.  Remember, by the time students get to your class, they could have already suffered three or four terrible icebreakers.  So rather than the usual “let’s go around the room and each person tell us a little about themselves,” spice it up with an activity or game, even something silly.  For example, I have had students engage in “speed dating” where they have 2 minutes to chat before the bell rings and they have to move to the next classmate.  We’ve also played “6 degrees of separation” where they make a list of 5 things they have in common with a classmate, then they have to find someone else in the room who has at least one of those things in common.  Then those two students make a list of 5 similarities and the game continues.  Students may roll their eyes at first, but by the end of class, they are laughing and I notice friendships forming by the next class period.  So try something new this semester to encourage your students to talk to one another, rather than spending the minutes before class begins texting on their phones.

Establish intentions.  Rather than spending time listing policy after policy, consider setting intentions for the semester and involving your students in this process.  What do you hope they accomplish and what do they want to learn?  What do you expect from them and what can they expect from you?  Is there a way both parties can be satisfied?  For example, after I explain a few of the more important policies, I ask students to compile a list of what they would like from me.  Punctuality, availability, and fairness are usually mentioned and these are qualities that I already deem important.  But because students composed the list themselves, it gives them the sense that I’m willing to share my power and that I’m open to their perspectives.  We also spend time establishing a classroom code of conduct.  Some of you may find this infantile, but I believe it’s one of the best and easiest ways to establish a respectful classroom culture.  When students generate the rules, they own them.

Showcase course content.  Some of you may disagree with me on this point as well, but sometimes we have to convince students to buy what we’re selling.  The first day is all about introductions and the course content should be included.  But rather than provide a regurgitation of the course catalog description, pitch the course as something students will find exciting and, yes, applicable to their lives.  And just as important, tell students why this is content you love and why this is a course you want to teach.  Enthusiasm is contagious.  I also recommend you start teaching the first day.  Students may look at you with incredulity, but it communicates that you take the course and their learning seriously.  In contrast, if you let them go after ten minutes, it communicates the course isn’t important.  So use this time to jump in and provide an outline of the fantastic content you’ll be sharing.

The first day of class is ripe with possibilities.  Make the most of it and it will set you up for a successful and enjoyable semester!

Accessibility, Best Practices, Distance Ed, Pedagogy, Productivity, Teaching Advice, TLT

TLT’s Top Tips for Time Management

What are instructors spending time on?

Below are the five most mentioned teaching behaviors identified in the research and from the feedback of online instructors. The ranking begins with the teaching activity that involved the highest time commitment, and descends from there. This is not a scientific analysis, but I included the list to provide an overview of the most prevalent online teaching activities (Van de Vord & Pogue, 2012).

  • Interacting with students: moderating discussion forums, responding to student emails
  • Evaluating student work: assignments, papers, discussion forums
  • Recording grades
  • Modifying and making changes to course materials and/or course home page
  • Addressing technical issues/course administration (not including grading)

 

Tips for Time Management

  1. Handle it once.

Following the principles of the GTD (Getting Things Done) Methodology, manage items as soon as you can.  For online teaching, this means doing things in a regimented format.  When emails come in, if an answer or action can be done in less than 5 minutes…do it now.  If It needs deeper thinking and reflection, mark it in a follow up folder or category before closing it.  While reading discussion boards, keep a spreadsheet open so that you can grade as you go and make notes while reading to help keep your students straight. Grade as items arrive and space out due dates to cut down on last minute or end of term grading.  Create blocks of time during each day to work on a particular item.  For example, Mondays from 10-11 am I work on items strictly for the mentors.  Everyday from 830-930 am I answer emails from participants about course related issues.  Thursdays from 1-4 are spend grading specified assignments.  Making this set schedule for yourself will make sure that you are allowing ample time to focus.

 

2.   Respond to students efficiently.

If a student asks a great question via email, reply to them and ask them to post their question and the response to the class, but if more than one student has emailed about the same issue or set of instructions, then address the group as a whole with a news item, whole class email, or something else that will make sure that all students see the information.  For example, if there is a procedural problem (students not knowing how to do something in a class) create a short video or screencast to walk them through the process.

 

3.   Make Time Count.

If it’s something that a student won’t notice…don’t do it!  If it’s something the students can do for themselves or with each other…delegate or provide opportunity to do it.  For example, a Course Lounge or question forum will allow students the ability to answer each other.  You can back this up by adding an “ask 3 before me” type policy so that you know they’ve tried to find help on their own first.  To make this efficient, you need to mindfully not engage in what one professor called “Whack a Mole” facilitation, where as soon as a discussion post or a question comes up the professor logs in to answer it or replies immediately.  Make sure you give your students that time to help each other or they will become accustomed to that immediate feedback and you’ll spend all your time responding to email.

 

4. Get Organized:  Location, Location Location

Have your course follow a logical path so that not only you but your students also know exactly where to go and what to do.  The easier it is to find something, the less time you spend looking for it!  This is especially applicable to the syllabus.  The more text heavy and exhaustive your syllabus, the less likely your students will be able to find what they need in the process.  Try breaking your syllabus up into sections and bulleting information rather than using paragraph texts.  Have your students engage in a scavenger hunt or quiz to show that they understand the key pieces of the document before the class gets too far underway.  This will lead to less questions and less time emailing “it’s in the syllabus”.

5. Get Organized: Me, Myself, and I

Make sure that your workspace is organized and ready to go.  This includes your computer!  If you have a hard time finding files or folders on your machine, take some time to organize your files so that you can easily grab an item when it is needed.  Keep a list handy of places you can go to for help.  Obviously TLT is going to be number one (:)) but make sure that you add your librarian, CDS, CSL, and other campus resources and how to contact them.

 

6. Develop a routine and electronic minions

There are a lot of moving parts in an online classroom.  Some can be automated, some cannot.  First, make a list of all items that you need to do (that you know of) and due dates prior to the course starting. Identify any weekly activities and blocks of time you’ll need to answer emails, grade, respond to discussions, etc.  If an item can be automated (for example, a news item reminder about a test that you want to go out on a certain date) go ahead and create the wording and release conditions before the class starts.  In the immortal words of Ronco…set it and forget it!  For those items that can’t be automated, create calendar reminders or use a task management tool that contains reminders like Asana.

 

7. #Unplugged

In honor of the TLT Lifetime DE Mentor award recipient Lancie Affonso, we bring you this most important tip.  Unplug every now and again!  Take some time away from the screen and technology to engage in the world.  It is tempting to want to be logged in 24/7 when your students are in session, but taking some time to take care of yourself (and your eyes, back, and wrists) will benefit you in the long run as an instructor.

 

8.  Use the right tools for the job.

Technology can do so much to help with time and task management, as well as automating parts of your responses without losing that personal touch.  Talk to your instructional technologist about some of the options to help you with time, task, grading, and communication management for your online class.  Check out this article on how to go about choosing the right tool for your situation:  http://blogs.charleston.edu/tlt/2014/03/05/plan-attack-implementing-technology-instruction/

 

9.  To Thine Own Self Be True

“Each person has a daily cycle when he or she is most alert; schedule that time for online work. Determine the best time of day to check and respond to email. Flag and prioritize emails.  Realize that what is an overload for some instructors is not for others. Before accepting teaching assignments, look at the other assignments already accepted for that semester and consider whether the workload is too heavy. Factor in family obligations and planned vacations when considering personal work capacity.  When planning for the future record notes each week in a teaching journal identifying thoughts about revisions for the next semester. Some fixes like broken links can be done on the fly during the current run, but others, like the rewriting of a section, need to wait until the students are no longer present. At the end of the semester, reflect on the notes and adjust as needed.”

 

10.  Practice your online writing

Because writing is a major channel of communication in an online class, the importance of clear and concise writing of the course materials cannot be over-emphasized. If one student finds a sentence unclear, the instructor will need to spend valuable additional time responding to clarify. Five or ten minutes of additional time for polishing a message or task instructions before distributing or publishing may save hours in clarifying later.  Have someone who is not familiar with an assignment read the instructions and see if it makes sense or if they could do the assignment with the information you provided.  Keep a list of frequently asked questions and your responses.  You can then copy and paste your responses or keep a running list published in a Google Doc that would get updated in real time for your students and would be easy to search for keywords.

 

11.  Design with Accessibility in Mind

Too often faculty members will design an online course and then realise a semester later that they have a student with a disability in their courses that require accommodations (screen readers, subtitles, alternative formats, etc.)  While it may take more time as you build the course, designing your course to be as accessible as possible from the start will save you more time (and you will reach more students) than trying to scramble after you get an accommodation request letter.  Remember, it is easier to construct than to retrofit a class!

 

colorful idea map
1-1-1, Collaboration, Faculty Technology Institute, Innovative Instruction, Pedagogy, TLT

Concepts, Connections, and Constructivism: Mind Mapping for Pre-service Teachers

Keonya Booker, Assistant Professor in Teacher Education, recently presented Concepts, Connections, and Constructivism:  Mind Mapping for Pre-service Teachers at the 2015 Conference on Higher Education Pedagogy at Virginia Tech.  As a result of what she learned at the 2014 Faculty Technology Institute she presented on how she used collaborative idea maps to help students make connections.  Below are snippets from her conference proposal


Abstract: Constructivist theory asserts that students attach meaning to their learning by way of predicting, organizing, and evaluating information. Instruction in constructivist-based classes should support students as they actively connect new ideas with prior knowledge. Mind mapping allows students to make associations between both abstract and concrete types of information in creative and imaginative ways. This practice session will explore the use of a popular software program to help pre-service teachers understand major theoretical perspectives in a human development course. Particular attention will be paid to student perceptions of both the tool’s functionality and benefit to learning.

Description of Practice:  Mind mapping has myriad uses in education and there are several tools instructors can use to support student learning. At the College of Charleston all elementary and secondary pre-service teachers must successfully complete a Human Development course prior to their fieldwork experience. Since lifespan development traditionally takes a survey approach, breadth of information is emphasized, not necessarily depth. Because we want students to have a strong understanding of a particular topical issue prior to their practicum, the cumulative assignment was developed. For the cumulative assignment, each student group is responsible for exploring a developmental theorist (e.g., Piaget) or current educational issue (e.g., Common Core) and then presenting to the rest of the class. Students are required to use Popplet to coordinate their work and show connections between contrasting ideas. Uses for Popplet include editing, organizing, and drafting mind maps which will be demonstrated in the session. Participants will also see examples of student work and hear how students evaluated the use of the tool in terms of functionality and worth to the overall project.


 

If you are interested in learning more about Dr. Booker’s presentation or how you can successfully us idea maps in your teaching feel free to contact Dr. Booker or your Instructional Technologist.

Assessment, instructional technology, Pedagogy, TLT, Web 2.0

Quick Audience Feedback with GoSoapBox

If you’ve ever asked your students “are there any questions?” you’ve likely received blank stares and shrugs.  Assuming this to mean everyone understands the content, you move on.  But what if students aren’t sure how to articulate what they don’t understand?  Or what if they’re too shy or embarrassed to admit they are confused?  Or maybe you’re simply looking for a way to get greater feedback from and interaction with students during lecture?  GoSoapBox could be just what you’re looking for!

GoSoapBox is an audience response system (a “clicker” tool) that works on any device that connects to the Internet.  This tool allows you to survey the class for understanding, quiz them on content, and encourage discussion.  The beauty of GoSoapBox is the simplicity of the user interface despite offering numerous features.  For example, “Social Q&A” allows students to contribute ideas and up-vote the ones they like.  This could be great for an exam review: students submit questions and vote for the ones they really want to spend class time discussing.

GoSoapBox Social Q&A

The “Confusion Barometer” is a super simple way to gauge just how well students really understand the material.  Instructors can see a live graphical display of how many students are confused by the material being covered and can then adjust their teaching strategy as necessary. GoSoapBox also offers quizzing, polling, and discussion board features, which allow for short answer/open-ended responses.

GoSoapBox Confusion Barometer

Students can respond with their names or anonymously, so GoSoapBox can be used to monitor students as well as allow sensitive opinions to be freely shared.  Instructors can even export reports in spreadsheet form to track student performance.

So why explore GoSoapBox instead of PollEverywhere?  If you have a class of 30 students or fewer, GoSoapBox is free and provides features that Poll Everywhere doesn’t, such as the quick and easy “confusion barometer” and threaded discussions.  It’s also a simpler interface so it’s quite user-friendly, while PollEverywhere can sometimes be clunky.  However, if you have course enrollment of over 30 students, I would not pay for GoSoapBox; our site license for PollEverywhere provides a great audience response system for free.

Applicationhttp://www.gosoapbox.com/

Platform: Web

Cost: Free for courses of 30 students or fewer

Tutorialshttp://help.gosoapbox.com/

GoSoapBox Blog (for updates and tips): http://gosoapbox.com/blog/

EXAMPLE MC ITEM WITH FLAWS
Faculty Technology Institute, Pedagogy

Reworking multiple choice exams for clarity

Multiple choice question creation is challenging and time-consuming. While question banks from the publisher can certainly benefit students by providing opportunities for practice, I prefer to create my own questions for exams to make sure they align with my learning objectives and the material I emphasized in class. While one of the main benefits of using multiple choice questions is the ease and speed of grading, one of the drawbacks is the amount of time invested in the development of each question. Various sources report that professional test item writers spend 30 minutes to 1 hour on just the first draft of a multiple choice question (1, 2). In some ways these numbers are reassuring as I know I am not alone in my occasional struggle with creating plausible distractors (choices) and targeting higher level thinking and reasoning.

During last week’s Faculty Technology Institute, TLT offered a session on best practices to improve multiple choice questions and exams. A number of tips resonated with the participants and led to a vibrant discussion. With multiple choice questions being so common, I thought the rest of the college community might gain new ideas from some of these discussion points. The summer is the perfect time to look back on exams from the past year and evaluate their effectiveness at measuring student learning. You might consider carrying out an item analysis on some of your questions to evaluate the difficulty and discrimination (3). Here are a few practical things to consider if you plan on revising your multiple choice questions:

 

3 options are optimal (in most cases).

A meta-analysis of over 80 years of research concluded that 3 options, or choices, are optimal for multiple choice questions (4). The analysis examined item difficulty, discrimination, and reliability and concluded that 3 options is best in most settings. I found this paper fascinating, and I was pleased to find out that I can spend less time trying to come up with plausible distractors for each question, while at the same time reducing the reading burden for students. Wahoo!

MC Question
Parts of a multiple choice question.

 

Question order does not influence performance or completion time.

The majority of research on this topic indicates that question order has no effect on performance or completion time (5). This is great news as scrambling question order is one strategy adopted by many instructors to prevent cheating. Interestingly, students may perceive exams with randomly ordered questions as more difficult than chronologically ordered exam questions (5). This might be something to keep in mind if you often hear from students that your exams are really difficult.


 

Following all the item writing recommendations is really hard.

  • Avoid absolutes (always, never, all, none, all of the above, none of the above, etc).
  • Avoid negatives (all of the following except, which of the following is not true, etc.).
  • Avoid imprecise terms (usually, sometimes, rarely, etc.).
  • Keep the stem of the question succinct.
  • Keep distractor length consistent.

I know my past exams have included “none of the above” or “all of the above” as options. Faculty attending TLT’s sessions on writing multiple choice questions have commented that these recommendations can be hard, sometimes impossible, to follow. I am hoping to reduce my item flaws by cutting question options down to three.

 

Poorly constructed questions and exams negatively affect students, and they interfere with interpretations of the exam results. As an instructor, I want to make sure that my questions are reliable and valid. In addition to wanting my exams to align with my learning objectives, I want my exams to be a reflection of student learning in my course and not a measure of reading ability or test-taking savviness. The recommendations listed above have led me to rethink my exam format and reconsider some of my test questions. I hope they are useful to you too!

 

(1) Van Hoozer, H.L. (1987). The teaching process: theory and practice in nursing. Norwalk, Connecticut: Appleton-Century-Crofts.

(2) http://www.getyardstick.com/how-long-does-it-take-to-create-a-multiple-choice-question

(3) http://www.thinkgate.com/improving-multiple-choice-questions-through-item-analysis

(4) Rodriguez, M.C. (2005). Three options are optimal for multiple-choice items: a meta-analysis of 80 years of research. Educational Measurement: Issues and Practice, 24, 3-13.

(5) Pettijohn, T.F. and Sacco, M.F. (2007). Multiple-choice exam question order influences on student performance, completion time, and perceptions. Journal of Instructional Psychology, 34, 142-149.