Citing Your Sources

writing-828911_1920
Image by Free-Photos from Pixabay 

While reading a post from A Learning A Day, I thought I’d keep the irony train rolling by linking to Rohan’s linked post from Derek Sivers about the perceived need to quote an idea’s source.  Specifically, I wanted to respond to this point:

2. School teaches us to reference. But we’re not trying to impress a teacher anymore. And every unnecessary fact dilutes our point.

I often reflect on the learning objectives I expect to achieve in a course lesson while teaching.  I try to parse out the meaningful things I want students to learn from rote procedural tasks that don’t serve a purpose.  The last thing I want to do is to reinforce the wrong lesson or derive the wrong conclusion from a student’s performance (e.g. did a student do well on a test because they understood the material, or because they are good at taking tests?).

Derek’s point above about references is well-taken and got me thinking: why do I want students to cite their sources?  I brainstormed a few reasons and listed them below with comments.

Reason

Thoughts

I want a student to be mindful of their research process (procedure). Having gone through writing my master’s thesis, it’s easy to lose track of references and citations if you don’t stay on top of it.  This isn’t super relevant to most assignment learning objectives, but it’s a good practice to have before launching into a bigger endeavor or capstone project.
2. I want a student to critically examine their own knowledge (what do they believe to be true facts, where did that fact come from, and why do they think it’s true). I’m not sure if making students cite their sources achieves this aim on its own, but I suppose I could use citation requirements to help guide them through this process.
3. I want a student to be mindful of idea ownership and give credit to people who have done work.

 

I’ve used this mostly in plagiarism cases where students copied work and submitted it as their own.  I try to distinguish between sloppy citing and outright theft, and I remind students that they shouldn’t get marks for work they didn’t do.  I’m still undecided if this is a rule of the academy or a legitimate thing to prevent fraudulently passing work off as your own in the future.  This point, though, is mostly relevant in academic contexts as opposed to Derek’s notes about doing this during conversations.
4. I want an easy way to see if the student did the work. This is a trick I’ve developed to see whether a student giving me their opinion is right by chance, or if they have informed their opinion by doing the course reading.  The same result could be gained if students inserted relevant information without citations, but the citations help to highlight this when I’m reading through their submission.  In other words, it makes my job easier.
5. I want to reinforce good academic writing habits. Using references is part of what it means to write academically, and is used as part of the integrity process.  This is only a good reason if my objective is to teach/reinforce academic writing for students.
6. This is the way it has always been done.

 

More cynically, requiring citations is part of the tradition, and who am I to question it?  It’s not a good reason to require it, but it is what it is.  I won’t included in the list to the left, but a more sadistic version of this is “I had to do it, so you have to (go through this rite of passage) too!”
7. I want to remain consistent with departmental policies and culture. Whether written or unstated, most departments adhere to some level of standards.  This was less the case for me in undergrad and it depended largely on the preferences of the prof.  By the time of my thesis, I ended up developing a hybrid referencing system that did not strictly follow any of the major citation methods.  I received no comments from anyone who reviewed my thesis on my citation practices.
8. It’s important to trace an idea’s lineage as much as possible to spot fabrication. If you are going to insert facts or conclusions into your work, it’s important to point to where you found them.  Without a citation or an adequate way of accounting for how you know what you purport to know, it’s possible that the information is made up.  Being able to trace these things helps, albeit this is more useful from a scholarship point of view, as I suspect a lay-reader isn’t concerned with checking a text for factual accuracy and instead takes it on authorial authority.

9.

Related – to see if a student is able to either properly reference work, or at the very least charitably restate ideas without dropping important content from the idea. This perhaps falls under sloppy citation practices, but on occasion students will misunderstand a piece of text and paraphrase or summarize information incorrectly.  Knowing where the student is drawing their source from can have pedagogical merit if you take the time to compare the student’s work with the source and discuss the divergence.

10.

Related – when an author cites their sources, a reader can use the bibliography of sources for further reading.

 

This is perhaps more for book nerds, but I love having references to be able to learn more for things that pique my interest.  This is, however, not the context Derek is referencing when he discusses giving citations during a normal conversation.  If Derek’s conversation partner was interested and want to know more, I’m sure they would ask Derek for more information.

11.

More abstractly, knowledge and academics is a web of mutually reinforcing facts, so academic writing is an extension of that reality. This one is a bit of a stretch as to why a student who is not adding to a body of knowledge is required to rigorously cite their sources in a pedagogical exercise, but I include this more epistemological point to try and be exhaustive.

12.

It’s a symbolic representation that the student (in most contexts) is not generating new or novel work/insights that creates new knowledge, but instead is remixing ideas from other sources. I think this is a good reminder of what the goal of the assignment should be (students are often far too ambitious in what they think they can reasonably achieve in x-number of pages), but I wouldn’t consider this to be an adequate reason to insist on proper citations.

13.

Like other skills, the act of referencing needs to be practiced. I’m sympathetic to this, but as Derek is implying, you should be practicing skills that transfer into other domains or that you will need.  In most instances, outside of school you don’t need to cite sources.

14.

Citing references is part of the argumentation process.  In order to build a successful argument, you must clearly express and state your premises, which includes any premises taken from the work of others (either their premises or their conclusions). I’m also sympathetic to this as I think everyone should keep in mind that arguments need to be made to help convey ideas.  It shows the logical chain from premise to conclusion and seeks to make the implicit explicit, and the unstated stated.

Other than a subset of the reasons above, a strict requirement for citations is often unnecessarily enforced in the classroom, and is almost never required outside of the academic setting.  I think there are some good pedagogical reasons to have students go through the effort  to cite their sources, but you should be intentional when teaching as to when those cases apply.  For instance, I am less strict about my students citing sources and instead I look for them to directly apply material from the course in their assignments (instead of giving me their opinions).

I enjoyed Derek’s point about how citing sources is a common trope in pop non-fiction, which sounds like a convergence on my ideas concerning animated bibliographies, or Ryan Holiday’s “15 academic studies” comment from a few weeks back.  Maybe Derek’s right – we should have more courage to integrate knowledge into our existing schema and be prepared to state things as facts instead of citing our sources.  I’m not sure I’m prepared to abandon the practice wholesale, but it has given me something to chew on.

Stay Awesome,

Ryan

Book Ideas – Types of Feedback

I’ve been reading Scott Young’s recently released book, Ultralearning, and I think it’s a pretty good summary of how one can take on an intense learning project for personal and professional development.  It functions like an autodidact’s road map with plenty of good tips, insights, and stories to round things out.  Elements of the animated bibliography are present, but I don’t find it contrived in its execution.  The stories help frame the chapter and serve as an introduction to the core material.

It’s funny how last week I was talking about mnemonic devices, because after drafting that post I ended up reading about the concept in Chapter 10 of the book as it dealt with ways of supporting retention of material you learn.

In chapter 9 of the book, Young talks about ways of providing feedback in the learning process, whether the feedback is provided from others or feedback you can use in your own learning process.  He parses out three kinds of feedback that I found interesting, not only for my own personal use in learning, but also as something I should keep in mind as a teacher.

The three kinds of feedback he outlines are outcome feedback, informational feedback, and corrective feedback.  Each type of feedback serves a specific purpose, and you should be mindful of the context the feedback is given, as the wrong type of feedback can set you back in your learning.

Outcome feedback – provides information on whether you are getting answers right or if you are meeting a pre-identified set of learning objectives.  It tells you that you are right but doesn’t give any indication of why (or why you are wrong).

Informational feedback – provides further information to explain the underlying reason why something is right or wrong.  It can be informative to re-affirm what you have learned, and can identify key areas of strength or weakness, however it does not create a concrete process forward.

Corrective feedback – provides, as the name indicates, a path forward for the learner in terms of how to overcome deficiencies.  It details not only how one is right/wrong, why they are right/wrong, but how to address or avoid being wrong.  This type of feedback not only requires a level of comprehension of the material, but requires sufficient understanding to teach the underlying processes to the learner through explanation, demonstration, suggestion, etc.

As a teacher, it’s important to know what kind of feedback is warranted and under what circumstances.  Most of us tend to focus just on outcomes, but students often don’t learn from pure outcome assessment.  Rather, you need to take the further steps to go beyond an evaluation and ensure you are addressing the underlying deficiency present in the student’s performance.  Outcome assessment is awesome because it’s quick and definitive, but it’s also lazy if your goal is to improve your students.  On the other hand, corrective feedback is desirable but it’s labour-intensive and must be done carefully so as not to remove critical thinking from your student – you don’t want them to merely follow your instructions but instead you want to promote their thinking and reasoning through problems without your guidance.

Stay Awesome,

Ryan

Livestreaming For My Students

Last week, I tried a new tactic to engage with my students.  I was inspired by two workshops I attended during Conestoga’s annual E3 (Employees for Excellence in Education) Conference.  The first workshop covered how to write good assignment prompts, with clarity and purpose in mind, and the second covered strategies for writing for online courses.  In the course I manage online, my students were preparing to submit their first major philosophical paper, and historically my students do poorly on the writing side.  I largely attribute this to it being their first time trying to write a philosophical paper and their only exposure to this point was either essays in high school or non-philosophy essays for other courses in college.  After sitting in on these two workshops, I reflected on what I could do, in an online course, that would improve my student’s ability to write.  It’s challenging to engage with online students for two reasons:

  • first, you (almost) never meet your students face to face, so you lose the ability to use tone, voice, inflection, and body language to convey information, and
  • second, online courses are atemporal, which means you don’t engage with your students at the same time.

An idea I’ve been kicking around for some time is creating a video for my students as an added bit of content for the course.  The problem with this option is it’s still fairly static and easy for students to skip if they feel it doesn’t contribute to improving their assessments.  It also goes in one direction, where I speak at my camera rather than engaging with the students.

However, I’ve been mulling over another option.  I have borrowed a web camera from my podcasting partner, I have a good microphone, and I delivered a webinar with a live Q&A in the middle of May.  I considered running a livestream last semester, however when I offered the option to the students, I had no requests for it.  But this semester, I decided to set it up and run it, regardless if students attended or not.  At worst, it would be a wasted hour of my time.  However, the benefits would be two-fold: my students would have a chance to interact with me and ask me questions about their assignment, and it would give me practice with a new skill set.

I picked a date and time, figured out how to broadcast (in the end, I went with Twitch, but next time I’ll test out YouTube Live) and went for it.  I had 4-7 students drop in, which is fairly low engagement, however the questions were really good and I had a lot of fun actively engaging with students again.

One unfortunate thing was I didn’t set up the system to auto-record, so I don’t have a copy of the livestream to review or upload.  I ended up recording a second (static) video to cover the main points so that my students had something to reference when they were completing and submitting their essays this past weekend.

It was a good experience and I plan to run at least one livestream per semester moving forward.  I have yet to grade the papers, so I don’t know if I had a material impact on their performance, but in time I hope that my students will get better with the added direction I can give them.  I also now have a video that I can post to help them think through the process of writing a philosophical paper.  If nothing else, it’s good to build handy resources and have them available for your students.  My goal is to help my students improve their thinking and writing as a result of taking my course.  Even if their papers are 1% better as a result of my direction, it’s worth it.

Stay Awesome,

Ryan

“Give Business Card” As A Default Action

I had a strange realization last week.  I am now at a point in my career where I need to make “give business card” a default action for when I’m out and about, but not for the reason you may think.  Under normal circumstances, I feel it’s relatively rare that I have to give out a business card.  In most instances, my role has been too small and insignificant to warrant it, but also because I don’t really buy into the culture of swapping business cards with people in an effort to ‘network.’  I have been promoted to a new role, which entails more responsibility and autonomy when it comes to business meetings, but I’m still getting used to the idea of thinking of myself as an administrator or a manager.

Last week, I was in a coffee shop to grab a quick bite to eat before a meeting.  The cashier saw that I was wearing a jacket with our school’s logo, and he excitedly asked if I was a student or employee.  I let him know that I work at the college, and he asked in what area.  When he heard I work in the school of engineering, he proudly told me that he received multiple acceptances into our mechanical engineering diploma programs.  Since the coffee shop was dead, he then launched into a mini history of his background – he was born in east Africa, immigrated to the Middle East, did secondary school in the US, and now has his visa to study in Ontario.  He told me some of his education, that he had top marks in design in high school, and even has a portfolio.

His energy and enthusiasm was infectious, and he left a strong impression on me.  He sounds like a great kid, and I have no doubt that he will be successful in his studies.  I told him where he could find me on campus, and he said he’d find me in the future.

I realized as I was driving away that I had missed the perfect opportunity to give him my card and promise to follow-up if he had any questions.  I want to see him succeed, and if there was anything I could do to help, I’d gladly try.

Rather than seeing the business card as a way of helping myself, I should put more emphasis on seeing the business card as a way of helping others.

Stay Awesome,

Ryan

 

Grading Drift

I’ve been reflecting on the concept of grade drift recently. My brain usually turns to grade drifting at the end of each semester as I evaluate how objectively I have scored the students. If you’ve never taught before, what I call “grade drift” is the tendency for an instructor to allow their grading standards to drift as they grade an assignment. I’m not sure how prevalent this is for assessments that are concerned with exact answers, such as math, science, engineering, programming, etc. But in assessments that deal with qualitative or creative responses, it’s common for you as an instructor to change your evaluation thresholds as you make your way through the pile of papers.

There are a few reasons why this happens. In my first courses, my grades would drift if I didn’t have a sufficiently robust marking guide to help me narrow down the kinds of answers I was looking for in a student’s response. Now that I’ve taught the course a few times, I know generally what I’m looking for and can go through the assignments with a checklist of items. This form of grade drift is usually related to lacking experience in teaching and grading, especially if your course delivery isn’t tied to your course learning outcomes.

However, there is another reason why your grades might drift. On the one hand, you want to approach your evaluations as if they are objective – that there are clear right and wrong answers. After all, your grading should be defensible, and one way to defend the grade you grant is by pointing to an objective standard. However, on the other hand, you want your evaluations of your student’s work to allow for imagination, creativity, and novel connections between ideas. You also want your evaluations to acknowledge that your classes have unique compositions of people, with their own experiences and their own progressions through your course. Just because you teach the same material each semester doesn’t mean your students progress through it at the same rate. Different students will take the material differently, which means the average response you read through will be different for each cohort of students.

This means that some groups will be “better” than others in how they perform. You can choose to penalize the students for not meeting an abstract standard that you’ve set, or you can meet the students where they are and make it your goal in the course to improve their performance as you go.

I know that some instructors will take the first approach. They will believe their teaching, evaluations, and courses are reflective of an external, eternal, objective standard; they don’t think they are being arbitrary. I’m willing to bet that these are also instructors who believe that a 70% in their course is “like a 50% in other courses” (a literal thing I’ve heard said by a peer). I think this approach is wrong and it reflects a misunderstanding of what it means to pass a course. When a student passes a course, it means they have met the minimum requirements of the course learning objectives. Anything above that should reflect varying degrees of competence and mastery. If your course is designed so that a student is only “just” meeting the standards with anything above a 70%, you haven’t calibrated the course or your expectations very well. At an undergraduate level, your job is to elevate your students, and improve their abilities while meeting the program learning outcome objectives.

I find myself on the other side of this issue. I understand what the goals are of the course I teach, and my aim is less concerned with ensuring my students can adequately explain all the theory they are exposed to in the course. Instead, my goals is to make my students better thinkers and writers from where they enter my course to their exit. If they can explain Aristotle’s ideas of tragedy by the end, great! But I won’t lose sleep if they can’t. My course is a general elective, and that means I’m supposed to round them out as students and people. I care less about them absorbing my esoteric knowledge and instead I care more about them learning how to think, reason, and communicate their ideas clearly.

And that’s why sometimes my grades drift as I score the student’s rubrics. I start off with some ideas of where they could be, then I calibrate my grading to meet them at their level. It’s a little more work for me, but I think it better captures the student’s performance.

As indicated above, there are a few strategies for overcoming this, such as having a clear rubric and clear notes on what you are looking for.  Also, marking all the students on one question, one at a time, rather than marking an entire submission will make it easy to compare student fairly.

While this is an unfortunate thing (the students like to think they are being objectively evaluated) this will happen as you come to understand the natural curve of your class.  You can either grade your students to one standard, or you can reflexively respond to your class’s own knowledge and aptitudes.  If your course objectives are clear, then you can feel free to adapt your grading to match the student’s progress.

Stay Awesome,

Ryan

“Kids These Days” Part 2

Last week, I reflected on the grading process and the tendency for us as faculty to sometimes judge that a student’s performance is more tied to internal motivation issues rather than external issues and a lack of experience.  When you think of a cohort of students, you can group them into three categories – the group that “gets it” and performs well, the group that is motivated but has knowledge gaps, and the group that lacks the motivation to want to meet the course outcomes.  Of course, these are simplistic categories, but I think it’s a useful illustration of how faculty approach their class, because how we choose to define the middle category impacts how we think about students and their performance.  If you frame the discussion around a group of students who want to be helped (are motivated to succeed), then you are more likely to want to extend yourself to help the student.  However, if you frame the conversation around whether the student should bootstrap themselves to catch up, you might be less willing to take extenuating circumstances into account.

When we assume that students are the sole reason for their failure, it’s possible for us to close off other considerations that questions whether we are dealing with a level playing field.  I don’t mean to say that students should not be responsible for their performance (and by extension, failure).  We as teachers must hold students accountable to their performance.  Yet, when a student fails to meet an objective, we should ask ourselves a number of questions:

  • Was the assessment fair?
  • Was the assessment clearly communicated?
  • Should the student have worked “harder” or “smarter”?
  • Is there something I could have done to better prepare the student?
  • Was there factors that influenced the student’s performance?

It is this last bullet point I’d like to discuss, because I think there is something really interesting going on that we often miss.

Engineering programs share a common trait – the problems are hard and the only way you will get the material is by slogging through the practice problems.  Many of the concepts are difficult to master, and the only way you can see the internal logic is to grind through problems, get feedback, and understand where you go wrong so that you can fix your methodology.  Some students appear gifted and grasp concepts easier, but most engineers will tell you stories of how they spent huge chunks of their time on manual computation.

Setting aside discussions about learning styles, this way of learning how to be an engineer is a good reflection of how the brain works.  The brain really hasn’t changed much in the last few thousand years, and we haven’t found genuine shortcuts to get around this limitation.  Structured education, being the only systematic way that allows you to efficiently teach advanced concepts, is the best approach to bringing someone to proficiency.

BUT

Students aren’t just students.  They are also members of this cultural and historical epoch.  Outside of the classroom, their lives are informed by culture, technology, and social norms, and increasingly over the last several decades, culture and technology has prioritized reducing friction.  Technology and corporations are incentivized to innovate ways of reducing barriers in our lives.  The technologies and corporations that achieve this end up shaping culture.  We spend less time focusing on basic survival, sustenance, communication, and transportation, because technology, innovation, and scale has reduced the time and resources we need to devote to these tasks.

As an experiment, consider this: when was the last time you had to carry cash?  For the average person, you can go weeks without needing to go to a bank.  Almost everything in your life can be handled through banking cards, e-transfers, direct deposits, and apps that instantaneously resolve payment upon the completion of service.  These services are available to us because they make things frictionless (and this is good for corporations because it helps us spend more).

If you want to buy stuff, you order it online.  If you want entertainment, you can find it on-demand.  If you don’t know something, a search algorithm will sort and rank answers for you.  If you don’t know how to do something, video tutorials are freely available with a few keystrokes and clicks to walk you through it.

Life outside of the classroom is frictionless, and yet we are insulted when students expect their experience in the classroom to conform to every other experience they live through in their daily lives.  Students ask for shortcuts to mastering hard concepts because literally everything else in their life operates this way.  The surface level encounters they experience have been refined through intentionally designing the user-interface (UI) and user-experience (UX).  Students have little grasp of the underlying mechanisms that hold this up because they’ve never had to worry about it.  If something breaks, it is either repaired as a service, or we cast away the broken and move on with purchasing new.

I was an undergrad student in the mid-aughts, and when I look at what life is like for students now compared to when I was a freshman in the dorm, I am startled at how easy it was for me to be a student.  I didn’t have the distractions that students experience today.  My life was less guided by algorithms and the whims of corporations and technology.  You may argue that technology has put the world at student’s fingertips today, but I think that the signal-to-noise ratio has shifted from my time.  Yes, I had to work harder to get answers, but that’s because there was less distraction clogging my search.  And don’t get me started on the attention economy and designing to maximize user engagement…

When we dismiss performance as being the result of “kids these days” not valuing hard work, we miss the fact that there is no incentive for the kids to work hard when life has grown frictionless.  I personally now value friction, because I understand what friction does for the learning process.  Much in the same way that you have to introduce low level stress to the body (exercise) in order to promote health, the introduction of friction can be a good thing.  But without understanding the motivations and lived experiences of your students, your demand for frictioned lives reduces you down to an old person yelling at the clouds.

Stay Awesome,

Ryan

 

 

“Kids These Days” Part 1

At the time of writing, I’m assisting faculty with processing the grades and academic standings of students from the last academic year.  All of the grades for the Winter are in, but for the engineering degrees we are in the long, tedious process of reviewing all the grades and courses delivered over the last twelve months and making notes on ways the delivery can be improved for next year.  This is an important process for us to follow, not only for our continuous improvement requirements for accreditation, but also because it’s important to pause periodically and reflect on the reasons students perform they way they do – especially when they fail.

Because people have a tendancy to shift blame away from themselves, reviewing student failures can be challenging.  If you ask students why they fail, you’ll likely hear something that reflects courses that are too challenging, professors who are unreasonable, or circumstances they had no control over.  Faculty, on the other hand, think students are unwilling to put in the hard work needed to be successful.  The truth is likely somewhere in the middle.  In my opinion, I feel that faculty sometimes forget what it’s like to be a student, and I feel that students don’t see the bigger picture to help them understand how they should be prioritizing their work.

Despite the fact that students are legally adults when they come to school, we forget that the depth of their experience is often pretty shallow.  It’s the first time they are away from home, the first time they are having to manage their day-to-day lives, and often higher education is a large step-up in academic expectations compared to their secondary school experience.  I’ll chat a bit more about this next week, but I think the takeaway is that we often take for granted the experience we, as professors, draw upon to manage ourselves and our work, and instead we shake our heads when the students perform poorly in their work and seem to ignore the opportunities we extend them for extra support (office hours, anyone?).

A valuable skill faculty need to develop and practice is empathy for students.  We as faculty have a responsibility to both apply high expectations to the students, but also be willing to place ourselves in their shoes and see the world as they do – a world where everything seems important, everything is competing for their attention, and crucially, students think everything carries dire consequences.

Stay Awesome,

Ryan