Video: Liquid Margins 004 | Experimenting on the Margins: Annotating Science (DocDrop)

00:00:09

uh good morning to those of you who are here welcome and it looks like people are still filing in i see that number going up so uh my name is franny and um

00:00:22

i'm your host of liquid margins welcome to the fourth episode of liquid margins today it's called experimenting on the margins annotating science i'd like to introduce

00:00:36

our guests now we have allison kolazar from colgate and jennifer blake mahmood from also from colgate university

00:00:48

and then jeremy dean not from colgate university but from hypothesis and with that i'm going to let jeremy take it away thanks hi everybody i'm super excited to be

00:01:05

part of this conversation um my parents work at the national institutes of health i have a brother who is a phd in neuroscience a sister is an md

00:01:17

and uh she's worked in an emergency room at mass general my little brother majored in chemistry in college and my wife is a phd in uh animal behavior uh but i

00:01:30

am a phd in english i'm a humanist um and so i'm out of my league here i'm uh you know i come from a discipline where close reading of text um is you know the foundation of the

00:01:43

discipline of english and literary studies um and so i've oh and i've always been interested in impressing my parents and siblings and wife about how a annotation could be used

00:01:54

outside of the sort of traditional you know uh area of uh you know annotation and close reading um and so i want to start by asking the panelists sort of that like you know how is

00:02:06

annotation not just for the human for the humanities right because and i get that question from a lot of institutions as well um why is annotation why is reading why is close reading um

00:02:19

important uh in the sciences as well and maybe we can start uh with you jennifer so i think that a lot of times people come into science thinking oh we get to be independent and we get to just do our

00:02:34

own thing and i think that's often the perception of students as well but that's not really how it works right so collaboration around text is something that happens in

00:02:47

lab group settings um it happens informally uh over lunch and over coffee right so we're used to reading papers and gaining information in that way

00:02:59

reading the the science of our uh of our field and then talking about it with others and i would say that texts are foundationally important for what i do as an ecologist and plant biologist

00:03:13

that's super interesting jennifer i especially like how you started off with saying you know people think they can do their own thing in science and i i certainly frame it the same way when i talk about uh annotation in the humanities right it's not just it's there's

00:03:25

there's a conversation that precedes you right um and no construction of knowledge can uh can begin without some attention to that conversation that proceeds and engaging with that conversation that precedes you so especially like that piece of what you said

00:03:37

alison you have anything further to add yeah i absolutely agree with jennifer that that it's science is very much collaborative um and i think that annotation collaborative annotation is a really great way to show

00:03:50

that to students um to show the the collaborative nature of this um i also think it's just absolutely wonderful for um i guess demonstrating to students how the the it's totally normal to sit down

00:04:03

with something to sit down with a scientific paper and to have that discomfort of i have no idea what this is about um and that discomfort is normal and and that's how it's supposed to be when you're reading a new paper otherwise there wouldn't be a reason to read it if

00:04:15

you already knew everything and so i love being able to use the collaborative annotation process as a way of showing students making that confusion visible but then also using it as a way to collectively

00:04:28

work through that confusion but it's okay to have that discomfort and here's how we can work through it here's how we can get stuck on something and not understand a concept and and that that process of working through it and making sense of it that's

00:04:40

normally very invisible and very solitary i love how this sort of allows us to to do that collaboratively or collectively wow we're going to steal some of the lines from that

00:04:52

response for our marketing materials i love the uh making confusion visible um working through that confusion this idea that you're uh you know you're not alone it's not necessarily a solitary uh practice um

00:05:04

let's let's dig in there a little bit um because you know part of what i you know we do in the humanities when we're close reading and annotating um is developing certain literary literacy skills

00:05:16

right so uh if i'm teaching a poem i'm going to be asking students to really break down the component parts of that poem understand the devices and concepts and illusions that might go into

00:05:29

um into the creation of this work of art um and so in the sciences and maybe we can start with you and go the other way this time allison you know what are the you know where does the confusion come up what types of you know what is what is that what are

00:05:42

the objects or the artifacts within a document um where confusion comes up and where certain literacies need to be developed for um for students that are you know entering college-level science uh courses yeah i think that

00:05:56

honestly the the most obvious answer here but the one that really comes up a lot is jargon right there's we you can call it jargon you can call it terminology um it's the the it's really common in

00:06:07

scientific literature um and even in in the sort of pop science articles i use a lot of those at um at sort of intro level courses it's really common for students to for any reader to stumble across something that you just you don't have

00:06:19

the background knowledge this isn't something you're familiar with um and so it's it's i think really helpful to um be able to annotate through that jargon um and to indicate how you where you found

00:06:31

your information when i have um when i ask students to make those types of annotations i always have them cite the source for where they got the information and so it's also a way of showing the using your external resources but then also in science it's always important

00:06:44

that you you cite your sources so students are citing sources and annotations yes they have to if they're if they're adding they're adding information to an annotation that comes from elsewhere that's not just their personal knowledge

00:06:56

they have to indicate where that information came from it doesn't have to be a formal citation but a link or something like that but so they're sort of uh practicing scientific literacy and performing

00:07:08

scientific literacy simultaneously that's that's cool um jennifer anything to add here about sort of what is it that we're annotating in the sciences what kind of literacies are we developing

00:07:19

so one of the things that i add or some kind of meta textual information about what's actually being done in the paper at the different points so sometimes when you read a paper uh in science it can be practically

00:07:33

unintelligible right and it seems like there may not be method to the madness so trying to call out to students okay you know this is what they're doing here they're trying to set the stage or they're trying to highlight gaps in

00:07:45

knowledge information like that i also use a hypothesis to provide encouragement along the way because there are some parts of the paper where you read through it and you think oh my

00:07:58

gosh that was horrible right like that made no sense whatsoever so uh i will seed annotations with like i know this is confusing skim this keep going you know or read for the big

00:08:11

picture here and keep going because i think there are some students who get to those really tough places and they do one of two things they either double down and they spend 45 minutes reading two

00:08:24

paragraphs which is not helping them or they get to that spot and they think oh my gosh this is horrible i'm done and neither one of those are helping us kind of practice the process of science

00:08:36

so just kind of encouraging them to get through the tough places i think has been helpful so what are we actually annotating here what are we attaching hypothesis to in your courses what types of documents

00:08:52

jennifer let's start with you what are students actually annotating it depends on what type of course i'm teaching so for upper level courses like juniors or seniors uh we're actually annotating peer-reviewed

00:09:05

literature um when i taught a freshman level course that's supposed to be interdisciplinary um in what's called our core program we were i think we did one scientific

00:09:18

paper there we were reading other things sometimes chapters out of books sometimes pop science sometimes news articles and i use hypothesis for anything that i thought the students would need some

00:09:29

extra support for whether that be encouragement from their peers or things that might be a little bit confusing what about you allison what are they actually annotating many of the the same types of

00:09:43

readings that jennifer has listed here um so scientific articles um and and as she said you know i think that the with scientific articles and upper level courses it's incredibly helpful for helping students work through the how do we read one of these papers

00:09:56

um but also at the at the the intro level courses it's really helps to make them more accessible by preceding them i also often use news articles and pop science articles that are some

00:10:10

application of whatever technical details we were learning that week a way that an environmental issue is coming up in the news an editorial something like that um this semester so this isn't something i've done yet but i'm really excited to um this fall

00:10:22

semester i'm going to be using an open access textbook and so i plan to since we'll be teaching remotely since i'll be teaching remotely i'm actually hoping to to use the annotations to deliver a lot of the

00:10:35

asynchronous course content and so much of the course content will be living in the margins um so i'll be annotating with the information that i would normally be providing in a lecture so links to videos of demos me doing demos

00:10:47

explanations of things links to other sources places where they can watch a short visualization of something so the textbook piece will be new to me this semester but i'm excited about that i've also used use this for governmental

00:11:00

reports like the ipcc reports the intergovernmental panel on climate change helping students work through those watching students work through those i keep saying helping students but really in many cases it's not me helping them

00:11:12

it's them working through it together with each other well that's cool i like the idea of annotating uh government reports uh with students um i want to just follow up on that allison because i think you know maybe you know people in the

00:11:26

margins of the of the uh video uh conferencing here in the chat uh might have annotations to add to the conversation i don't know if people can unmute but um this idea and first of all what textbook do you know what textbooks are

00:11:39

using what the source is because um you know people might find that interesting if they're interested in bringing in open textbooks open resources and uh following this lead but you kind of made a shift there right because

00:11:51

previously we've been talking about student annotation and this new assignment you're thinking of is instructor instructional annotation preceding uh you know preceded into a textbook or content

00:12:03

before the students arrive which sounds like a brilliant idea what textbook are you using um and maybe talk a little bit more about the kinds of content you're thinking about inserting in there to guide

00:12:14

students as they encounter this text yeah so um the the course that i'll be teaching this fall is a course called sustainable earth and it's an intro level geology course and it's um to be honest finding a good textbook for this course is something

00:12:28

that i've struggled with for a couple of years here now because it's sort of an environmental geology course but it has um also a lot of the sustainability emphasis that's not always covered in those textbooks so i've often had to cobble together

00:12:40

a couple of different resources um and for better or for worse that's that's actually going to work pretty well here by doing an open access textbook i'm pulling chapters from a couple of different ones um and so some of those are physical

00:12:53

geology textbooks in the beginning of the semester where we talk about setting the stage earth's cycles plate tectonics how that drives climate um i'll be using more sort of traditional physical geology textbooks for that but

00:13:05

then moving more into the sustainability side of things and some a number of different sustainability textbooks so um sorry this is a long answer to a short question not just one textbook um but by doing it this way i can sort

00:13:18

of pull chapters from a variety of different ones and you anticipate going in and helping uh you know like elucidate a concept with a video that kind of thing yeah so normally um

00:13:30

you know in a traditional teaching face-to-face setting there would be some technical reading before class and then and then in class time i would be talking about these concepts in more detail and and i always have students do

00:13:42

something in class it's not just me talking about stuff and so they would be doing hands-on demos we'd be looking at short video clips we'd be talking through stuff together they'd be pouring over a big piece of paper and sketching stuff out together

00:13:55

um and so the the prompts for those types of things i'm hoping to have them live in the annotations and the little as you're reading through a section the piece that i would talk about in class instead i'll put in an annotation

00:14:07

with a little video of me talking about that or like i said doing some demo and showing something or a link to another resource um to to sort of supplement that in animation or something like that very cool and i'm seeing something in the chat

00:14:20

that i kind of want to bring in here you're talking about creating multimedia annotations for your students in the margins of your textbooks that's awesome um do either of you ever use ask students to do anything besides write with text i

00:14:31

mean you mentioned links alison but jennifer have you ever thought about images or video or do students use images or video or links in different ways and annotations for your uh

00:14:43

course well they're a pretty tech savvy bunch so some of them figure out along the way that you know they can do a lot more than just write so in the past i haven't explicitly asked them to use multimedia

00:14:57

but i think i will be talking it up more this coming fall to encourage them to do that because we do a lot of things in the course that are image based and i think this would be a way to connect back to some of that other content

00:15:10

as well as other things that they're running into anything to build on that alice and you touch upon this a little bit but do you ever have students explicitly use images and video in their annotations or see them doing it naturally themselves

00:15:23

i've encouraged them to do so and every so often a student will throw in an annotation with sometimes a song or i've had a student throw in like a music video that had something that was that was tangentially related and

00:15:36

i just really love the idea as we're reading through things of going down wormholes frankly um and i really encourage students to do that in their annotations i think that it it's um i think that there's this uh

00:15:48

tendency to kind of compartmentalize science right science with sort of capital s to compartmentalize it and not see the applications of it and so i really love it when students use annotations not just with text but

00:15:59

with multimedia to really find these different connections and find these different wormholes i've had some students that have annotated with memes which has always been enjoyable as well well that's so awesome i love this idea

00:16:11

of like go you know going down a wormhole and almost making that like an explicit instruction like find a wormhole in this article and and go down it you know some create a meme for it or find some pop culture reference to

00:16:24

to the concept you know i i thought about uh that we should be playing that they might be giant song science as real as the at the beginning of this little podcast whatever we call this the show i think is what we call it internally um

00:16:37

i i'd be remiss if i didn't give a shout out to my wife here in this conversation a multimedia annotation because she uh long ago when i was working at rap genius uh with collaboration and experimenting with the science classroom she had students annotating

00:16:49

academic science articles and i'm going to drop in a link to a an assignment she wrote a long time ago um that was for genius and sort of has been divorced of its uh the specificity of the tool and also the specific specificity that this originated in

00:17:02

science but she had soon zentained scientific articles and she's a expert in frog song so she had students annotating an article um about uh you know frog localizations

00:17:13

um and you know part of what the students did and i i think it was built into the assignment was to um uh uh you know add images of the frog right or

00:17:26

the youtube videos of the frog song and i remember the funny story from that anecdote is that at some point somebody found uh the the frog song the frog calls remix to like panamanian discotheque

00:17:38

music because it was a you know panamanian frog um so anyway that kind of stuff i don't mean to it sort of brings the brings the text to life and brings science to life in in certain ways i think

00:17:48

um but i love that idea of of wormholes um could you each talk about how you introduce uh you know an annotation assignment i'm a student in your course

00:18:02

um i have a reading and do you give students either at the beginning of the course to talk about uh the role of hypothesis generally or you could think about a specific like when i do this particular article these are the you know this is the

00:18:15

prompt can you talk get sort of drill down into how you introduce students annotations or um a particular annotation activity uh that you've uh had students uh perform

00:18:27

and let's start with jennifer since allison talked less so um i actually start with an activity that i believe i stole from allison which is i have them annotate my syllabus so

00:18:40

um i give them a syllabus and i say you know we're going to be using this annotation software um throughout the semester so please go and check it out and annotate the syllabus you know make some comments just so they

00:18:54

have a low stakes way of experimenting with things and seeing seeing what it's like um and then from there we start going into annotating annotating papers but

00:19:06

it is it's something that i kind of frame as part of a larger building of a scholarly community within the course so i try to have a lot of inter interdependent work that happens um

00:19:20

and build in community there not just via group projects right like okay there's one group project that you have to do during the course of the semester but really building a community of scholarships so i talk about

00:19:33

annotation as being part of how we do that that's great and of course we have uh scholars and scientists outside of uh formal

00:19:45

uh you know teaching contests that are using hypothesis for lab groups and for collaboration uh across uh you know scientific uh publications allison anything to add here

00:19:57

uh well i'll just i'll say here that um the annotating the syllabus i stole that idea from someone else i think that was a uh remy clear has a great um great writing online about that and um so that wasn't that wasn't

00:20:09

something that i came up with my own um but i really also love that and i start every semester with that with annotating the syllabus um and uh as jennifer said i think it's a great sort of entry into the the process of annotation

00:20:21

i also really like it because students flag things on the syllabus that are either if there's any sources of confusion on there but but more interestingly to me is when they flag things that are interesting to them topics that they're already a little bit

00:20:34

invested in or topics that relate to again the wormholes right they're pulling in other courses that they've taken things that this reminds me of something else that i've seen and so i love being able to have that at the beginning of the

00:20:46

semester because then i can kind of view i know which topics they're already invested in um and so building from those syllabus annotations has been really helpful with then um kind of not necessarily choosing the topics but choosing the direction

00:20:58

that we might go with some of the topics based on um comments that they've made i want to double down on my question though because i love the annotation the syllabus assignment but you know what am i what are you asking students to do

00:21:12

are there things you're asking them to look for when you're reading scientific literature whether it's pop or scholarly um you know what practices are they meant to be in acting how are they supposed to ask questions

00:21:24

are they supposed to define terms what kind of direction do you give them in terms of like what am i supposed to do with the annotations this is a cool tool i like being able to comment on the syllabus what am i actually supposed to be doing when i'm reading this article and

00:21:38

writing annotations that you may or may not be grading um uh alison let's start with you okay yeah so so you asked you know were they supposed to write questions are they supposed to the answer to all of those is yes they i encourage them to do all of those things

00:21:50

i the the guidance that i give i give them a couple of examples um of of annotations from other courses from previous previous annotations um but i encourage them to an annotation should

00:22:02

just add it should add something substantive it should be additive it should be constructive it should be substantive it should be additive it should be whichever of these modifiers you'd like to use um and so that can often be a explanation

00:22:14

of here's a word i didn't know what it meant here's a link i found it or this was interesting to me and i wanted to know more about it i went here um it's it's it's sort of it's adding content

00:22:25

um in any way that they feel is additive i guess that's a little recursive sorry no that's great jennifer anything do you define additive in any way

00:22:37

or direct what additive means in any way or do you have another way that you prompt students in terms of what am i supposed to do uh professor in my annotations on this reading so i agree that the the answer to your

00:22:49

question was yes all of the above um i tell them that i'm looking for something that shows me they have meaningfully engaged with the text so for some students who want to check

00:23:01

boxes this can be frustrating right because it's like well what do you want um but i think one of the strengths of the annotation software is that there are multiple ways to approach this and to be

00:23:12

successful um in the annotation right there's not just one way to do it and that they can do a variety of things right and they don't have to do the same thing every time right like if they

00:23:25

if they're primarily a question asker on one text they can be a question answer on the next right it doesn't mean that they have to play a specific role the entire time so like allison i give them examples right and then in class um

00:23:39

if we meet face to face then i will pull out questions or points of confusion or really good observations that were made uh in the margins and then talk about that in the class

00:23:51

if you're all online then i try to come back after the fact and make some comments about things that students have written but i do try to wait a little bit on that so i will often precede an annotation but

00:24:05

then i will let the conversation kind of evolve because i don't want it to be here are these interesting things that people have said and then i as the professor come in oh yeah great here look at this check this out right i want the students to actually be having that conversation

00:24:18

amongst themselves so i will give them you know sometimes a couple of days sometimes you know over a week before i come back in to kind of mop up and resolve any any issues that might be

00:24:30

still lingering there i love that um well i don't know if either of you have sort of something that you were hoping to share that i haven't been able to draw out with a question or

00:24:46

if uh franny has seen anything in the margin of the video chat that uh that we want to surface here for the group um i think this is amazing it's been amazing conversation and provides a lot of you know

00:24:59

help to folks who might be starting with an annotation in the science classroom um any friend is there anything you want to bring out there's a recent question how do you get students to return to the annotated text later to see what others have added i

00:25:11

think that's an interesting question to ask um allison if you want to start sure yeah so that was that was actually uh one other thing that i i i think is always interesting when i

00:25:23

hear about other people using hypothesis um i i like to hear you know what they have the students doing but then also like what do you do with what the students do what do you do with the annotations after they're there and you know jennifer just talked about sort of coming in afterwards and i

00:25:36

like the idea of the the mop up afterwards um but one of the courses that i taught this past semester um it was a small course and so what i would do is their annotations at the end of the week

00:25:47

um friday's class was basically going through a usually a pop science article some application and using their annotations to kind of guide the story arc of our class so working our way through the article with the the story arc created by

00:26:01

their annotations um and so with that i would have the document pulled up in class and we would work through them together and so in that case the students were returning to the annotations collectively all of us together and then

00:26:15

at the end of the semester because we were surprisingly online and um i wanted to do something very different for the final exam i like the idea of a finale rather than a final and so i had them return to their

00:26:28

annotations um to each annotated article for their final exam and find an annotation and respond to it in such a way to demonstrate how their how their understanding of something has evolved over the course of the semester and so

00:26:41

um in that case they were returning to the annotations at the end of the semester and going through all of them that way cool and before jennifer jumps in on talking about how to you know bring students back to the uh to the text i will say

00:26:56

thanks to anna for asking a question in the q a part of the uh zoom that's a great place to surface because you know nate is in the chat talking about mickey mouse which is distracting me so if you really have a question for the panelists

00:27:08

um you might put it in the q a and then that'll be easier for us to surface it uh jennifer any strategies um for bringing students back to the text

00:27:19

so when we made the pivot to online i explicitly asked them to go back and re-engage with a couple of questions that i had flagged so after students would read the text before

00:27:32

class uh i would go in and i would mark questions that i thought were especially provocative ones for which there's not a clear answer right um that people could really go back and

00:27:45

forth on so then i marked those and then the students were um asked to come back in and you know pick two questions and kind of follow up with those uh another thing that i did with these

00:27:57

to kind of encourage students to to go back and read the annotations was that students were responsible for being kind of in charge of a paper right so presenting that in some way to their peers helping lead discussions

00:28:10

and they were instructed to use the annotations so as a group we decided when the annotations would be due right so you should be completed by you know 5 p.m the night before and this would kind of be like a brain

00:28:22

trust for the students who were presenting and they could rely on those annotations for the discussion questions if they needed to or for understanding the paper so that there was kind of this iterative process because i agree that i think it

00:28:35

is hard especially for the students who are maybe really quick to go in and annotate you know you don't want them to always just be the first person and the first voice right you want them to be able to come back

00:28:48

and see what's going on and what has developed since they read it oh that's great thank you um we have a couple more let me just follow up on that real quick with jennifer for a second franny um so jennifer you mentioned this a

00:29:02

couple times i'm just going to be a literary snob for just a minute and needle you and this is a straw man thing but i want you to uh sort of perform this for our listeners um you've mentioned conversation or discussion or debate

00:29:14

right and a couple times and sort of students going back and forth and and debating something and you know so obviously that happens in art and in literature like why does that happen in science and what

00:29:26

context does that happen in science right i mean it's science right you should wear a mask that stops the virus right end of conversation there shouldn't be a debate like so like what what if what are folks going back and forth about what is that debate discussion

00:29:38

talk to me about the discursive aspect of reading scientific literature so that's a great question we actually debate things all the time in science and um

00:29:50

i was talking earlier about kind of meta reading of text and i think that this is a lot of what happens in the introduction of papers so in higher level courses i talk about this explicitly right that we have this

00:30:03

conversation between what has happened historically what are the different ideas about why something happens or how it happens right and you have you know this view that says it works like this and another view

00:30:16

came came along and we said no no it works this other way and this kind of back and forth is really integral to the process of how we do science so i think talking more about that um is

00:30:28

important is important in the classroom because i think that a lot of people do have this idea right that you said that you know it just is right science just is but it really is this long conversation over time

00:30:41

it is um it is truly a process um i think i think it was carl sagan who said that science is a way of thinking um much more than is a body of knowledge so trying to model that thinking

00:30:55

in the margins i think is an important thing for our students that's awesome allison anything to add there no i think that i think jennifer summed it up really well you don't want to

00:31:08

upstage carl sagan no i don't i'm not gonna nope not gonna not gonna try that one uh franny sorry to interrupt you before but i i sensed an opportunity to have an interesting conversation there about that no problem at all no i'm always for that

00:31:20

and we do have a couple more questions and we have a bit more time so um i want to get to those um and thank you to those of you who actually answer other people's questions that's great

00:31:32

um can you talk about your assessment process for annotation assignments do you give students a rubric for number and quality of annotations

00:31:46

so um i do not give a rubric because i don't really want box checking um right like okay i asked a question i defined a word i'm done um but i do try to do

00:31:58

to give a variety of um of feedback and grades on annotations so uh to begin with i just had if they didn't if they only did like one annotation that was not really worth

00:32:12

much um they didn't get a lot of credit for that now i'm i'm starting to make that a pretty low a low grade but something there because zeros can really bring down averages

00:32:25

right so i pretty much have like a check plus check check minus type of system that corresponds to numbers um and ideas if you go in and you do kind of you know a mediocre job but

00:32:36

you've engaged with the text you know that would be the equivalent of a check if you've really like obviously done some deep thinking about things or pulled out some important parts then i give that a a check plus and if

00:32:49

you clearly did not have enough time but you did try and you put an annotation or two you know that would be a check minus and i found that that gives room for improvement for students but also tries to um reward you know engaging even just a

00:33:03

little bit which i think is important especially with covet and all the things that can be going on in students lives i so i um i struggled with the same same types of things um and jeremy you

00:33:19

referenced the the flybys right the students who just come in annotate and then never look at it again and and you know jennifer you talked about the box checking in the first i think the first year or two that i used hypothesis i had given them a recommended number of

00:33:31

annotations per week maybe three or five what i call meaningful annotations and i found that that led to a lot of box checking and flybys and so the past year i've removed the number of recommended annotations i have

00:33:44

still given them a rubric but the rubric instead is of how to demonstrate meaningful engagement with the text right so um it may be that somebody only puts in one or two annotations but it's really obvious in those annotations that they

00:33:56

have meaningfully engaged with this text this person in this text they have bonded they have had deep thoughts about it they've grappled with it and they show that um and sometimes maybe the the annotations don't do quite such a deep

00:34:08

dive but the student does sort of more more coverage of the text and annotates in many different ways um and so i i do still give them a rubric but it's more qualitative in showing

00:34:20

that meaningful engagement and then in the first two or three weeks i give them very very detailed feedback on their annotations and on the grade that they received as a way to to hopefully set the bar high and give them something to strive

00:34:32

for that's great thanks i like that quality over quantity um so um there's a couple more questions i really like this one um it's about visiting annotators

00:34:48

so do you have ever have anyone like say the author of an article come in and annotate their own article or that could be an article that you wrote as well

00:34:59

you know that you're annotating i have not but that sounds like a great idea uh i would love to do that so i'll put that on my to-do list for the fall because i think that could be really

00:35:13

uh really meaningful for folks yeah sounds great thank you i agree that's not something i've done yet but i really i do like the idea of that i think it's um it's a really that'd be awesome yeah yeah good luck getting carl sagan into

00:35:27

uh colgate moodle but uh outside the lms certainly that's a very cool idea yeah really neat um okay and then let's see um

00:35:39

so is there an ideal group size for annotations that balances active engagement by individuals with critical mass and range of perspectives so i've used hypothesis in classes as

00:36:00

small as it was an independent study with two students um uh and then i had a small course this past semester with six students and i've used it up to courses that had 25 or 26 students honestly i really loved the way that it played out in the six person

00:36:13

class last semester um the students were they knew each other well by the end of the semester there was a lot of dialogue happening a lot of conversation um and and i really liked that a lot um but i haven't always had the luxury

00:36:26

of being able to do that and um i found that even with 25 or 26 students um it's i still feel like there's meaningful engagement that's happening there and meaningful interactions between them

00:36:40

i've done this with small groups of about 10 or 11 um maybe up to 12 i'm considering splitting it in half because i think that'll promote more accountability

00:36:53

and then maybe shuffling those groups halfway through the semester so that people can work with different folks um but we'll see i haven't i haven't yet uh worked all that out logistically

00:37:08

okay um great and then i think this question we did talk about it but it keeps coming up so maybe we should talk about it a little bit more when assigning primary literature do you have them annotate the html or the pdf

00:37:21

version or does it matter i've always preferred to go with pdfs just because i've had too many issues with html with links breaking you know we set up everything at the beginning of the semester and then by week 14 of the semester something has

00:37:36

moved something has changed and so i prefer to use pdfs for that reason but i um i used to host the pdfs online but now with the lms integration i host the pdfs on moodle

00:37:46

and have it run through there same here i do the pdfs okay great um and we still have a little bit of time does anybody have any other

00:38:02

questions um including uh our hypothesis people here today jeremy and nate and i suppose if i could think of a an intelligent question right now i

00:38:14

would ask one myself i did want to address sorry this is nate jumping in i did want to address one uh question that came in a lot earlier or it was really an idea and a suggestion

00:38:27

which was that it would be great if there were a collection of annotation assignments and exercises and practices um the person who put it in uh suggested in biology

00:38:39

but i just i answered in chat but i wanted to make it clear that um we see this as a real need and so hypothesis is kind of in the final stages of preparing a way to collect annotation practices across all the disciplines

00:38:51

but then also be able to view and sort them by discipline and so because you registered for this webinar we'll send you an email that is if you don't mind us sending you an email about uh when that collection uh is

00:39:05

ready and so we'll both invite you to to populate it with your ideas as well as you'll be able to browse and search other people's ideas so that's that's coming up and i just want to add that if there are folks here

00:39:17

who don't yet haven't gotten started with hypothesis yet uh and are you know interested in using hypothesis this fall please reach out to us at education at hypothesis and

00:39:29

we can help you get set up um there may be a bit of a process if we're working to get it into your uh lms at your school but we are offering a free pilot of the lms integration through um the end of the

00:39:42

of the calendar year so it's a great opportunity for you and your colleagues and your institution to to get involved in exploring hypothesis and collaborative annotation for teaching and learning i also just want to give a quick shout

00:39:54

out to my mom and dad um and my brothers and sisters again they're all scientists and so i'll probably send them the link to this at some point i just want to say hi mom i just want to say this has been such a great show and

00:40:07

thank you to our guests thank you to everyone who attended and to jeremy dean and nate angel