Information Literacy Program Assessment

The SC4 Library Information Literacy Program

"Information literacy is the set of integrated abilities encompassing the reflective discovery of information, the understanding of how information is produced and valued, and the use of information in creating new knowledge and participating ethically in communities of learning." Framework for Information Literacy for Higher Education 2015, American Library Association, American College & Research Libraries Association

In 2015, ACRL adopted the  Framework for Information Literacy in Higher Education focusing on six threshold concepts to serve as "passageways or portals to enlarged understanding or ways of thinking and practicing within that discipline." (If interested, see "Before the Framework" at the bottom of this page.)

The reference librarians at SC4  incorporated the Framework into the Information Literacy program in 2018-19 with the following student learning outcome:

Assessment of the 2018-19 Library English 101 IL Program

Since it’s revision in 2015, the SC4 reference staff has incorporated the Association of College and Research Libraries Framework for Information Literacy for Higher Education (www.ala.org/acrl/standards/ilframework) concepts into the SC4 Library information literacy program to maximize student success. Using the Framework as a guideline, the librarians at SC4 adopted the following IL outcome for the ENG 101 information literacy program:

Students will be able to find and critically evaluate sources

for relevance and accuracy and use them ethically.

Shown on the following pages is a reflective evaluation of the 2018-2019 SC4 library information literacy program. Also included are statistics and the scoring distribution of participating students in the English 101 information literacy (IL) program for this past academic year. 

The statistics show the number of ENG 101 information literacy classes remained the same as the previous year, but the number of online sessions increased from nine to 14. Also, the number of non-ENG 101 IL sessions increased; The total number of students attending an IL session this past academic year (1,564) increased over the previous year (1,523) despite a drop in enrollment.

Number of students attending library IL class 2018-19

During the IL classes, the reference librarians conducted pre- and post-IL class quizzes using individual response devices, or clickers.  The results demonstrate that after attending the IL class, students were better able to critically and effectively evaluate sources for relevance and usefulness and use them ethically. Students also improved the following skills:

• Recognizing the need to evaluate all sources critically;
• Identifying characteristics of a scholarly journal versus a general magazine;
• Using Boolean operators and other techniques to refine their searches; and
• Recognizing the need to cite direct quotes and paraphrased material.
• Identifying the elements of the citation.

Action plans for 2019-20 Information Literacy Program to improve student success:

• Continue to incorporate concepts of the ACRL Framework into the ENG 102 and discipline specific IL classes.  Understanding the concepts may help students think more critically about the sources they are using.
• Continue to work with faculty to help incorporate IL Gen. Ed. Competency Outcomes into curriculum.
• Increase participation in ENG 101 IL attendance.
• Revise LibWizard online ENG 101 IL program.

Strive to meet the proficiencies proposed by the ACRL Standards for Proficiencies for Assessment Librarians and Coordinators (www.ala.org/acrl/standards/assessment_proficiencies).

Comparative Results - ENG 101 Information Literacy 2018-2019

Classes conducted by Jane Lewandoski – Fall & Winter Combined

Evaluating two articles

Both face-to-face (f2f) and online students are required to complete questions evaluating two given sources. Face-to-face students were directed to a library website which linked to two, and answer the following questions.

Students in the online ENG 101 classes were asked to compare the same two linked sources and answer the following questions.

Consider your answer with the following questions.

• Why did do you think your selection(s) were more authoritative?
• Was one article biased in any way?
• What about the authors? 
• Would you use the other source(s) in a different way / for a different purpose?

Although both articles point to human involvement in contributing to climate change, the NASA article “Climate Change: How Do We Know? Facts” provides scientific evidence of all of the causes of climate change. After attending the IL class, the majority of students chose the NASA article as the more authoritative source.

Most students were able to recognize the NASA website as being more authoritative as shown below.

• I chose Climate Change: How Do We Know? Facts because it is written by NASA which is a very reliable source. NASA is a well-known organization that can be well trusted. This article seems to have a lot of scientific evidence to support what it is saying. I would not use the second source in any way. I do not see an author listed on the main page and at the bottom it seems like many different people just submitting their own views. The topic is under the section spirituality>personal growth which doesn't seem very factual or based on any evidence.
• The author is NASA and so their evidence it factual and researched whereas the other article can be researched it will also have more opinions. NASA is a federally funded organization whereas the other is not.
• This article has more facts and evidence than giving causes as in the other article.   Yes, the other article could be more used for Cause and solution to climate change research.
• Provides all citation information and has a credible author (NASA). I would use the other source to gain insight and ideas, however not to get factual information and quote it.

On the other hand, there were still some answers such as the following which indicates helping students learn how to evaluate sources is an ongoing process.

• I chose the first source as being more authoritative because it presented more facts, more reasoning, and is written by science editors for Nasa. I would still incorporate the other source because in high school my English teachers always wanted us to use as many sources as possible to make our writing as plausible as possible
• It makes a statement as a title instead of a question mark

More on Evaluating Sources of Information

Classes conducted by Jane Lewandoski – Fall & Winter Combined

Determining Bias

During the on campus information literacy class, students are asked which of the following statements seems more authoritative. Most students correctly choose the one citing the Lancet Psychiatry, a British medical journal (see chart below).

After asking the question, a discussion of what makes the third choice sound more trustworthy followed in class, and how students could find the primary source of information for the newspaper article.

Identifying Potentially Biased Sources

Only 58% of ENG 101 students felt the need to evaluate materials from all content sources before the ENG 101 IL class. After the class, 97% correctly recognized the need to evaluate all sources regardless of where they were found.

Recognizing the importance of peer-reviewed materials

Less than half of ENG 101 students recognized the importance of peer reviewed sources before attending an ENG 101 IL class. After the class, over 90% understood the importance of peer reviewed journals for research papers after the IL class as shown below.

Using Boolean Operators

Slightly over half the students were aware of Boolean operators before the IL class. After, over 90% of students understood the meaning of the AND Boolean operator.

Citing Paraphrased Material

More students understood the importance of citing paraphrased sources after the IL class.

Identifying Elements of an MLA Citation

Most students were not able to identify the title of the journal from an MLA 8th edition citation before the IL class: After IL class, over 85% of the students were able to identify the title of the journal.

Student Comments on the ENG 101 Library Information Literacy Program 2018-19

Classes conducted by Jane Lewandoski – Fall & Winter Combined

After completing the on campus and online ENG 101 information literacy assignment, students are given the opportunity to provide anonymous comments on the program. Almost all students participate. Representative comments from students who attended Jane’s classes are given.

What is the most valuable piece of information you learned during the orientation? (On-campus responses)

• Knowing that the online library services are on 24/7.
• Not “most valuable” but fun – RFID clickers 
• How to tell if a source is reliable or not.
• The MLA format to citing information.
• The most valuable piece of information I learned was the Boolean search. I learned “and” is more effective.
• How to properly research information on the internet to find exactly what I am looking for.
• The most valuable piece of information I learned was the searching techniques.
• How to refine searches using Boolean, “”, and ()
• I learned that the SC4 library is very helpful especially the online version. I ever knew I can look up articles on this site for my papers. Also, the library chat box is open for questions which I didn’t know of at any time of the day.
• How to use MLA format.
• There are tons of ways to find a source for a paper.
• How to effectively use a database to find what I need.
• The difference between a magazine and a news article.
• How to cite and use “AND” and “OR”
• How to use words when searching for info that will give you more specific results.
• The library can help 24/7 with any questions.
• That I can access a reference librarian at any time.
• How to search for articles, books, and videos.
• Quotation marks (“”) and how to use AND and OR.
• That you can text the library when you need them and that there is a 24/7 chat.
• How to breakdown “One Search”
• Learning about copyright rules.
• Accessing the library from home.
• How to narrow searches and properly cite sources in MLA format.
• AND or OR
• How to work my way around the library website. *A lot of students have no idea.
• How to use the full text databases.

What is the most valuable piece of information you learned during the orientation (Online IL responses)

• The most valuable piece of information I learned was how to correctly search for topics and certain subjects.
• How to refine my search as well as how to find reputable sources.
• Different ways to search for certain things was something I found to be very valuable.
• That it provides the citation. Citing is so confusing to me, not that we have to do but how you actually cite it. This is a great resource for me.
• how to cite
• how to navigate the library searches and they are available anytime
• How to refine my search to credible and peer-edited works.
• Knowing you can access the library online.  I did not know this source before now.
• The MLA citation button was very useful, and I will definitely use it in the future!
• It's easier to fined works to cite in the databases, and Boolean logic.
• Probably learning how to research the right articles.
• How to narrow and widen my searches while looking for articles or videos.
• The most valuable piece of information was putting "" around searches to keep the words together.
• The most valuable piece of information I learned during the orientation was how to find citations.
• The understanding of MLA 8th Edition.
• Being introduced to the digital library, as I had not used it yet.
• That it will cite the sources for me. NO MORE EASYBIB!!!
• All the sources available to me. I had no clue!
• Citing help
• How to correctly google and search for the information I need.
• That the databases offer built-in citation.
• Learning how to use the search properly.
• How to use the different sc4 services to their potential.
• I already knew this information. It was required for high school. Their website is similar to SC4's. Videos are a nice touch.
• Search resources
• MLA citations. Those are difficult for me to create.
• All of the information that can be found in the online library
• everything was quite helpful
• The most valuable thing I learned was how to evaluate sources.
• that I can watch videos on the topic.
• How to cite in MLA format
• How use the "cite" area.
• How to use the e-library sources!
• Learning how to easily find professional books and articles that could help me for future essays.
• How many different databases the library has access to for research.
• The MLA formatting assistance that is available online.
• How to better a search for more narrow results
• All of the help and information that is available to us even when not on campus.
• The search methods were informational. Thank you for the hints. I think this exercise would be best if the questions weren't confusing in the beginning.
• The different citation options easily available.
• How to search.
• too much info at one time for someone who is still learning how to use online site.  The video's were helpful!
• There is a lot to the online library.
• 24/7 communication
• Climate change needs to be taken more seriously
• just how to navigate around the site.
• How to change cite format

What was the least valuable part of the orientation? (On-campus responses)

• Nothing was really least valuable. Everything was important in a different way.
• Learning about MLA format because it was prior knowledge.
• I thought it was all valuable.
• The extra page of MLA format.
• Nothing, everything was new to me.
• Probably the tour but it is still good to know where everything is.
• How to correctly source citations.
• Knowing the volume of the article or paper.
• Nothing, it was all very useful information.
• Asking if the articles were biased.
• The clickers were fun but I don’t think it was very helpful.
• The library hours.
• MLA formatting because I already knew how to do it.
• The subjects picked for reading.
• The trip around the library.
• Everything in the presentation was very valuable.
• Least valuable part was doing the same questions for the post test. Maybe should’ve mixed it up.
• Timing. I got 6/12/ hrs of sleep. Though, that was more my fault than anything else.
• Nothing J

What was the least valuable part of the orientation? (Online IL responses)

• Everything was at least somewhat valuable to me.
• I thought everything was useful.
• Having to go through each different database example. They are seem similar to one another so there was no need to explain CQ researcher or ProQuest central search, etc. It became repetitive.
• the setup
• none, it was all valuable
• There was no un-valuable parts but if I had to choose it was probably the question on the quiz "Which of the following provides evidence of climate change?" I wasn't exactly sure if the articles I didn't choose are related to climate change or not because I have no background knowledge on climate change.
• Any knowledge can be useful.  I am sure at one point I will use the online library.
• I did believe that using a search bar was self explanatory.
• How to use each of the individual databases.
• Nothing I can think of
• It was all useful information.
• The least valuable part was the first video about contacting the library because that is easy to find on the homepage.
• I found all of the information to be valuable.
• The eBooks
• Nothing.
• The hours and ways to contact the library.
• One video not loading. YouTube  video
• Reading
• All the info was useful.
• I feel as if some of the videos were repeative.
• I don't think any of this was invaluable.
• All of the information was useful to me. I am a student returning after a ten year hiatus. It is wonderful to have access to such tools.
• I found all of it to be valuable.
• I kept having to resign in and it was not accepting my password
• The least valuable was how to contact someone because I already knew it, still good information though!
• I think all the information was valuable.
• Everything was useful
• I did not have a least valuable part.
• Repeating how to narrow a search and cite in different ways and in multiple videos
• Nothing
• all of it
• Finding evidence.
• Searching for stuff
• I never understood or was able to find out how to copy and paste my "permialink"...????
• it was all valuable if you haven't used yet.  I have already had to use it for my phycology class, however I wish I would have received this assignment first as I would have been able to find things much faster.  This should be given as assignment on first week.
• I can't think of any
• N/A [multiple responses]
• it was all helpful.

Do you have any other comments about the orientation? (On-campus responses)

• I am very glad that we had this orientation because it was very helpful and I learned a lot.
• I liked the multiple choice questions we answered with the clickers.
• I did enjoy the opportunity to learn more information about the differences between a trustworthy and not trustworthy paper.
• The lady was nice and patient with our class.
• It was very easy to listen and well explained.
• Very helpful and makes me very comfortable with the website.
• More pics
• Clickers were fun.
• Great way to learn about how to use the site!
• No, I do not. She was a very nice lady and so helpful.
• No, all together it was a really good orientation.
• It was super helpful!
• No, not really. I just really enjoyed the Library Orientation experience.
• Well presented. Easy to follow.
• Good job.
• I liked how the instructor taught us how to use the SC4 library website properly.
• The woman was very nice and helpful J
• Very helpful and clear understanding!

Would you recommend service the library provides, such as help from a reference librarian or using the full text databases, to other SC4 students?  (On-campus responses)

• Yes, there are many many texts in the database and there is always someone on staff ready to help.
• Yes, they are very helpful in finding materials. Thank you for teaching us everything!!
• Yes, of course! It has already helped me and I know it could help others.
• Yes, the 24/7 tool is helpful.
• No. The worksheet provided (this worksheet) was sufficient.
• Yes, I have used them before and it helped narrow down my topic I was searching.
• Of course! I would recommend all of the reference help and suggest the online library to offer help and assistance.
• Yes, not everyone takes ENG 101 right away.
• Yeah, if they really needed it.
• Yes, I would. [Multiple times]
• Yes! Absolutely!

Actually, yes, I would recommend all that the Library provides.

ENG 101 Information Literacy Links and Documents

SC4 Library Information Literacy Program Before the 2015 Framework

From 2000 until the introduction of the Framework in 2015, the SC4 library adhered to the Information Literacy Competency Standards for Higher Education as written by the Association of College and Research Libraries (ACRL):

“Information literacy is the set of integrated abilities encompassing the reflective discovery of information, the understanding of how information is produced and valued, and the use of information in creating new knowledge and participating ethically in communities of learning.” Association of College & Research Libraries, American Library Association

An information literate individual is able to:

• Determine the extent of the information needed. (ACRL Standard One)
• Access the needed information effectively and efficiently. (ACRL Standard Two)
• Evaluate information and its sources critically. (ACRL Standard Three)
• Incorporate selected information into one’s knowledge base. (ACRL Standard Three)
• Use information effectively to accomplish a specific purpose. (ACRL Standard Four)
• Understand the economic, legal, and social issues surrounding the use of information and access and use information ethically and legally. (ACRL Standard Five)