Critically analyzing sources is a crucial step in research and decision making. A single biased source can lead to misinformed conclusions, as seen in the example of the study on the benefits of a new weight loss supplement, which was later found to be funded by the supplement's manufacturer.
Inaccurate information can spread quickly, making it essential to evaluate sources critically. This involves considering factors such as the author's credentials, the publication's reputation, and any potential conflicts of interest.
To avoid falling prey to misinformation, it's essential to verify information through multiple credible sources. This approach can help ensure that conclusions are based on accurate and reliable data.
Understanding Sources
A primary source is the best type of source to use when conducting research, as it presents the author's own information based on professional knowledge or research.
Primary sources can be distinguished from secondary sources, which report information presented from other people and may contain misunderstandings or misinterpretations.
The Big 5 Criteria and the CRAAP Test are two common forms of early source evaluation that cover the most significant variables for evaluation.
The Big 5 Criteria include Currency, Coverage/Relevance, Authority, Accuracy, and Objectivity/Purpose, while the CRAAP Test uses the acronym to remember these criteria: Currency, Relevance, Authority, Accuracy, and Purpose.
Here are the Big 5 Criteria in a quick-reference table:
Primary and Secondary Sources
Primary sources are the best type of source to use when conducting research because they present original information based on professional knowledge or research.
A primary source is where the author is presenting their own information.
This is a more reliable source because it's based on the author's own research and expertise.
You can trust primary sources to provide accurate information because they're not reporting on someone else's work.
A secondary source, on the other hand, is where the author is reporting information presented from other people.
Secondary sources can be less reliable because there's a risk of misunderstanding or misinterpretation of the information.
This can lead to inaccuracies and a less trustworthy source.
Introduction
Evaluating sources is an ongoing process that starts from the moment you encounter a source. This process helps you determine what's relevant, accurate, and unbiased, ensuring your review has the best literature in the field.
The purpose of evaluating sources is to make sure your review has the most relevant, accurate, and unbiased literature in the field, so that you can determine what has already been learned about your topic and where further research may be needed.
You should evaluate sources at different stages, including when you first encounter a source, while reading it over, and as you incorporate it into your project. This multi-stage evaluation helps you achieve different goals at each stage.
Note the publisher, as a reputable publisher like a university press suggests that the source is likely to be scholarly. However, a reputable publisher doesn't necessarily guarantee quality, but it does show that the publisher has high regard for the source being published.
- Previous: Finding Sources
- Next: Organizing the Review
Critical Analysis Techniques
Critical analysis is about reviewing information with a critical eye, not just finding problems or being judgmental. A movie critic, for example, reviews a movie for its strengths and weaknesses.
We need to be critical when reviewing our own writing and when reviewing information for our papers. This means not just believing everything we see, hear, or read.
Documentaries, which we often think have true and accurate information, can sometimes present only one viewpoint or be biased towards it. This is because they don't always present all viewpoints.
To be a good critical analyzer, we need to consider whether the information is coming from a legitimate source. We should also be aware that even documentaries can have flaws.
Credibility
Credibility is key when it comes to evaluating sources. A believable source is one that is created by a person or organization that knows about the subject matter. If a person is named as the author, is that person truly a professional in the field?
Determining the credibility of online sources can be a challenge since it's not always clear who created or published what we're looking at. You can use the CRAAP Test or the Big 5 Criteria to quickly evaluate a source. These tools cover the same most significant variables for evaluation.
The CRAAP Test is a helpful mnemonic to remember the evaluation criteria: Currency, Relevance, Authority, Accuracy, and Purpose. You can ask yourself questions like "When was this source published?" and "What are the author or authors' qualifications?" to quickly determine the credibility of a source.
Here's a quick rundown of the Big 5 Criteria:
- Currency: When the source was published. A good rule of thumb is that medical, scientific, and technology resources should be published within the last 5 years.
- Coverage/Relevance: How closely related the source is to your topic and research question.
- Authority: Who wrote the source and whether they are likely to be credible on the subject.
- Accuracy: Whether the information is accurate or not.
- Objectivity/Purpose: Whether or not the source presents a biased point of view or agenda.
If a source presents biased or emotional language in the summary or introduction, it's likely not a credible source. Similarly, if the website or journal the source comes from has a bias to their reporting, you should be cautious.
In general, it's best to run each article, book, or other resource you find through a quick checklist to avoid wasting time on unhelpful sources.
Argumentation and Logic
Critical analysis of sources is crucial to separate fact from opinion, and one of the key aspects is evaluating the logic behind an argument. Logic is essential to determine if an argument is valid or sound.
A valid argument is based on logical analysis of information, but if the information is not accurate, the conclusion is not necessarily true. This highlights the importance of verifying facts and not just accepting information at face value.
When evaluating an argument, it's also essential to check for logical fallacies. These include sweeping generalizations, ad hominem attacks, and non sequiturs, which can undermine the credibility of an argument.
Here are some common logical fallacies to watch out for:
By being aware of these logical fallacies and evaluating the logic behind an argument, you can make more informed decisions and avoid being misled by flawed reasoning.
Objective Reasoning
Objective reasoning is crucial in evaluating arguments. It involves separating fact from opinion and propaganda, which can be tricky. Skilled writers can make you think their interpretations are facts. Facts can usually be verified, but opinions evolve from the interpretation of facts.
To assess the validity of information, ask yourself if it appears to be well-researched and supported by evidence. Be on the lookout for assumptions that may be unreasonable. Note any errors or omissions.
When evaluating an argument, consider whether the ideas and arguments advanced align with other works on the same topic. The more radical an author's departure from established views, the more critically you should scrutinize their ideas.
A good indicator of objective reasoning is whether the author's point of view is impartial and free of emotion-arousing words and bias. If the language is loaded with emotional appeals, it may be a sign of a biased argument.
Here are some key questions to ask when evaluating objective reasoning:
- Is the information covered fact, opinion, or propaganda?
- Does the information appear to be valid and well-researched, or is it questionable and unsupported by evidence?
- Are the ideas and arguments advanced more or less in line with other works you have read on the same topic?
- Is the author's point of view objective and impartial?
Appeals
Appeals are a key component of argumentation, and they can be used to sway the reader by appealing to their emotions, logic, or ethics.
Appealing to emotions can be a powerful tool, as it taps into the reader's personal feelings and experiences. In the right context, it can be a highly effective way to build a connection with the reader.
Logic, on the other hand, appeals to the reader's rational thinking. It's about presenting evidence and reasoning that makes sense, and helps the reader to see things from a different perspective.
Avoiding Pitfalls
As we critically analyze sources, it's essential to avoid pitfalls that can lead us astray.
Bias and slanted language can be sneaky, showing a preference for one position over another through language that's subtly skewed.
A preference for one side over the other can be a major issue, making it hard to trust the information we're getting.
Slanted language can be as simple as using words that have a certain connotation, like "controversial" or "debated", to imply a certain perspective.
This can be especially problematic when we're not aware of it, as it can influence our opinions and decisions without us even realizing it.
Evaluating Sources
Evaluating sources is crucial in research because it helps you determine the credibility and reliability of the information. A primary source is the best type of source to use, as it presents original information based on professional knowledge or research.
To evaluate sources quickly, you can use the "Big 5 Criteria" or the "CRAAP Test". The "Big 5 Criteria" include: Currency, Coverage/Relevance, Authority, Accuracy, and Objectivity/Purpose. For medical, scientific, and technology resources, it's best to look for sources published within the last 5 years. For less time-sensitive topics, resources published within the last 5-10 years are often acceptable.
The "CRAAP Test" is a helpful mnemonic to remember the evaluation criteria, which includes: Currency, Relevance, Authority, Accuracy, and Purpose. You can use the following questions to evaluate sources: When was this source published? Is this source relevant to your topic? What are the author or authors' qualifications? Are sources cited to support the author's claims? Does the website or journal the source comes from have a bias to their reporting?
Edition
Understanding Editions is key to evaluating sources. A first edition of a publication indicates it's the original version, but further editions suggest revisions and updates have been made to reflect changes in knowledge.
Many printings or editions can indicate a work has become a standard source in its area and is reliable. A publication's edition can say a lot about its credibility and usefulness.
First editions are often considered more valuable, but later editions can be more accurate and up-to-date. If a source has multiple editions, look for the most recent one for the most current information.
If you're using a Web source, check for revision dates on the pages to see if the content has been updated.
Coverage
Coverage is a crucial aspect of evaluating sources. It refers to the extent to which a source updates, substantiates, or adds new information to your topic. A good source should provide a variety of viewpoints, so explore multiple sources to get a well-rounded understanding.
You want to consider whether the material is primary or secondary in nature. Primary sources are the raw material of the research process, while secondary sources are based on primary sources. For example, if you're researching a historical event, a primary source might be a contemporary newspaper article, while a secondary source would be a book written by a historian.
A good source should provide both primary and secondary information. In the sciences, primary documents include journal articles and conference proceedings written by experimenters. In history, primary sources might include government documents, personal letters, or diaries.
To evaluate the coverage of a source, ask yourself whether it extensively or marginally covers your topic. Does it provide new insights, or is it just rehashing what you already know?
Evaluating Sources
A primary source is the best type of source to use when conducting research, as it presents the author's own information based on professional knowledge or research.
To evaluate sources quickly, use the "Big 5 Criteria" or the "CRAAP Test", which cover the same significant variables for evaluation.
The most important criteria for evaluating a potential resource are: Currency, Coverage/Relevance, Authority, Accuracy, and Objectivity/Purpose.
For medical, scientific, and technology resources, a good rule of thumb for Currency is that they should be published within the last 5 years to prevent the information from being out-of-date.
A helpful mnemonic to remember the evaluation criteria is CRAAP, which stands for Currency, Relevance, Authority, Accuracy, and Purpose.
Here are some helpful questions for initial evaluation: When was this source published? Is this source relevant to your topic? What are the author or authors' qualifications? Are sources cited to support the author's claims?
The CRAAP Test is a useful tool to quickly evaluate a source, covering the same variables as the "Big 5 Criteria".
Sources
- https://writing-center.phsc.edu/research/finding-and-evaluating-sources-critical-analysis
- https://guides.library.cornell.edu/critically_analyzing
- https://www.studocu.com/en-us/messages/question/2868310/why-is-it-important-to-critically-analyze-sources-why-are-scholarl-sources-more-appropriate
- https://www.studocu.com/en-us/messages/question/2827884/why-is-it-important-to-critically-analyze-sources-why-are-scholarly-sources-more-appropriate
- https://libraryservices.acphs.edu/lit_review/evaluating_sources
Featured Images: pexels.com