Chapter 4 · Video 3

Emerging AI tools, and being wary of fake science

12 slides · Video page · All videos · Transcript
Print layout
Slide 1

Emerging AI tools, and being wary of fake science

Slide 2

AI tools are changing how researchers discover literature

Used wisely, they can accelerate discovery
Used carelessly, they will lead you to cite papers that do not exist
Slide 3
What is available

Some tools are built for research discovery

Elicit, Consensus, and Scite take questions in natural language
They return relevant papers with generated summaries
ChatGPT and Perplexity help too, though built for other work
Slide 4

What they are good for

Rapid orientation on a topic you have not read into
Papers that use terminology you would not have searched for
Generating search terms when you are stuck on keywords
Slide 5

Why they are dangerous

No AI tool searches all databases systematically
They hallucinate citations — plausible papers that do not exist
And you cannot document what was searched, or why
Slide 6

Verify everything

Find the paper in PubMed or Google Scholar and read it yourself
AI for discovery, databases for rigor
Note which tools you used, and how
Slide 7

Understand both their power and their limitations

AI probably will not replace careful scholarship
It can make careful scholars more efficient
What is unreliable today may be better tomorrow, and vice versa
Slide 8
A grand front held up by scaffolding, with nothing behind it, repeated down the row.

Predatory journals mimic legitimate academic journals

They collect publication fees
No peer review, no oversight
Slide 9
Flattery, a claim to have read your work, and urgency.

The solicitation in your inbox

Dear Distinguished Professor
Submit within 48 hours
Slide 10

Names built to be confused with real ones

Journal of Medical Sciences, against Journal of Medical Science
Persuasive to early-career researchers building a record
Easy to confuse with reputable venues
Slide 11

The ecosystem is now self-reinforcing

Fake conferences, fake impact metrics, fake indexing services
Predatory journals cite each other to inflate citation counts
Indexing services list them to make them appear legitimate
Slide 12
In Closing

Cross-checks that usually settle it

Is the open access journal listed in the DOAJ?
Is it indexed in PubMed, Scopus, or Web of Science?
Is the editorial board made of real, verifiable people?

Emerging AI tools, and being wary of fake science

Slide 1This video covers two things: the emerging AI tools that are changing how researchers discover literature, and how to be wary of fake science, including the journals that will publish anything for a fee.

AI tools are changing how researchers discover literature

Used wisely, they can accelerate discovery
Used carelessly, they will lead you to cite papers that do not exist
Slide 2AI tools are changing how researchers discover literature, and creating new ways to get into trouble. Used wisely, they can accelerate discovery. Used carelessly, they'll lead you to cite papers that don't exist.
What is available

Some tools are built for research discovery

Elicit, Consensus, and Scite take questions in natural language
They return relevant papers with generated summaries
ChatGPT and Perplexity help too, though built for other work
Slide 3What's available. Tools like Elicit, Consensus, and Scite are designed specifically for research discovery. They let you ask questions in natural language and return relevant papers with AI-generated summaries. General-purpose tools like ChatGPT and Perplexity can also help you explore topics, though they weren't built for systematic literature work.

What they are good for

Rapid orientation on a topic you have not read into
Papers that use terminology you would not have searched for
Generating search terms when you are stuck on keywords
Slide 4What they're good for. Rapid orientation: ask what the main approaches to treating severe acute malnutrition are, and get a structured overview faster than hours of reading. Surfacing papers that use different terminology than you'd think to search for. Summarizing findings across multiple studies to reveal patterns. And generating search terms when you're stuck on keywords or subject headings.

Why they are dangerous

No AI tool searches all databases systematically
They hallucinate citations — plausible papers that do not exist
And you cannot document what was searched, or why
Slide 5Why they're dangerous. No AI tool searches all databases systematically. They're discovery tools, and they don't replace proper database searching. AI tools can and do hallucinate citations, inventing plausible-sounding papers that don't exist. Never cite a paper you found through AI without verifying it exists and says what the AI claimed. Training data has cutoffs, so the newest literature may not be indexed. And unlike database searches, you can't fully document what an AI searched or why it returned certain results, which is a problem for reproducible reviews.

Verify everything

Find the paper in PubMed or Google Scholar and read it yourself
AI for discovery, databases for rigor
Note which tools you used, and how
Slide 6It's best practice to verify everything. If an AI suggests a paper, find it in PubMed or Google Scholar and read it yourself; if you can't find it, it may not exist. Use AI for discovery, but databases for rigor. Document your process by noting which tools you used and how, even if you can't fully reproduce the outputs. And don't trust AI summaries, especially if you have not provided the article PDF. They can miss nuance, misstate findings, or reflect training biases rather than what the paper actually says.

Understand both their power and their limitations

AI probably will not replace careful scholarship
It can make careful scholars more efficient
What is unreliable today may be better tomorrow, and vice versa
Slide 7The researchers who will use these tools most effectively are those who understand both their power and their limitations. AI probably won't replace careful scholarship, but it can make careful scholars more efficient. Be quick, not dirty. And stay current: these tools improve rapidly, so what's unreliable today may be better tomorrow, and vice versa.
A grand front held up by scaffolding, with nothing behind it, repeated down the row.

Predatory journals mimic legitimate academic journals

They collect publication fees
No peer review, no oversight
Slide 8Humans can mislead you too. That's because not everything that looks like science is good science. As you search the literature, you'll encounter predatory journals, poorly conducted studies, and sometimes outright fraud. Predatory journals mimic legitimate academic journals but exist primarily to collect publication fees without providing genuine peer review or editorial services. They look like real journals, but behind the facade there's no real peer review, no editorial oversight, and no quality control.
Flattery, a claim to have read your work, and urgency.

The solicitation in your inbox

Dear Distinguished Professor
Submit within 48 hours
Slide 9If you have an academic email address, you've probably received solicitations from predatory journals. The emails often flatter: Dear Distinguished Professor. They claim to have seen your recent work: we were impressed by your publication. And they urgently invite submission: special discount if you submit within 48 hours.

Names built to be confused with real ones

Journal of Medical Sciences, against Journal of Medical Science
Persuasive to early-career researchers building a record
Easy to confuse with reputable venues
Slide 10These emails can be persuasive, especially for early-career researchers eager to build their publication records. The journals often have names that sound similar to legitimate journals, the Journal of Medical Sciences against the Journal of Medical Science, making it easy to confuse them with reputable venues.

The ecosystem is now self-reinforcing

Fake conferences, fake impact metrics, fake indexing services
Predatory journals cite each other to inflate citation counts
Indexing services list them to make them appear legitimate
Slide 11Some predatory publishers have become sophisticated. They organize fake conferences, create fake impact metrics, and establish fake indexing services to lend credibility to their operations. The ecosystem of predatory publishing is now self-reinforcing. Predatory journals cite each other to inflate citation counts, predatory conferences invite authors to present papers later published in predatory journals, and predatory indexing services include predatory journals to make them appear legitimate.
In Closing

Cross-checks that usually settle it

Is the open access journal listed in the DOAJ?
Is it indexed in PubMed, Scopus, or Web of Science?
Is the editorial board made of real, verifiable people?
Slide 12A few cross-checks usually reveal whether a journal is legitimate. The Directory of Open Access Journals only indexes journals meeting quality criteria, so if an open access journal isn't in it, investigate further. Check whether the journal is indexed in PubMed, Scopus, or Web of Science. Indexing isn't a guarantee of quality, but lack of indexing in any major database is a warning sign. Look up the publisher by searching the name plus predatory or scam. Examine the editorial board: are the editors real people with verifiable academic affiliations, and can you find their work in legitimate venues? Finally, read a few published articles: do they look professionally edited, and is the science plausible?