Independent Judgment in the Age of LLMs

Abstract painting with a rising copper-and-umber stroke over faint peach marks and white paint.

A fluent answer can conceal an unsettled question. Its structure makes the subject appear resolved before the reader has examined the assumptions, alternatives, or evidence behind it.

Large language models (LLMs) make that experience readily available. They can help develop an argument, explain an unfamiliar concept, and expose a weakness in a draft. They can also supply a direction so quickly that the person using it never decides whether that direction was worth taking.

Independent judgment matters at that point. It involves understanding why an account is convincing, recognizing where its authority ends, and taking responsibility for how it is used. The issue extends beyond LLMs to any situation in which a persuasive explanation is easier to acquire than the knowledge needed to assess it.

What It Means to Know Enough

Access to information and the ability to evaluate it are different capacities. Someone needs enough familiarity with a subject to recognize a relevant answer, identify a missing condition, and notice when a conclusion exceeds the evidence.

That does not mean rebuilding every field of knowledge from first principles. Most useful thinking depends on other people's work. Responsible reliance begins with knowing what kind of claim is being made and what makes the source qualified to support it.

An expert can be reliable on one question and outside their field on another. A study can establish an effect in a particular setting without determining how it generalizes. A generated explanation can accurately summarize a concept while inventing a supporting reference. The method of checking should match the claim and the consequences of being wrong.

Research on LLM-supported mathematics practice makes a related distinction between performance with assistance and performance after it is removed.1 In everyday reasoning, the question is whether the interaction leaves someone better able to understand the subject or merely better equipped to repeat an answer.

A useful check is to explain the reasoning without copying its wording. What assumptions does it need? What would change the conclusion? Which part is established, and which part is an interpretation? Difficulty answering those questions identifies work still to be done.

Expertise Makes Better Questions Possible

A point of view develops partly through attention to details that a general explanation leaves out.

In cars, for example, a broad comparison between premium and mainstream brands can obscure the model, generation, powertrain, maintenance history, and purpose of the vehicle. The person who knows the subject can ask a better question because those distinctions are visible to them.

The same is true in teaching, nursing, cooking, or any activity with practical depth. Familiarity reveals circumstances in which a tidy rule becomes incomplete. It provides ways to test an explanation against the work it is supposed to describe.

Experience does not make a judgment infallible. It can produce habits and blind spots as well as insight. Its contribution is that it gives reasoning something specific to address. An observation can then be compared with evidence, discussed with other people, or tested in practice.

This is one reason to preserve an initial question before asking a tool to frame the entire subject. The rough version may contain a useful detail that disappears when the problem is translated into a more familiar pattern.

Assistance Can Improve Work and Narrow Its Direction

LLMs can help overcome a blank page, suggest alternatives, and make a line of thought easier to examine. Those benefits deserve to be considered alongside the influence of the suggestions themselves.

In a 2024 short-story experiment, Anil Doshi and Oliver Hauser found that access to LLM-generated ideas improved evaluators' ratings of individual stories while making the assisted stories more similar to one another.2 The study concerns a specific creative task, but it illustrates how better individual outputs can coexist with less variation across a group.

That is a useful concern for anyone developing a perspective. A suggestion can improve expression while quietly determining what the work treats as important. Once an outline exists, it becomes easier to refine its sections than to reconsider why those sections were chosen.

One practice I want to keep is supplying an observation, a rough argument, or a disagreement before requesting a finished response. Another is to ask the tool to examine alternatives and objections rather than immediately produce the final account.

Neither method guarantees originality. Both keep more of the judgment available for examination. The goal is to understand which decisions came from the subject and which came from accepting the first convenient formulation of it.

Confidence Helps When It Allows Revision

An unfinished idea needs enough confidence to be explored. Too little confidence can lead someone to abandon a useful observation because it does not yet sound authoritative. Too much can make criticism feel like a threat to the person rather than information about the argument.

The kind of confidence I value is provisional commitment: take the idea seriously enough to develop it, while remaining willing to discover that it is wrong. That requires distinguishing the value of asking a question from the eventual quality of the answer.

LLMs introduce pressures in both directions. A polished response can make an early draft seem inadequate. An agreeable response can make a weak argument feel validated. Neither fluency nor encouragement establishes that the reasoning holds.

A claim becomes stronger through evidence, clear distinctions, and an honest account of its limits. Changing it in response to those things is part of exercising judgment.

Independence Does Not Require Disagreement

A position does not become more thoughtful because it is unusual. Rejecting expertise automatically is as mechanical as accepting authority without examining its relevance.

Often the best-supported conclusion is already available. Independent judgment may consist of understanding why it should be accepted, where disagreement remains reasonable, and what new evidence would justify reconsidering it.

Other people contribute more than competing opinions. They live with constraints that a private argument can leave out. A product decision that sounds efficient to its designer may create additional work for a teacher or family. Hearing that objection changes the factual situation the decision needs to address.

The distinction is between borrowing knowledge and surrendering responsibility. It is possible to rely extensively on others while retaining a clear account of why their work is credible and how it bears on the question.

Keep the Argument in Contact with Its Subject

Some questions become clearer through direct investigation than through another round of explanation. Using a product, observing a task, reading an original study, or discussing a problem with the people affected can expose assumptions that remain invisible in a polished draft.

These activities give assisted reasoning a point of reference. They make it possible to ask whether the account fits something beyond its own wording.

The appropriate amount of checking varies. A casual idea does not require the same scrutiny as a consequential decision. What matters is recognizing when the confidence of the presentation has outrun the basis for the claim.

Independent judgment is valuable because explanations always leave something for the person using them to decide. The responsibility includes knowing what is understood, what is being taken on trust, and what remains uncertain. LLMs can support that work. They cannot remove the need to do it.

Sources and Notes

  1. Hamsa Bastani and colleagues. Generative AI without guardrails can harm learning: Evidence from high school mathematics. Proceedings of the National Academy of Sciences 122(26), e2422633122 (2025). ↩
  2. Anil R. Doshi and Oliver P. Hauser. Generative AI enhances individual creativity but reduces the collective diversity of novel content. Science Advances 10(28), eadn5290 (2024). ↩

Views expressed here are my own.

* Written with assistance from GPT-6.1 Sol.