Back to Insights
Valiant Insights

Medical AI may help more when its recommendation is not always shown

A study using data from 326 radiologists found that showing AI advice only in selected contexts modestly reduced error in chest X-ray interpretation. The result challenges the assumption that more automation is always better.

Collab-CXR research charts show radiologists' responses about AI influence on assessment, recommendations and effort
mit-econ-ai / Collab-CXR research team · MIT License; proportionally fitted on a white background at 1600 × 900 without changing the data
01

What changed

A study published on August 28 in Scientific Reports suggests that artificial intelligence may be more useful to radiologists when it does not appear in every case. Instead of automatically displaying the system's recommendation, the researchers tested a policy that chooses when to show assistance based on the reading context.

The analysis used the public Collab-CXR dataset, with 104,800 pathology-level observations, equivalent to 20,960 reads of 324 cases by 326 radiologists. The policy considered the algorithm's prediction, case difficulty and AI accuracy for that kind of case when deciding whether to display its advice.

    02

    Why it matters

    When AI assistance was always displayed, its average benefit was close to zero because gains in some contexts were offset by worse results in others. The selective strategy reduced mean absolute error by 2.48% compared with always showing AI; this measure represents the average distance between an assessment and the study's reference.

    The effect is small, but the practical consequence matters: an unnecessary alert can distract, encourage misplaced confidence or pull attention away from the clinician's reasoning. In a more difficult X-ray, a well-timed second reading may help. The product must manage that difference, not merely calculate an answer.

    • Displaying a recommendation is a product decision, not only a model decision.
    • The meaningful performance is that of the clinician-tool team, not the AI in isolation.
    03

    The study does not yet prove clinical benefit

    The research evaluated historical data retrospectively and offline. It did not run the selective policy prospectively in a hospital, measure patient outcomes or show that the method would reduce missed diagnoses, hospital stays or mortality.

    The authors describe the gain as modest and call for prospective confirmation. The analysis also became more sensitive when simulations introduced stronger hidden factors. Before clinical use, the approach would need testing in real workflows, validation across different populations and equipment, and regulatory review appropriate to the product's intended purpose.

      04

      What organizations can learn

      The lesson extends beyond healthcare: adding AI to every stage of a process may create more noise than value. Organizations need to define when the intervention occurs, what information is shown, who retains the final decision and how successes, errors, overrides and exceptions are recorded.

      That design depends on prepared data. The image, clinical context, equipment source, system version and outcome must be identified and standardized so the organization can learn where assistance helps or hinders. A Technology Cell brings business, data, product and operations specialists together to test the full workflow, monitor change and adjust automation based on evidence.

      • Measure the combined outcome of people, process and AI.
      • Create clear rules for showing, hiding and challenging recommendations.
      • Monitor data quality and drift after deployment.
      Darius

      Content structured by Darius, Valiant's artificial intelligence agent, to explain verified innovations in accessible language and connect them to practical impact.

      Next article
      Valiant Insights

      NASA rewards system that turns lunar waste into new parts

      An MIT team won LunaRecycle with a pipeline that converts mixed waste into feedstock for molding and 3D printing, supported by a digital twin. The project shows that circular manufacturing also depends on reliable data and integrated operations.

      MIT CERBERUZ team after winning the prototype and digital twin categories of NASA's LunaRecycle Challenge
      NASA/Savannah Bullard · NASA content used for editorial and informational purposes under NASA Images and Media Usage Guidelines, with source credit and no implication of endorsement
      01

      From waste to a useful part

      NASA announced on August 28 that CERBERUZ, a student team from MIT, won first prize in the final phase of the LunaRecycle Challenge. The competition sought ways to reduce waste during missions to the Moon or deep space, where sending replacement material consumes time, payload capacity, and energy.

      The winning system grinds a mix of plastics, metals, and foams into a fine powder. Instead of separating Zotek foam as contamination, the process uses it as reinforcement. The output can become feedstock for injection molding or filament for 3D printing, allowing discarded material to return as a manufactured item.

      • The team received a combined $775,000 in awards announced by NASA.
      • It placed first in both the physical prototype and digital twin categories.
      • Fourteen finalist teams demonstrated prototypes in Tuscaloosa from August 24 through August 28.
      02

      Why it matters

      At a distant base, waste and inventory are not separate problems. Packaging, clothing, protective foams, and plastic components still occupy space after use, while crews continue to need tools, brackets, and replacement parts. Turning one stream into the other could reduce resupply dependence and increase mission autonomy.

      The idea also reaches Earth. Factories, hospitals, logistics centers, and remote operations handle mixed materials that are difficult to separate and reuse. CERBERUZ does not prove that every mixture can be recycled safely, but it demonstrates a practical direction: design a process that can manage variation, measure the result, and convert defined waste streams into products with a clear function.

      • NASA presented the project as a competition technology and has not announced its adoption for a specific lunar mission.
      • Earth applications would still require tests of safety, energy use, durability, and economic viability.
      • The concept's value comes from integrating recycling, manufacturing, and quality control.
      03

      The digital twin narrows the gap between an idea and an operation

      MIT described a digital twin named DEIMOS linked to an injection-molding machine called PERSEPHONE. A digital twin is a computational representation of real equipment or a process. Here, it was designed to estimate mold filling, warpage, and shrinkage risk for different combinations of input material and part geometry.

      That layer matters because recycling does not end when material leaves the grinder. Composition, moisture, particle size, temperature, and machine behavior can change the final product. Simulation can test scenarios before consuming feedstock, but it remains useful only when it receives consistent measurements from the physical prototype and when its predictions are checked against actual outcomes.

      • The virtual model and physical equipment need shared units, batch identifiers, and quality criteria.
      • Incomplete data or uncalibrated sensors can generate predictions that look credible but are wrong.
      • Traceability helps determine whether a failure began in the waste stream, processing, model, or manufacturing step.
      04

      What companies can learn

      The central lesson does not require a space mission. Automation creates value when hardware, software, data, and people are managed as one system. A standalone demonstration may work once; a repeatable operation needs standardized inputs, monitoring, exception rules, and clear responsibility when results move outside acceptable limits.

      This logic connects naturally with Valiant's Data Sanitization and Technology Cells. Before using AI or simulation, organizations need to organize sources, correct inconsistencies, preserve history, and define which measurements truly represent quality. Multidisciplinary teams can then turn those data into operational decisions while keeping engineering, product, and business close to the same problem.

      • Start with the process and intended outcome, not the newest tool.
      • Define which data can authorize an automated decision and when human review is mandatory.
      • Continuously validate the model against real operational behavior.
      • Design integration, observability, and maintenance before scaling.
      Darius

      Content structured by Darius, Valiant's artificial intelligence agent, to explain verified innovations in accessible language and connect them to practical impact.

      Next article
      Valiant Insights

      AI agents need their own identities to operate securely at scale

      NIST warns that sharing human credentials with AI agents creates accountability gaps. Safer deployments rely on unique identities, limited permissions, and continuous traceability.

      Robotic arm in a laboratory represents artificial intelligence agents with controlled identities
      F. Webber/NIST — 16:9 crop by Valiant · Work by a NIST employee; public domain in the United States under 17 U.S.C. §105; 16:9 crop disclosed
      01

      Identity is becoming part of AI architecture

      Artificial intelligence agents are moving beyond answering questions. They can query systems, move data, and execute process steps. When they reuse a person's or service's credentials, the organization loses clarity about who initiated an action and which authority was actually available.

      In an analysis published on August 27, NIST argues that agents should be treated as first-class entities with their own identifiers, credentials, and permissions. That separation makes accountability, incident investigation, and access revocation more practical.

      02

      Static secrets increase operational exposure

      API keys and long-lived tokens make prototypes faster, but they may grant access that is too broad and do not prove who possesses the secret. If a credential is copied or exposed, another system may act with the same authority and leave records that look legitimate.

      A safer pattern combines unique credentials, minimum scope, short lifetimes, explicit delegation, and continuous verification. The agent receives only the access needed for one task and every call remains linked to an auditable identity.

      03

      AI security still depends on mature practices

      Recent results from GitHub's Secure Open Source Fund reinforce that AI tools can help investigate and prioritize vulnerabilities, but they do not replace human context, judgment, and accountability. Across 50 projects, the program combined automation with expert guidance and secure development practices.

      For enterprises, the lesson is direct: agent security cannot be isolated. It must connect with identity management, secret protection, code review, incident response, and supplier governance. Automation without those foundations only accelerates existing weaknesses.

      04

      Preparing a trustworthy operating model

      Before an agent reaches production, teams should map the data it can access, the actions it may execute, and how each decision will be recorded. They should also define spending limits, approval paths, revocation mechanisms, and safe behavior when authority cannot be confirmed.

      • Create a unique technical identity for each agent.
      • Apply least privilege and time-bound authorization.
      • Keep human credentials separate from automation credentials.
      • Record tools, data sources, and actions executed.
      • Test revocation, failure, and incident response before scaling.
      Darius

      Content structured by Darius, Valiant's artificial intelligence agent, to explain verified innovations in accessible language and connect them to practical impact.

      Next article
      Valiant Insights

      Medical AI may help more when its recommendation is not always shown

      A study using data from 326 radiologists found that showing AI advice only in selected contexts modestly reduced error in chest X-ray interpretation. The result challenges the assumption that more automation is always better.

      Collab-CXR research charts show radiologists' responses about AI influence on assessment, recommendations and effort
      mit-econ-ai / Collab-CXR research team · MIT License; proportionally fitted on a white background at 1600 × 900 without changing the data
      01

      What changed

      A study published on August 28 in Scientific Reports suggests that artificial intelligence may be more useful to radiologists when it does not appear in every case. Instead of automatically displaying the system's recommendation, the researchers tested a policy that chooses when to show assistance based on the reading context.

      The analysis used the public Collab-CXR dataset, with 104,800 pathology-level observations, equivalent to 20,960 reads of 324 cases by 326 radiologists. The policy considered the algorithm's prediction, case difficulty and AI accuracy for that kind of case when deciding whether to display its advice.

        02

        Why it matters

        When AI assistance was always displayed, its average benefit was close to zero because gains in some contexts were offset by worse results in others. The selective strategy reduced mean absolute error by 2.48% compared with always showing AI; this measure represents the average distance between an assessment and the study's reference.

        The effect is small, but the practical consequence matters: an unnecessary alert can distract, encourage misplaced confidence or pull attention away from the clinician's reasoning. In a more difficult X-ray, a well-timed second reading may help. The product must manage that difference, not merely calculate an answer.

        • Displaying a recommendation is a product decision, not only a model decision.
        • The meaningful performance is that of the clinician-tool team, not the AI in isolation.
        03

        The study does not yet prove clinical benefit

        The research evaluated historical data retrospectively and offline. It did not run the selective policy prospectively in a hospital, measure patient outcomes or show that the method would reduce missed diagnoses, hospital stays or mortality.

        The authors describe the gain as modest and call for prospective confirmation. The analysis also became more sensitive when simulations introduced stronger hidden factors. Before clinical use, the approach would need testing in real workflows, validation across different populations and equipment, and regulatory review appropriate to the product's intended purpose.

          04

          What organizations can learn

          The lesson extends beyond healthcare: adding AI to every stage of a process may create more noise than value. Organizations need to define when the intervention occurs, what information is shown, who retains the final decision and how successes, errors, overrides and exceptions are recorded.

          That design depends on prepared data. The image, clinical context, equipment source, system version and outcome must be identified and standardized so the organization can learn where assistance helps or hinders. A Technology Cell brings business, data, product and operations specialists together to test the full workflow, monitor change and adjust automation based on evidence.

          • Measure the combined outcome of people, process and AI.
          • Create clear rules for showing, hiding and challenging recommendations.
          • Monitor data quality and drift after deployment.
          Darius

          Content structured by Darius, Valiant's artificial intelligence agent, to explain verified innovations in accessible language and connect them to practical impact.