The latest version of the artificial intelligence chatbot ChatGPT has passed a radiology board-style examination.
Researchers put ChatGPT to the test using 150 multiple-choice questions modelled on the Canadian Royal College and American Board of Radiology exams.
This breakthrough underscores the vast potential of AI in medical fields, yet it also reveals certain limitations that affect its dependability, two studies said.
ChatGPT, a deep-learning model developed by OpenAI, is known for generating humanlike responses based on the input it receives.
Its pattern recognition abilities allow it to interpret and respond to vast amounts of data, but it sometimes produces factually incorrect responses because of the absence of a source of truth in its training data.
“The use of large language models like ChatGPT is rapidly expanding and will only continue to grow,” said Dr Rajesh Bhayana, an abdominal radiologist and technology lead at University Medical Imaging Toronto, Toronto General Hospital.
“Our research offers valuable insight into how ChatGPT performs in a radiology setting, emphasising its immense potential while shedding light on current reliability issues.”
ChatGPT's usage and influence have been growing significantly. Notably, it was recently named the fastest-growing consumer application in history. It is also being integrated into popular search engines like Google and Bing, which both physicians and patients use for medical inquiries.
The AI chatbot managed to correctly answer 69 per cent of the questions, just short of the passing grade of 70 per cent.
However, it showed a noticeable gap in performance between lower-order thinking (84 per cent) and higher-order thinking questions (60 per cent), particularly struggling with descriptions of imaging findings, calculations and classifications, and the application of concepts.
Given that the AI has not received any radiology-specific training, these struggles were not unexpected.
A newer version — GPT-4 — was released in March, the release was an improved version of the AI including enhanced advanced reasoning capabilities. In a follow-up study, GPT-4 answered 81 per cent of the same questions correctly, exceeding the passing threshold and outperforming its predecessor, GPT-3.5.
Despite these improvements, GPT-4 did not show any progress on lower-order thinking questions and answered 12 questions incorrectly that GPT-3.5 had answered correctly. This inconsistency raises questions about the AI's reliability in information gathering.
“ChatGPT gave accurate and confident answers to some challenging radiology questions, but then made some very illogical and inaccurate assertions,” said Dr Bhayana.
“Given how these models function, the inaccurate responses should not be surprising.”
The studies noted a tendency of ChatGPT to produce inaccurate responses, termed hallucinations. Although less frequent in GPT-4, this tendency still limits the chatbot's current usability in medical education and practice.
Despite the limitations, the researchers see potential in using ChatGPT to spark ideas and aid in the medical writing process and data summarisation, as long as the information is fact-checked.
“To me, this is its biggest limitation. At present, ChatGPT is best used to spark ideas, help start the medical writing process and in data summarisation. If used for quick information recall, it always needs to be fact-checked,” Dr Bhayana said.
The Cockroach
(Vintage)
Ian McEwan
The%20Crown%20season%205
%3Cp%3E%3Cstrong%3EStars%3A%20%3C%2Fstrong%3EImelda%20Staunton%2C%20Jonathan%20Pryce%2C%20Lesley%20Manville%2C%20Jonny%20Lee%20Miller%2C%20Dominic%20West%2C%20Elizabeth%20Debicki%2C%20Salim%20Daw%20and%20Khalid%20Abdalla%3C%2Fp%3E%0A%3Cp%3E%3Cstrong%3EWritten%20by%3A%20%3C%2Fstrong%3EPeter%20Morgan%3C%2Fp%3E%0A%3Cp%3E%3Cstrong%3ERating%3A%3C%2Fstrong%3E%204%2F5%20stars%3C%2Fp%3E%0A
Read more from Johann Chacko
More coverage from the Future Forum
MATCH INFO
Manchester City 4 (Gundogan 8' (P), Bernardo Silva 19', Jesus 72', 75')
Fulham 0
Red cards: Tim Ream (Fulham)
Man of the Match: Gabriel Jesus (Manchester City)
Key findings of Jenkins report
- Founder of the Muslim Brotherhood, Hassan al Banna, "accepted the political utility of violence"
- Views of key Muslim Brotherhood ideologue, Sayyid Qutb, have “consistently been understood” as permitting “the use of extreme violence in the pursuit of the perfect Islamic society” and “never been institutionally disowned” by the movement.
- Muslim Brotherhood at all levels has repeatedly defended Hamas attacks against Israel, including the use of suicide bombers and the killing of civilians.
- Laying out the report in the House of Commons, David Cameron told MPs: "The main findings of the review support the conclusion that membership of, association with, or influence by the Muslim Brotherhood should be considered as a possible indicator of extremism."
Quick pearls of wisdom
Focus on gratitude: And do so deeply, he says. “Think of one to three things a day that you’re grateful for. It needs to be specific, too, don’t just say ‘air.’ Really think about it. If you’re grateful for, say, what your parents have done for you, that will motivate you to do more for the world.”
Know how to fight: Shetty married his wife, Radhi, three years ago (he met her in a meditation class before he went off and became a monk). He says they’ve had to learn to respect each other’s “fighting styles” – he’s a talk it-out-immediately person, while she needs space to think. “When you’re having an argument, remember, it’s not you against each other. It’s both of you against the problem. When you win, they lose. If you’re on a team you have to win together.”
Kandahar%20
%3Cp%3E%3Cstrong%3EDirector%3A%3C%2Fstrong%3E%20Ric%20Roman%20Waugh%3C%2Fp%3E%0A%3Cp%3E%3Cstrong%3EStars%3A%C2%A0%3C%2Fstrong%3EGerard%20Butler%2C%20Navid%20Negahban%2C%20Ali%20Fazal%3C%2Fp%3E%0A%3Cp%3E%3Cstrong%3ERating%3A%3C%2Fstrong%3E%202.5%2F5%3C%2Fp%3E%0A
Killing of Qassem Suleimani
Killing of Qassem Suleimani
Company%20Profile
%3Cp%3E%3Cstrong%3ECompany%20name%3A%3C%2Fstrong%3E%20myZoi%3Cbr%3E%3Cstrong%3EStarted%3A%3C%2Fstrong%3E%202021%3Cbr%3E%3Cstrong%3EFounders%3A%3C%2Fstrong%3E%20Syed%20Ali%2C%20Christian%20Buchholz%2C%20Shanawaz%20Rouf%2C%20Arsalan%20Siddiqui%2C%20Nabid%20Hassan%3Cbr%3E%3Cstrong%3EBased%3A%3C%2Fstrong%3E%20UAE%3Cbr%3E%3Cstrong%3ENumber%20of%20staff%3A%3C%2Fstrong%3E%2037%3Cbr%3E%3Cstrong%3EInvestment%3A%3C%2Fstrong%3E%20Initial%20undisclosed%20funding%20from%20SC%20Ventures%3B%20second%20round%20of%20funding%20totalling%20%2414%20million%20from%20a%20consortium%20of%20SBI%2C%20a%20Japanese%20VC%20firm%2C%20and%20SC%20Venture%3C%2Fp%3E%0A
Red flags
- Promises of high, fixed or 'guaranteed' returns.
- Unregulated structured products or complex investments often used to bypass traditional safeguards.
- Lack of clear information, vague language, no access to audited financials.
- Overseas companies targeting investors in other jurisdictions - this can make legal recovery difficult.
- Hard-selling tactics - creating urgency, offering 'exclusive' deals.
Courtesy: Carol Glynn, founder of Conscious Finance Coaching
KILLING OF QASSEM SULEIMANI
Globalization and its Discontents Revisited
Joseph E. Stiglitz
W. W. Norton & Company
FIXTURES
Saturday
5.30pm: Shabab Al Ahli v Al Wahda
5.30pm: Khorfakkan v Baniyas
8.15pm: Hatta v Ajman
8.15pm: Sharjah v Al Ain
Sunday
5.30pm: Kalba v Al Jazira
5.30pm: Fujairah v Al Dhafra
8.15pm: Al Nasr v Al Wasl
GYAN’S ASIAN OUTPUT
2011-2015: Al Ain – 123 apps, 128 goals
2015-2017: Shanghai SIPG – 20 apps, 7 goals
2016-2017: Al Ahli (loan) – 25 apps, 11 goals
IPL 2018 FINAL
Sunrisers Hyderabad 178-6 (20 ovs)
Chennai Super Kings 181-2 (18.3 ovs)
Chennai win by eight wickets
Dengue%20fever%20symptoms
%3Cp%3EHigh%20fever%20(40%C2%B0C%2F104%C2%B0F)%3Cbr%3ESevere%20headache%3Cbr%3EPain%20behind%20the%20eyes%3Cbr%3EMuscle%20and%20joint%20pains%3Cbr%3ENausea%3Cbr%3EVomiting%3Cbr%3ESwollen%20glands%3Cbr%3ERash%26nbsp%3B%3C%2Fp%3E%0A
AI traffic lights to ease congestion at seven points to Sheikh Zayed bin Sultan Street
The seven points are:
Shakhbout bin Sultan Street
Dhafeer Street
Hadbat Al Ghubainah Street (outbound)
Salama bint Butti Street
Al Dhafra Street
Rabdan Street
Umm Yifina Street exit (inbound)
MOUNTAINHEAD REVIEW
Starring: Ramy Youssef, Steve Carell, Jason Schwartzman
Director: Jesse Armstrong
Rating: 3.5/5
Labour dispute
The insured employee may still file an ILOE claim even if a labour dispute is ongoing post termination, but the insurer may suspend or reject payment, until the courts resolve the dispute, especially if the reason for termination is contested. The outcome of the labour court proceedings can directly affect eligibility.
- Abdullah Ishnaneh, Partner, BSA Law
RESULT
Huddersfield Town 1 Manchester City 2
Huddersfield: Otamendi (45' 1 og), van La Parra (red card 90' 6)
Man City: Agüero (47' pen), Sterling (84')
Man of the match: Christopher Schindler (Huddersfield Town)
'Gold'
Director:Anthony Hayes
Stars:Zaf Efron, Anthony Hayes
Rating:3/5
At a glance
- 20,000 new jobs for Emiratis over three years
- Dh300 million set aside to train 18,000 jobseekers in new skills
- Managerial jobs in government restricted to Emiratis
- Emiratis to get priority for 160 types of job in private sector
- Portion of VAT revenues will fund more graduate programmes
- 8,000 Emirati graduates to do 6-12 month replacements in public or private sector on a Dh10,000 monthly wage - 40 per cent of which will be paid by government
Zodi%20%26%20Tehu%3A%20Princes%20Of%20The%20Desert
%3Cp%3E%3Cstrong%3EDirector%3A%20%3C%2Fstrong%3EEric%20Barbier%26nbsp%3B%3C%2Fp%3E%0A%3Cp%3E%3Cstrong%3EStarring%3A%20%3C%2Fstrong%3EYoussef%20Hajdi%2C%20Nadia%20Benzakour%2C%20Yasser%20Drief%3C%2Fp%3E%0A%3Cp%3E%3Cstrong%3ERating%3A%3C%2Fstrong%3E%204%2F5%3C%2Fp%3E%0A
From Zero
Artist: Linkin Park
Label: Warner Records
Number of tracks: 11
Rating: 4/5
Jetour T1 specs
Engine: 2-litre turbocharged
Power: 254hp
Torque: 390Nm
Price: From Dh126,000
Available: Now
More from Neighbourhood Watch
Benefits of first-time home buyers' scheme
- Priority access to new homes from participating developers
- Discounts on sales price of off-plan units
- Flexible payment plans from developers
- Mortgages with better interest rates, faster approval times and reduced fees
- DLD registration fee can be paid through banks or credit cards at zero interest rates
