The latest version of the artificial intelligence chatbot ChatGPT has passed a radiology board-style examination.
Researchers put ChatGPT to the test using 150 multiple-choice questions modelled on the Canadian Royal College and American Board of Radiology exams.
This breakthrough underscores the vast potential of AI in medical fields, yet it also reveals certain limitations that affect its dependability, two studies said.
ChatGPT, a deep-learning model developed by OpenAI, is known for generating humanlike responses based on the input it receives.
Its pattern recognition abilities allow it to interpret and respond to vast amounts of data, but it sometimes produces factually incorrect responses because of the absence of a source of truth in its training data.
“The use of large language models like ChatGPT is rapidly expanding and will only continue to grow,” said Dr Rajesh Bhayana, an abdominal radiologist and technology lead at University Medical Imaging Toronto, Toronto General Hospital.
“Our research offers valuable insight into how ChatGPT performs in a radiology setting, emphasising its immense potential while shedding light on current reliability issues.”
ChatGPT's usage and influence have been growing significantly. Notably, it was recently named the fastest-growing consumer application in history. It is also being integrated into popular search engines like Google and Bing, which both physicians and patients use for medical inquiries.
The AI chatbot managed to correctly answer 69 per cent of the questions, just short of the passing grade of 70 per cent.
However, it showed a noticeable gap in performance between lower-order thinking (84 per cent) and higher-order thinking questions (60 per cent), particularly struggling with descriptions of imaging findings, calculations and classifications, and the application of concepts.
Given that the AI has not received any radiology-specific training, these struggles were not unexpected.
A newer version — GPT-4 — was released in March, the release was an improved version of the AI including enhanced advanced reasoning capabilities. In a follow-up study, GPT-4 answered 81 per cent of the same questions correctly, exceeding the passing threshold and outperforming its predecessor, GPT-3.5.
Despite these improvements, GPT-4 did not show any progress on lower-order thinking questions and answered 12 questions incorrectly that GPT-3.5 had answered correctly. This inconsistency raises questions about the AI's reliability in information gathering.
“ChatGPT gave accurate and confident answers to some challenging radiology questions, but then made some very illogical and inaccurate assertions,” said Dr Bhayana.
“Given how these models function, the inaccurate responses should not be surprising.”
The studies noted a tendency of ChatGPT to produce inaccurate responses, termed hallucinations. Although less frequent in GPT-4, this tendency still limits the chatbot's current usability in medical education and practice.
Despite the limitations, the researchers see potential in using ChatGPT to spark ideas and aid in the medical writing process and data summarisation, as long as the information is fact-checked.
“To me, this is its biggest limitation. At present, ChatGPT is best used to spark ideas, help start the medical writing process and in data summarisation. If used for quick information recall, it always needs to be fact-checked,” Dr Bhayana said.
About RuPay
A homegrown card payment scheme launched by the National Payments Corporation of India and backed by the Reserve Bank of India, the country’s central bank
RuPay process payments between banks and merchants for purchases made with credit or debit cards
It has grown rapidly in India and competes with global payment network firms like MasterCard and Visa.
In India, it can be used at ATMs, for online payments and variations of the card can be used to pay for bus, metro charges, road toll payments
The name blends two words rupee and payment
Some advantages of the network include lower processing fees and transaction costs
Polarised public
31% in UK say BBC is biased to left-wing views
19% in UK say BBC is biased to right-wing views
19% in UK say BBC is not biased at all
Source: YouGov
Federer's 19 grand slam titles
Australian Open (5 titles) - 2004 bt Marat Safin; 2006 bt Marcos Baghdatis; 2007 bt Fernando Gonzalez; 2010 bt Andy Murray; 2017 bt Rafael Nadal
French Open (1 title) - 2009 bt Robin Soderling
Wimbledon (8 titles) - 2003 bt Mark Philippoussis; 2004 bt Andy Roddick; 2005 bt Andy Roddick; 2006 bt Rafael Nadal; 2007 bt Rafael Nadal; 2009 bt Andy Roddick; 2012 bt Andy Murray; 2017 bt Marin Cilic
US Open (5 titles) - 2004 bt Lleyton Hewitt; 2005 bt Andre Agassi; 2006 bt Andy Roddick; 2007 bt Novak Djokovic; 2008 bt Andy Murray
AS IT STANDS IN POOL A
1. Japan - Played 3, Won 3, Points 14
2. Ireland - Played 3, Won 2, Lost 1, Points 11
3. Scotland - Played 2, Won 1, Lost 1, Points 5
Remaining fixtures
Scotland v Russia – Wednesday, 11.15am
Ireland v Samoa – Saturday, 2.45pm
Japan v Scotland – Sunday, 2.45pm
Key facilities
- Olympic-size swimming pool with a split bulkhead for multi-use configurations, including water polo and 50m/25m training lanes
- Premier League-standard football pitch
- 400m Olympic running track
- NBA-spec basketball court with auditorium
- 600-seat auditorium
- Spaces for historical and cultural exploration
- An elevated football field that doubles as a helipad
- Specialist robotics and science laboratories
- AR and VR-enabled learning centres
- Disruption Lab and Research Centre for developing entrepreneurial skills
Labour dispute
The insured employee may still file an ILOE claim even if a labour dispute is ongoing post termination, but the insurer may suspend or reject payment, until the courts resolve the dispute, especially if the reason for termination is contested. The outcome of the labour court proceedings can directly affect eligibility.
- Abdullah Ishnaneh, Partner, BSA Law
GAC GS8 Specs
Engine: 2.0-litre 4cyl turbo
Power: 248hp at 5,200rpm
Torque: 400Nm at 1,750-4,000rpm
Transmission: 8-speed auto
Fuel consumption: 9.1L/100km
On sale: Now
Price: From Dh149,900
Specs
Engine: 51.5kW electric motor
Range: 400km
Power: 134bhp
Torque: 175Nm
Price: From Dh98,800
Available: Now
More coverage from the Future Forum
UAE currency: the story behind the money in your pockets
New UK refugee system
- A new “core protection” for refugees moving from permanent to a more basic, temporary protection
- Shortened leave to remain - refugees will receive 30 months instead of five years
- A longer path to settlement with no indefinite settled status until a refugee has spent 20 years in Britain
- To encourage refugees to integrate the government will encourage them to out of the core protection route wherever possible.
- Under core protection there will be no automatic right to family reunion
- Refugees will have a reduced right to public funds
WITHIN%20SAND
%3Cp%3EDirector%3A%20Moe%20Alatawi%3C%2Fp%3E%0A%3Cp%3EStarring%3A%20Ra%E2%80%99ed%20Alshammari%2C%20Adwa%20Fahd%2C%20Muhand%20Alsaleh%3C%2Fp%3E%0A%3Cp%3ERating%3A%203%2F5%3C%2Fp%3E%0A
Scorecard:
England 458 & 119/1 (51.0 ov)
South Africa 361
England lead by 216 runs with 9 wickets remaining
HIJRA
Starring: Lamar Faden, Khairiah Nathmy, Nawaf Al-Dhufairy
Director: Shahad Ameen
Rating: 3/5
The Travel Diaries of Albert Einstein The Far East, Palestine, and Spain, 1922 – 1923
Editor Ze’ev Rosenkranz
Princeton
GIANT REVIEW
Starring: Amir El-Masry, Pierce Brosnan
Director: Athale
Rating: 4/5
Continental champions
Best Asian Player: Massaki Todokoro (Japan)
Best European Player: Adam Wardzinski (Poland)
Best North & Central American Player: DJ Jackson (United States)
Best African Player: Walter Dos Santos (Angola)
Best Oceanian Player: Lee Ting (Australia)
Best South American Player: Gabriel De Sousa (Brazil)
Best Asian Federation: Saudi Jiu-Jitsu Federation
The biog
Family: wife, four children, 11 grandchildren, 16 great-grandchildren
Reads: Newspapers, historical, religious books and biographies
Education: High school in Thatta, a city now in Pakistan
Regrets: Not completing college in Karachi when universities were shut down following protests by freedom fighters for the British to quit India
Happiness: Work on creative ideas, you will also need ideals to make people happy
Non-oil%20trade
%3Cp%3ENon-oil%20trade%20between%20the%20UAE%20and%20Japan%20grew%20by%2034%20per%20cent%20over%20the%20past%20two%20years%2C%20according%20to%20data%20from%20the%20Federal%20Competitiveness%20and%20Statistics%20Centre.%C2%A0%3C%2Fp%3E%0A%3Cp%3EIn%2010%20years%2C%20it%20has%20reached%20a%20total%20of%20Dh524.4%20billion.%C2%A0%3C%2Fp%3E%0A%3Cp%3ECars%20topped%20the%20list%20of%20the%20top%20five%20commodities%20re-exported%20to%20Japan%20in%202022%2C%20with%20a%20value%20of%20Dh1.3%20billion.%C2%A0%3C%2Fp%3E%0A%3Cp%3EJewellery%20and%20ornaments%20amounted%20to%20Dh150%20million%20while%20precious%20metal%20scraps%20amounted%20to%20Dh105%20million.%C2%A0%3C%2Fp%3E%0A%3Cp%3ERaw%20aluminium%20was%20ranked%20first%20among%20the%20top%20five%20commodities%20exported%20to%20Japan.%C2%A0%3C%2Fp%3E%0A%3Cp%3ETop%20of%20the%20list%20of%20commodities%20imported%20from%20Japan%20in%202022%20was%20cars%2C%20with%20a%20value%20of%20Dh20.08%20billion.%3C%2Fp%3E%0A
More from Aya Iskandarani
Champions parade (UAE timings)
7pm Gates open
8pm Deansgate stage showing starts
9pm Parade starts at Manchester Cathedral
9.45pm Parade ends at Peter Street
10pm City players on stage
11pm event ends
Emergency
Director: Kangana Ranaut
Stars: Kangana Ranaut, Anupam Kher, Shreyas Talpade, Milind Soman, Mahima Chaudhry
Rating: 2/5
THE SPECS
2020 Toyota Corolla Hybrid LE
Engine: 1.8 litre combined with 16-volt electric motors
Transmission: Automatic with manual shifting mode
Power: 121hp
Torque: 142Nm
Price: Dh95,900
The Brutalist
Director: Brady Corbet
Stars: Adrien Brody, Felicity Jones, Guy Pearce, Joe Alwyn
Rating: 3.5/5
RACE CARD
6.30pm Al Maktoum Challenge Round-1 Group 1 (PA) Dh119,373 (Dirt) 1,600m
7.05pm Handicap (TB) Dh102,500 (D) 1,200m
7.40pm Handicap (TB) Dh105,000 (Turf) 1,800m
8.15pm UAE 1000 Guineas Trial (TB) Dh183,650 (D) 1,400m
9.50pm Handicap (TB) Dh105,000 (D) 1,600m
9.25pm Handicap (TB) Dh95,000 (T) 1,000m
Analysis
Members of Syria's Alawite minority community face threat in their heartland after one of the deadliest days in country’s recent history. Read more
Who has lived at The Bishops Avenue?
- George Sainsbury of the supermarket dynasty, sugar magnate William Park Lyle and actress Dame Gracie Fields were residents in the 1930s when the street was only known as ‘Millionaires’ Row’.
- Then came the international super rich, including the last king of Greece, Constantine II, the Sultan of Brunei and Indian steel magnate Lakshmi Mittal who was at one point ranked the third richest person in the world.
- Turkish tycoon Halis Torprak sold his mansion for £50m in 2008 after spending just two days there. The House of Saud sold 10 properties on the road in 2013 for almost £80m.
- Other residents have included Iraqi businessman Nemir Kirdar, singer Ariana Grande, holiday camp impresario Sir Billy Butlin, businessman Asil Nadir, Paul McCartney’s former wife Heather Mills.
Hunting park to luxury living
- Land was originally the Bishop of London's hunting park, hence the name
- The road was laid out in the mid 19th Century, meandering through woodland and farmland
- Its earliest houses at the turn of the 20th Century were substantial detached properties with extensive grounds
Quick facts on cancer
- Cancer is the second-leading cause of death worldwide, after cardiovascular diseases
- About one in five men and one in six women will develop cancer in their lifetime
- By 2040, global cancer cases are on track to reach 30 million
- 70 per cent of cancer deaths occur in low and middle-income countries
- This rate is expected to increase to 75 per cent by 2030
- At least one third of common cancers are preventable
- Genetic mutations play a role in 5 per cent to 10 per cent of cancers
- Up to 3.7 million lives could be saved annually by implementing the right health
strategies
- The total annual economic cost of cancer is $1.16 trillion
Specs
Engine: Dual-motor all-wheel-drive electric
Range: Up to 610km
Power: 905hp
Torque: 985Nm
Price: From Dh439,000
Available: Now
