Google is trying to create new method to classify skin tones to remove racial bias. Reuters
Google is trying to create new method to classify skin tones to remove racial bias. Reuters
Google is trying to create new method to classify skin tones to remove racial bias. Reuters
Google is trying to create new method to classify skin tones to remove racial bias. Reuters

Google is developing a new method to classify skin tones to curb bias


  • English
  • Arabic

Alphabet Inc's Google told Reuters this week it is developing an alternative to the industry standard method for classifying skin tones, which a growing chorus of technology researchers and dermatologists says is inadequate for assessing whether products are biased against people of colour.

At issue is a six-colour scale known as Fitzpatrick Skin Type (FST), which dermatologists have used since the 1970s. Tech companies now rely on it to categorise people and measure whether products such as facial recognition systems or smartwatch heart-rate sensors perform equally well across skin tones.

Ensuring technology works well for all skin colours, as well different ages and genders, is assuming greater importance as new products, often powered by artificial intelligence (AI)

Critics say FST, which includes four categories for "white" skin and one apiece for "black" and "brown," disregards diversity among people of colour. Researchers at the US Department of Homeland Security, during a federal technology standards conference last October, recommended abandoning FST for evaluating facial recognition because it poorly represents colour range in diverse populations.

In response to Reuters' questions about FST, Google, for the first time and ahead of peers, said that it has been quietly pursuing better measures.

"We are working on alternative, more inclusive, measures that could be useful in the development of our products, and will collaborate with scientific and medical experts, as well as groups working with communities of colour," the company said, declining to offer details on the effort.

The controversy is part of a larger reckoning over racism and diversity in the tech industry, where the workforce is more white than in sectors like finance. Ensuring technology works well for all skin colours, as well as different ages and genders, is assuming greater importance as new products, often powered by artificial intelligence (AI), extend into sensitive and regulated areas such as healthcare and law enforcement.

Companies know their products can be faulty for groups that are under-represented in research and testing data. The concern over FST is that its limited scale for darker skin could lead to technology that, for instance, works for golden brown skin but fails for espresso red tones.

Numerous types of products offer palettes far richer than FST. Crayola last year launched 24 skin tone crayons, and Mattel's Barbie Fashionistas dolls this year cover nine tones.

The issue is far from academic for Google. When the company announced in February that cameras on some Android phones could measure pulse rates via a fingertip, it said readings on average would err by 1.8 per cent regardless of whether users had light or dark skin.

The company later gave similar warranties that skin type would not noticeably affect results of a feature for filtering backgrounds on Meet video conferences, nor of an upcoming web tool for identifying skin conditions, informally dubbed Derm Assist.

Those conclusions derived from testing with the six-tone FST.

A starting point

The late Harvard University dermatologist Dr Thomas Fitzpatrick invented the scale to personalise ultraviolet radiation treatment for psoriasis, an itchy skin condition. He grouped the skin of "white" people as Roman numerals I to IV by asking how much sunburn or tan they developed after certain periods in sun.

A decade later came type V for "brown" skin and VI for "black." The scale is still part of US regulations for testing sunblock products, and it remains a popular dermatology standard for assessing patients' cancer risk and more.

Some dermatologists say the scale is a poor and overused measure for care, and often conflated with race and ethnicity.

Many people would assume I am skin type V, which rarely to never burns, but I burn. To look at my skin hue and say I am type V does me disservice

"Many people would assume I am skin type V, which rarely to never burns, but I burn," said Dr Susan Taylor, a University of Pennsylvania dermatologist who founded Skin of Colour Society in 2004 to promote research on marginalised communities. "To look at my skin hue and say I am type V does me disservice."

Technology companies, until recently, were unconcerned. Unicode, an industry association overseeing emojis, referred to FST in 2014 as its basis for adopting five skin tones beyond yellow, saying the scale was "without negative associations."

A 2018 study titled Gender Shades, which found facial analysis systems more often misgendered people with darker skin, popularised using FST for evaluating AI. The research described FST as a "starting point," but scientists of similar studies that came later told Reuters they used the scale to stay consistent.

"As a first measure for a relatively immature market, it serves its purpose to help us identify red flags," said Inioluwa Deborah Raji, a Mozilla fellow focused on auditing AI.

In an April study testing AI for detecting deepfakes, Facebook researchers wrote FST "clearly does not encompass the diversity within brown and black skin tones." Still, they released videos of 3,000 individuals to be used for evaluating AI systems, with FST tags attached based on the assessments of eight human raters.

The judgment of the raters is central. Facial recognition software startup AnyVision last year gave celebrity examples to raters: former baseball great Derek Jeter as a type IV, model Tyra Banks a V and rapper 50 Cent a VI.

AnyVision told Reuters it agreed with Google's decision to revisit use of FST, and Facebook said it is open to better measures.

Microsoft and smartwatch makers Apple and Garmin reference FST when working on health-related sensors.

But use of FST could be fuelling "false assurances" about heart rate readings from smartwatches on darker skin, University of California San Diego clinicians, inspired by the Black Lives Matter social equality movement, wrote in the journal Sleep last year.

Microsoft acknowledged FST's imperfections. Apple said it tests on humans across skin tones using various measures, FST only at times among them. Garmin said due to wide-ranging testing it believes readings are reliable.

Victor Casale, who founded makeup company Mob Beauty and helped Crayola on the new crayons, said he developed 40 shades for foundation, each different from the next by about 3 per cent, or enough for most adults to distinguish.

Colour accuracy on electronics suggest tech standards should have 12 to 18 tones, he said, adding, “you can’t just have six.”

The years Ramadan fell in May

1987

1954

1921

1888

Need to know

When: October 17 until November 10

Cost: Entry is free but some events require prior registration

Where: Various locations including National Theatre (Abu Dhabi), Abu Dhabi Cultural Center, Zayed University Promenade, Beach Rotana (Abu Dhabi), Vox Cinemas at Yas Mall, Sharjah Youth Center

What: The Korea Festival will feature art exhibitions, a B-boy dance show, a mini K-pop concert, traditional dance and music performances, food tastings, a beauty seminar, and more.

For more information: www.koreafestivaluae.com

UAE currency: the story behind the money in your pockets
MADAME%20WEB
%3Cp%3EDirector%3A%20S.J.%20Clarkson%3C%2Fp%3E%0A%3Cp%3EStarring%3A%20Dakota%20Johnson%2C%20Tahar%20Rahim%2C%20Sydney%20Sweeney%3C%2Fp%3E%0A%3Cp%3ERating%3A%203.5%2F5%3C%2Fp%3E%0A
Volvo ES90 Specs

Engine: Electric single motor (96kW), twin motor (106kW) and twin motor performance (106kW)

Power: 333hp, 449hp, 680hp

Torque: 480Nm, 670Nm, 870Nm

On sale: Later in 2025 or early 2026, depending on region

Price: Exact regional pricing TBA

Founders: Abdulmajeed Alsukhan, Turki Bin Zarah and Abdulmohsen Albabtain.

Based: Riyadh

Offices: UAE, Vietnam and Germany

Founded: September, 2020

Number of employees: 70

Sector: FinTech, online payment solutions

Funding to date: $116m in two funding rounds  

Investors: Checkout.com, Impact46, Vision Ventures, Wealth Well, Seedra, Khwarizmi, Hala Ventures, Nama Ventures and family offices

UAE%20ILT20
%3Cp%3E%3Cstrong%3EMarquee%20players%3A%3C%2Fstrong%3E%3Cbr%3EMoeen%20Ali%2C%20Andre%20Russell%2C%20Dawid%20Malan%2C%20Wanindu%20Hasiranga%2C%20Sunil%20Narine%2C%20Evin%20Lewis%2C%20Colin%20Munro%2C%20Fabien%20Allen%2C%20Sam%20Billings%2C%20Tom%20Curran%2C%20Alex%20Hales%2C%20Dushmantha%20Chameera%2C%20Shimron%20Hetmyer%2C%20Akeal%20Hosein%2C%20Chris%20Jordan%2C%20Tom%20Banton%2C%20Sandeep%20Lamichhane%2C%20Chris%20Lynn%2C%20Rovman%20Powell%2C%20Bhanuka%20Rajapaksa%2C%20Mujeeb%20Ul%20Rahman%3C%2Fp%3E%0A%3Cp%3E%3Cstrong%3EInternational%20players%3A%3C%2Fstrong%3E%3C%2Fp%3E%0A%3Cp%3ELahiru%20Kumara%2C%20Seekugge%20Prassanna%2C%20Charith%20Asalanka%2C%20Colin%20Ingram%2C%20Paul%20Stirling%2C%20Kennar%20Lewis%2C%20Ali%20Khan%2C%20Brandon%20Glover%2C%20Ravi%20Rampaul%2C%20Raymon%20Reifer%2C%20Isuru%20Udana%2C%20Blessing%20Muzarabani%2C%20Niroshan%20Dickwella%2C%20Hazaratullah%20Zazai%2C%20Frederick%20Klassen%2C%20Sikandar%20Raja%2C%20George%20Munsey%2C%20Dan%20Lawrence%2C%20Dominic%20Drakes%2C%20Jamie%20Overton%2C%20Liam%20Dawson%2C%20David%20Wiese%2C%20Qais%20Ahmed%2C%20Richard%20Gleeson%2C%20James%20Vince%2C%20Noor%20Ahmed%2C%20Rahmanullah%20Gurbaz%2C%20Navin%20Ul%20Haq%2C%20Sherfane%20Rutherford%2C%20Saqib%20Mahmood%2C%20Ben%20Duckett%2C%20Benny%20Howell%2C%20Ruben%20Trumpelman%3C%2Fp%3E%0A
NEW%20UTILITY%20POLICY%3A%20WHAT%20DOES%20IT%20REGULATE%3F
%3Cp%3E%E2%80%A2%20Agreements%20on%20energy%20and%20water%20supply%3C%2Fp%3E%0A%3Cp%3E%E2%80%A2%20Applied%20service%20fees%3C%2Fp%3E%0A%3Cp%3E%E2%80%A2%20Customer%20data%20and%20information%20privacy%3C%2Fp%3E%0A%3Cp%3E%E2%80%A2%20Prohibition%20of%20service%20disconnections%3C%2Fp%3E%0A%3Cp%3E%E2%80%A2%20Customer%20complaint%20process%3C%2Fp%3E%0A%3Cp%3E%E2%80%A2%20Management%20of%20debts%20and%20customers%20in%20default%3C%2Fp%3E%0A%3Cp%3E%E2%80%A2%20Services%20provided%20to%20people%20of%20determination%20and%20home%20care%20customers%3C%2Fp%3E%0A
The specs

Engine: 6.2-litre V8

Transmission: ten-speed

Power: 420bhp

Torque: 624Nm

Price: Dh325,125

On sale: Now

The specs

Engine: 2.0-litre 4cyl turbo

Power: 261hp at 5,500rpm

Torque: 405Nm at 1,750-3,500rpm

Transmission: 9-speed auto

Fuel consumption: 6.9L/100km

On sale: Now

Price: From Dh117,059

Abandon
Sangeeta Bandyopadhyay
Translated by Arunava Sinha
Tilted Axis Press 

The candidates

Dr Ayham Ammora, scientist and business executive

Ali Azeem, business leader

Tony Booth, professor of education

Lord Browne, former BP chief executive

Dr Mohamed El-Erian, economist

Professor Wyn Evans, astrophysicist

Dr Mark Mann, scientist

Gina MIller, anti-Brexit campaigner

Lord Smith, former Cabinet minister

Sandi Toksvig, broadcaster

 

How to apply for a drone permit
  • Individuals must register on UAE Drone app or website using their UAE Pass
  • Add all their personal details, including name, nationality, passport number, Emiratis ID, email and phone number
  • Upload the training certificate from a centre accredited by the GCAA
  • Submit their request
What are the regulations?
  • Fly it within visual line of sight
  • Never over populated areas
  • Ensure maximum flying height of 400 feet (122 metres) above ground level is not crossed
  • Users must avoid flying over restricted areas listed on the UAE Drone app
  • Only fly the drone during the day, and never at night
  • Should have a live feed of the drone flight
  • Drones must weigh 5 kg or less
The specs

Engine: 1.5-litre turbo

Power: 181hp

Torque: 230Nm

Transmission: 6-speed automatic

Starting price: Dh79,000

On sale: Now

Company profile

Name: Fruitful Day

Founders: Marie-Christine Luijckx, Lyla Dalal AlRawi, Lindsey Fournie

Based: Dubai, UAE

Founded: 2015

Number of employees: 30

Sector: F&B

Funding so far: Dh3 million

Future funding plans: None at present

Future markets: Saudi Arabia, potentially Kuwait and other GCC countries

UAE currency: the story behind the money in your pockets
Profile of Hala Insurance

Date Started: September 2018

Founders: Walid and Karim Dib

Based: Abu Dhabi

Employees: Nine

Amount raised: $1.2 million

Funders: Oman Technology Fund, AB Accelerator, 500 Startups, private backers

 

Company name: Farmin

Date started: March 2019

Founder: Dr Ali Al Hammadi 

Based: Abu Dhabi

Sector: AgriTech

Initial investment: None to date

Partners/Incubators: UAE Space Agency/Krypto Labs 

COMPANY%20PROFILE%20
%3Cp%3EName%3A%20DarDoc%3Cbr%3EBased%3A%20Abu%20Dhabi%3Cbr%3EFounders%3A%20Samer%20Masri%2C%20Keswin%20Suresh%3Cbr%3ESector%3A%20HealthTech%3Cbr%3ETotal%20funding%3A%20%24800%2C000%3Cbr%3EInvestors%3A%20Flat6Labs%2C%20angel%20investors%20%2B%20Incubated%20by%20Hub71%2C%20Abu%20Dhabi's%20Department%20of%20Health%3Cbr%3ENumber%20of%20employees%3A%2010%3C%2Fp%3E%0A