Raising the dead: how AI is allowing people to hear from lost loved ones again


Joshua Longmore
  • English
  • Arabic

In a plush, sun-drenched living room filled with modern, sleek furniture, a group of people huddle around a laptop to speak to their grandmother.

“How did becoming a grandparent change you?” one asks.

“It brought immense joy into my life,” says 87-year old Marina Smith, through what appears to be a live video call.

Ms Smith speaks seamlessly from her sofa, surrounded by flowers and family photos, smiling as she carefully considers each question she is asked.

“I enjoyed the company, going places and sharing. And the beautiful little things that would come out of a child’s life. And the simple trust in you. It’s very, very beautiful,” she adds.

The conversation, however, is not live.

The Holocaust campaigner from the UK actually died in June 2022 after a short illness.

The tender exchange above was made possible only by advances in artificial intelligence technology and the efforts of her son to document her life.

“It’s an opportunity to be a good ancestor,” Stephen Smith tells The National. “It’s like a living photo album you keep throughout your life. And like a photo album, it will survive you.”

Marina Smith talks to her grandchildren after her death. Photo: StoryFile
Marina Smith talks to her grandchildren after her death. Photo: StoryFile

Mr Smith, who lives in Los Angeles but is originally from Nottinghamshire in the UK, is an oral historian who has dedicated much of his life to the testimony of those who experienced extreme, historic events such as the Holocaust.

He is co-founder of the conversational AI video company StoryFile. He is also the son of Ms Smith.

A few months before she died, Mr Smith sat down to talk to his mother. He wanted to answer some lingering questions about his family history, as well as pass on her life story to his children.

Stephen Smith, right, is one of the co-founders of StoryFile. Photo: StoryFile
Stephen Smith, right, is one of the co-founders of StoryFile. Photo: StoryFile

“I interviewed her [on camera] over two days, two hours each day, and asked about 120 questions,” Mr Smith says. “I learnt things about her and her interests that I didn’t even know about.”

Mr Smith used his mother’s answers to create a conversational AI video of her, one that could listen to questions and talk back.

In the same way Ms Smith spoke to her grandchildren on a laptop after her death, she answered questions on a TV screen at her own funeral.

“What would you say at your funeral?” her son asked at the end of a touching service, which had been filled with loving tributes by friends and family members from around the world.

“I’m so pleased I met so many good people who influenced my life,” she replied. “I haven’t done everything right, but I’ve done the best I can with God’s help. I’m ready to go and be with him, for ever.”

All of the words were Ms Smith’s own and had been directly pulled from the interview conducted by her son. StoryFile does not use AI technology to put text that has been generated into people’s mouths.

Marina Smith answers questions at her own funeral. Photo: StoryFile
Marina Smith answers questions at her own funeral. Photo: StoryFile

Mr Smith said the experience was not strange at all and his only regret was not asking more questions during the interview.

“It was emotional. I think people were pleased to see her smile and hear her voice,” he says. “It didn’t feel spooky or like we were clinging on to her – it was natural.”

The technology works by recording participants as they answer questions about their lives. The answers are then uploaded to StoryFile’s cloud. The final product is an interactive video, ready to answer questions from loved ones as if they are having a normal conversation.

StoryFile has its own special studio for some users, but most people create their virtual self on a home computer. The idea is that future generations will be able to ask real questions and receive real answers about an ancestor’s personal story.

StoryFile has its own special studio, but the technology also works on most home computers. Photo: StoryFile
StoryFile has its own special studio, but the technology also works on most home computers. Photo: StoryFile

“There is going to be somebody that you don’t know yet, who is your great-great-great-grandchild, say, digging back into the past,” Mr Smith says. “You might be the key to information [they are looking for], you might know the family history or lineage, you might have stories they can dig into.”

The use of technology to reanimate the dead is not an entirely new phenomenon.

Long explored in science fiction, the concept recently became popular in the dystopian drama Black Mirror, created by Charlie Brooker.

In the ep isode Be Right Back, a young woman named Martha struggles to overcome her grief when her boyfriend Ash is killed in a car accident.

Martha, who finds out she is pregnant, recreates a digital version of Ash using data scraped from text messages, emails and videos. Ultimately she builds a synthetic, albeit imperfect, Ash who can walk and talk, and introduces him to their daughter.

While current technology does not allow for a carbon copy, humanoid version of oneself to be left behind for loved ones, in the digital space, things are moving quickly.

In April 2023, the South China Morning Post reported that a 24-year-old man in Shanghai had used AI to resurrect his grandmother to give him comfort after she died at 84 from coronavirus.

He used image software and old photos to create her face, and trained the AI to mimic her voice using recordings of their phone conversations.

Similarly, in South Korea, the company DeepBrain AI released a video that showed bereaved family members meeting and talking to loved ones who had passed away.

The word “griefbot” has sometimes been used online to describe such creations.

Also in South Korea, a mother burst into tears after being reunited with her seven-year-old daughter using virtual reality after the girl died from a blood disease.

“Mum, where have you been? Have you been thinking of me?” the daughter, Na-yeon, says.

“Always,” replies her mother, Jang Ji-sun.

The heart-rending footage struck a chord with many South Koreans, while highlighting the growing scope of possibilities for VR technology.

StoryFile does not currently offer its customers the ability to create a so-called griefbot, although Mr Smith says there might come a time in the future when they allow families to experiment with this.

But the technology can be imprecise. If there are secrets or finer details not picked up while gathering data, they would not be included in the bot and its subsequent personality.

“When you are a family member and you happen to know about grandpa’s blue Corvette, but grandpa didn’t talk about the blue Corvette [in his interview] … you feel like that secret has been lost a little,” Mr Smith says.

The demand for this technology stems from society’s difficulty in dealing with death, says psychologist and AI enthusiast Mike Brooks.

A digital, interactive likeness of oneself can be created in the home. Photo: StoryFile
A digital, interactive likeness of oneself can be created in the home. Photo: StoryFile

“Death, historically, was always final,” he tells The National. “But we have reached an inflection point in humanity, death is going to be different moving forward.”

Dr Brooks also envisions potential problems arising in the future, should griefbots become more commonplace.

He believes adverts could creep into the algorithm of such bots and worries about the trauma caused to a family should a bot’s data ever be lost.

For Mr Smith, while the technology he harnesses is all about preserving memories like those of his mother, he believes grief is an entirely personal journey.

“I don’t criticise anybody for creating a bot of their deceased family or friends,” he says. “If that is what helps you come to terms with it.”

Gifts exchanged
  • King Charles - replica of President Eisenhower Sword
  • Queen Camilla -  Tiffany & Co vintage 18-carat gold, diamond and ruby flower brooch
  • Donald Trump - hand-bound leather book with Declaration of Independence
  • Melania Trump - personalised Anya Hindmarch handbag
'Downton Abbey: A New Era'

Director: Simon Curtis

 

Cast: Hugh Bonneville, Elizabeth McGovern, Maggie Smith, Michelle Dockery, Laura Carmichael, Jim Carter and Phyllis Logan

 

Rating: 4/5

 
'The worst thing you can eat'

Trans fat is typically found in fried and baked goods, but you may be consuming more than you think.

Powdered coffee creamer, microwave popcorn and virtually anything processed with a crust is likely to contain it, as this guide from Mayo Clinic outlines: 

Baked goods - Most cakes, cookies, pie crusts and crackers contain shortening, which is usually made from partially hydrogenated vegetable oil. Ready-made frosting is another source of trans fat.

Snacks - Potato, corn and tortilla chips often contain trans fat. And while popcorn can be a healthy snack, many types of packaged or microwave popcorn use trans fat to help cook or flavour the popcorn.

Fried food - Foods that require deep frying — french fries, doughnuts and fried chicken — can contain trans fat from the oil used in the cooking process.

Refrigerator dough - Products such as canned biscuits and cinnamon rolls often contain trans fat, as do frozen pizza crusts.

Creamer and margarine - Nondairy coffee creamer and stick margarines also may contain partially hydrogenated vegetable oils.

AI traffic lights to ease congestion at seven points to Sheikh Zayed bin Sultan Street

The seven points are:

Shakhbout bin Sultan Street

Dhafeer Street

Hadbat Al Ghubainah Street (outbound)

Salama bint Butti Street

Al Dhafra Street

Rabdan Street

Umm Yifina Street exit (inbound)

The Voice of Hind Rajab

Starring: Saja Kilani, Clara Khoury, Motaz Malhees

Director: Kaouther Ben Hania

Rating: 4/5

How to get there

Emirates (www.emirates.com) flies directly to Hanoi, Vietnam, with fares starting from around Dh2,725 return, while Etihad (www.etihad.com) fares cost about Dh2,213 return with a stop. Chuong is 25 kilometres south of Hanoi.
 

The burning issue

The internal combustion engine is facing a watershed moment – major manufacturer Volvo is to stop producing petroleum-powered vehicles by 2021 and countries in Europe, including the UK, have vowed to ban their sale before 2040. The National takes a look at the story of one of the most successful technologies of the last 100 years and how it has impacted life in the UAE.

Read part three: the age of the electric vehicle begins

Read part two: how climate change drove the race for an alternative 

Read part one: how cars came to the UAE

The burning issue

The internal combustion engine is facing a watershed moment – major manufacturer Volvo is to stop producing petroleum-powered vehicles by 2021 and countries in Europe, including the UK, have vowed to ban their sale before 2040. The National takes a look at the story of one of the most successful technologies of the last 100 years and how it has impacted life in the UAE. 

Read part four: an affection for classic cars lives on

Read part three: the age of the electric vehicle begins

Read part two: how climate change drove the race for an alternative 

UAE currency: the story behind the money in your pockets
The years Ramadan fell in May

1987

1954

1921

1888

The five pillars of Islam

1. Fasting 

2. Prayer 

3. Hajj 

4. Shahada 

5. Zakat 

THE BIO

Family: I have three siblings, one older brother (age 25) and two younger sisters, 20 and 13 

Favourite book: Asking for my favourite book has to be one of the hardest questions. However a current favourite would be Sidewalk by Mitchell Duneier

Favourite place to travel to: Any walkable city. I also love nature and wildlife 

What do you love eating or cooking: I’m constantly in the kitchen. Ever since I changed the way I eat I enjoy choosing and creating what goes into my body. However, nothing can top home cooked food from my parents. 

Favorite place to go in the UAE: A quiet beach.

All%20We%20Imagine%20as%20Light
%3Cp%3E%3Cstrong%3EDirector%3A%20%3C%2Fstrong%3EPayal%20Kapadia%3C%2Fp%3E%0A%3Cp%3E%3Cstrong%3EStarring%3A%3C%2Fstrong%3E%20Kani%20Kusruti%2C%20Divya%20Prabha%2C%20Chhaya%20Kadam%3C%2Fp%3E%0A%3Cp%3E%3Cstrong%3ERating%3A%3C%2Fstrong%3E%204%2F5%3C%2Fp%3E%0A
The%20Color%20Purple
%3Cp%3E%3Cstrong%3EDirector%3A%20%3C%2Fstrong%3EBlitz%20Bazawule%3Cbr%3E%3Cstrong%3EStarring%3A%20%3C%2Fstrong%3EFantasia%20Barrino%2C%20Taraji%20P%20Henson%2C%20Danielle%20Brooks%2C%20Colman%20Domingo%3Cbr%3E%3Cstrong%3ERating%3A%3C%2Fstrong%3E%204%2F5%3C%2Fp%3E%0A

Profile Periscope Media

Founder: Smeetha Ghosh, one co-founder (anonymous)

Launch year: 2020

Employees: four – plans to add another 10 by July 2021

Financing stage: $250,000 bootstrap funding, approaching VC firms this year

Investors: Co-founders

The specs

Price, base / as tested Dh135,000

Engine 1.6L turbo

Gearbox Six speed automatic with manual and sports mode

Power 165hp @ 6,000rpm

Torque 240Nm @ 1,400rpm 0-100kph: 9.2 seconds

Top speed 420 kph (governed)

Fuel economy, combined 35.2L / 100km (est)

What are the influencer academy modules?
  1. Mastery of audio-visual content creation. 
  2. Cinematography, shots and movement.
  3. All aspects of post-production.
  4. Emerging technologies and VFX with AI and CGI.
  5. Understanding of marketing objectives and audience engagement.
  6. Tourism industry knowledge.
  7. Professional ethics.
UAE currency: the story behind the money in your pockets
Specs

Engine: Dual-motor all-wheel-drive electric

Range: Up to 610km

Power: 905hp

Torque: 985Nm

Price: From Dh439,000

Available: Now

Monster

Directed by: Anthony Mandler

Starring: Kelvin Harrison Jr., John David Washington 

3/5

 

The specs: 2018 Nissan 370Z Nismo

The specs: 2018 Nissan 370Z Nismo
Price, base / as tested: Dh182,178
Engine: 3.7-litre V6
Power: 350hp @ 7,400rpm
Torque: 374Nm @ 5,200rpm
Transmission: Seven-speed automatic
​​​​​​​Fuel consumption, combined: 10.5L / 100km

Book%20Details
%3Cp%3E%3Cem%3EThree%20Centuries%20of%20Travel%20Writing%20by%20Muslim%20Women%3C%2Fem%3E%3Cbr%3E%3Cstrong%3EEditors%3A%20%3C%2Fstrong%3ESiobhan%20Lambert-Hurley%2C%20Daniel%20Majchrowicz%2C%20Sunil%20Sharma%3Cbr%3E%3Cstrong%3EPublisher%3A%20%3C%2Fstrong%3EIndiana%20University%20Press%3B%20532%20pages%3Cbr%3E%3C%2Fp%3E%0A
UAE currency: the story behind the money in your pockets
UAE currency: the story behind the money in your pockets
Global state-owned investor ranking by size

1.

United States

2.

China

3.

UAE

4.

Japan

5

Norway

6.

Canada

7.

Singapore

8.

Australia

9.

Saudi Arabia

10.

South Korea

Updated: August 25, 2023, 6:00 PM`