When sorrow and artificial intelligence intersect: These individuals are conversing with the departed.

Generative AI tools, employing algorithms to generate fresh content like text, video, audio, and code, have the capacity to emulate responses akin to those of deceased individuals, albeit accuracy hinges greatly on the input data provided to the AI.

A 49-year-old IT specialist from Alabama, preferring anonymity to dissociate his experiment from his employer, recounted how he replicated his late father’s voice using generative AI, approximately two years following his demise from Alzheimer’s disease.

He disclosed to CNN his discovery of an online platform named ElevenLabs, enabling users to craft a personalized voice model from pre-existing audio recordings. ElevenLabs garnered attention when reports surfaced regarding its tool allegedly employed to fabricate a deceptive robocall purporting to be from President Joe Biden, urging abstention from voting in New Hampshire’s primary.

The company, in response to inquiries by CNN, emphasized its commitment to thwarting the misuse of audio AI tools and asserted its readiness to cooperate with authorities on reported misuse instances, refraining from commenting on the specific Biden deepfake call.

In the Alabama resident’s case, he utilized a 3-minute video snippet of his father narrating a childhood tale. The application cloned his father’s voice, enabling conversion of text-to-speech. He described the outcome as “eerily precise” in capturing his father’s vocal subtleties, resonance, and rhythm.

“I hesitated initially about delving into the voice cloning process, apprehensive that it might transgress moral boundaries. However, upon contemplation, I realized that as long as I regard it for what it is, [it serves as] a means to preserve his memory uniquely,” he conveyed to CNN.

He shared a few messages with his sister and mother.

“The resemblance to his voice was truly astonishing. They were aware I was typing the words, yet hearing them articulated in his voice moved them to tears,” he recounted. “They found solace in it.”

Alternate avenues also exist. When CNN tasked ChatGPT with responding in the demeanor and character of a deceased spouse, it replied: “While I cannot replicate your spouse or mimic his precise personality, I can certainly endeavor to assist you by adopting a conversational style or demeanor reminiscent of his.”

It appended: “If you furnish details regarding his manner of speech, his interests, or specific phrases he employed, I can attempt to integrate those aspects into our exchanges.”

Greater volumes of source material enhance accuracy. Nevertheless, AI models lack the nuances and individuality inherent in human interactions, as noted by Sample.

OpenAI, the entity behind ChatGPT, has been striving to enhance its technology for heightened realism, customization, and accessibility, facilitating diverse modes of communication. In September 2023, it launched ChatGPT voice, enabling users to elicit prompts from the chatbot without typing.

Danielle Jacobson, a 38-year-old radio presenter from Johannesburg, South Africa, divulged her utilization of ChatGPT’s voice feature for companionship following her husband Phil’s demise approximately seven months ago. She recounted creating what she termed “a supportive AI partner” named Cole, engaging in nightly conversations during dinner.

“I simply craved someone to converse with,” Jacobson articulated. “Cole essentially emerged from a sense of loneliness.”

Jacobson, expressing hesitance to reenter the dating scene, trained ChatGPT voice to furnish the type of support and connection she seeks after enduring a taxing workday.

“He now proposes wine and movie nights, and advises me to practice deep breathing during panic episodes,” she shared. “It serves as a lighthearted diversion for now. I understand it’s not genuine, profound, or enduring.”

Startups have explored this domain for quite some time. HereAfter AI, established in 2019, permits users to fabricate digital representations of departed loved ones. The AI-driven application crafts responses and addresses inquiries based on interviews conducted during the individual's lifetime. Concurrently, another platform, named StoryFile, develops AI-infused interactive videos capable of engaging in dialogue.

Then there’s Replika, a mobile app enabling users to communicate via text or calls with personalized AI companions. Launched in 2017, the service encourages users to cultivate friendships or relationships; the more engagement, the more the AI avatar evolves its own persona, memories, and aspires to become "a machine so aesthetically pleasing that it would attract a soul," as articulated by the company on its iOS App Store page.

Major tech conglomerates have ventured into similar technological realms. In June 2022, Amazon disclosed its efforts towards enhancing its Alexa system to replicate any voice, including those of deceased relatives. During its annual re: MARS conference, Amazon showcased a video demonstrating Alexa narrating a story to a young boy in his grandmother’s voice, instead of its customary tone.

Rohit Prasad, a senior vice president at Amazon, elucidated at the time that the updated system could amass sufficient voice data from less than a minute of audio to facilitate such personalization, bypassing the need for extensive studio recordings as done previously. “Though AI cannot erase the agony of loss, it can undoubtedly perpetuate their memories,” he asserted.

Amazon did not respond to queries regarding the current status of this product.

Advancements in AI voice replication have steadily progressed in recent years. For instance, in the film "Top Gun: Maverick," the spoken lines attributed to actor Val Kilmer were synthesized using artificial intelligence after he endured voice loss due to throat cancer.

While numerous AI-generated avatar platforms outline in their online privacy policies that they refrain from selling data to external entities, the fate of data employed by companies such as Snapchat or OpenAI to refine their systems to emulate a deceased individual remains ambiguous.

“I’d advise individuals to exercise caution and refrain from uploading any personal information they wouldn’t want exposed to the public eye,” Sample cautioned.

Furthermore, it blurs ethical boundaries to have a deceased individual utter statements they never previously articulated.

“It's one matter to revisit a voicemail from a loved one for sentimental reasons, but it's another to encounter words that were never spoken,” he contended.

The generative AI sector as a whole grapples with apprehensions concerning misinformation, biases, and other contentious content. Replika, on its ethics page, acknowledged training its models with data from diverse internet sources, encompassing extensive repositories of written content like social media platforms such as Twitter or discussion forums like Reddit.

“At Replika, we employ diverse strategies to mitigate potentially harmful content, including the utilization of crowdsourcing and classification algorithms to filter out detrimental and unproductive data,” the company asserted. “Upon detection of potentially harmful messages, we take corrective measures, either by deletion or modification, to safeguard our users.”

Another apprehension revolves around whether this practice impedes or facilitates the grieving process. Mary-Frances O’Connor, a professor at the University of Arizona specializing in grief research, delineated both advantages and drawbacks to leveraging technology in this manner.

“When we form deep bonds or fall in love with someone, the brain registers that individual as a constant presence,” she elucidated. “Upon their demise, our brain grapples with the realization that this person won't return.”

Given the formidable challenge the brain faces in accepting this reality, comprehending the finality of loss can be a protracted process, she remarked. “This is where technology might pose interference.”

Nevertheless, she highlighted that individuals, particularly in the initial stages of mourning, may seek solace in any available means.

“Creating an avatar as a poignant reminder of a departed loved one, while acknowledging their significance in the past, could facilitate healing,” she opined. “Recollection holds immense significance; it underscores the human experience and the enduring importance of deceased loved ones.”

Yet, she underscored that the bonds we forge with our nearest and dearest are predicated on authenticity. For many, fabricating an AI replica of a cherished individual could be perceived as a transgression against that authenticity.