Pomni
Home / Articles / AI copy
AI copy

Can an AI copy do harm - and how we protect against it

March 20, 20262 min readPomni

Any powerful technology carries risks. We name them honestly and build protection right into the product.

Contents
  1. The risk of dependency
  2. The risk of distorting memory
  3. Crisis guardian
  4. Honesty about the risks

The risk of dependency

The main risk is getting stuck talking with the copy instead of living through grief. Farewell mode and gentle reminders of reality work against this.

The risk of distorting memory

So the copy does not 'invent' the person, it answers only from the data that was gathered. No fabrications - only what truly was.

Crisis guardian

If troubling signals appear in a conversation, the service gently offers psychological support resources. A person's safety matters more than the dialogue.

Honesty about the risks

We do not pretend the technology is safe on its own. The risks are real, so protection is built into the product rather than buried in fine print. Acknowledging the limits is part of a responsible approach.

  • Risk of dependency to farewell mode.
  • Risk of distortion to gathered facts only.
  • A crisis guardian offers help.
  • Control and deletion stay with the family.

Frequently asked questions

Can a copy deepen grief?
If misused - yes; that is why farewell mode, reminders of reality, and a crisis guardian are built in.
What if the conversations feel too hard?
Pause the copy or use farewell mode; if you need it, reach out to a therapist.

Save the story while it is with you

Create a memorial page in a few minutes — gently, beautifully and with respect for your loved ones. Free forever for the text version.

Create a memorial
Pomni editors

We help families gently preserve the memory of their loved ones. The materials are written with respect for the subject of loss and are regularly updated. About · Support resources

Read also

AI copy

How an AI copy differs from a deepfake

The difference between a gentle AI memory copy and a deepfake: consent, transparency, purpose, and control.

March 21, 20262 min
AI copy

What data makes for a good copy

What to gather for a true-to-life AI copy: stories, facts, voice, messages, and photos. The fuller the memory, the more accurate the likeness.

March 22, 20262 min
AI copy

The technology behind an AI copy

What technologies Pomni uses for an AI copy: a language model, speech recognition and synthesis, and a 3D avatar.

March 23, 20262 min