when you delete a file in many email programs they're actually moved to a recycle bin so you can often find them there until the recycle bin is emptied.

When you empty the recycle bin, then the messages are actually deleted.

Might be different with different programs though