This sounds tragic, I'm sorry for your loss. Most people here are advising you to give it back, which also seems to be the legally correct way to me.
But, since it's both about a promise that is up to interpretation and about a sizable amount of money, I'd ask a lawyer.
It's right there in that guy's palm!