Looking for a novel or short story - help needed

I don't know the title of a short story (or novel), I only know more or less what this is about. I hope you can help me out somehow.

So the main point, there is a man who is telling a stranger his story: he was together with a woman in a room, when suddenly the husband pops in. He kills his wife, but this man was naked, right next to the wall, and was so scared that he somehow "melted" into the wall and became invisible. He then spent the rest of his life wearing bath-robe.

This is all I know about this novel, but I'd like to read it.
I neither know the title nor the writer....