Being alone is not the same as being lonely....

I've been looking for this book ever since I was a kid. I always wanted to read it. It was a red book on my great grandmother's library shelf. I always want to say the scarlet lady, but I don't think that was it. I once pulled it down and read the first few pages. To this day I remember the quote, "To be alone is not the same as being lonely. To be alone is to be free by yourself in the world. To be lonely is to be set among a pillar of a thousand eyes that judge and condem."

I don't remember the title of the book and didn't read more than that (also not a direct quote since it has been decades). I was wondering if anyone knew the book. I've looked up quotes online, but found nothing.