I always wrote with the idea that what I put out there is going to stay there. Once I publish something, it has been published. I've never deleted more than one or two posts from my site. I don't think that there are takebacks. I don't feel right about it.
In terms of being late or not starting at all, then it's never too late.