I think that, with age, Howard realized that the "personality" he had been playing on THSS was a real dickhead. Look at what happened with Robin Williams. Howard shit on him, then regretted it for years, but couldn't face up to it. And then Williams died.
How many jellybeans are in Rosie's head?