Billy Ray Cyrus is trying to do right by his loved ones after saying that fame “destroyed my family” and that he was “scared” for daughter Miley.