Good times, bad times, you know I've had my share
When my woman left home for a brown-eyed man
but I still don't seem to care
He's been through his share of ups and downs, including heartbreak.
The use of "brown-eyed man" recalls (and is possibly a direct reference to) Van Morrison, who released Brown Eyed Girl a couple of years prior to this song.