I know it's hard, having those two sets of memories. But that impulse doesn't have to overcome the knowledge of where you are now.
I don't know what your experiences with the Doctor in that life were. All I have are my own experiences and memories of the first Hellburbia, but you and everyone else here deserve better than what that place ultimately is.

[And any esteem he might have for the Doctor is much better redirected for Fitz's benefit. If the former has any good qualities it's because there is something innate to Fitz's nature that even AIDA couldn't reprogram completely.]