You split up with him for a reason
whatever that might have been. It's been years ago, he lived his life, you lived yours. Ofcourse memories live on, but people change as they get older. He has bagage, you have bagage... let the past be for what it's worth, as nice as what it all seems right now, don't throw away what you have now for something that possibly could never last.