My now sisterwife tried for about 7 years to make things work with a man that was not moral, not commited, not faithful, and did not provide. As FollowingHim has said, how you proceed will say a lot about your character and let others see your sincere desire to do things right. Then too, you had good things to say about the man you married. He may be a better man then you will find moving on.And even if it fails, the fact that you seriously tried will go a long way to reassuring any future potential husband that you are of good, trustworthy character and worth marrying.
Even if you don't succeed at patching things up, you may have fewer regrets after trying.