Abusive behavior escalates over time, so there will come a time when he does hit you, or in my case my husband kicked me. I was able to prove my case, so it is on record that he is domestically violent, berates me (still even though we are separated, calls me stupid, fat f****** [censored], and so on.
If you decide to leave and he has been unfaithful, and you can prove it,or he admits to it, then you can get an immediate divorce (depending on the laws in your state). You can look it up under the divorce laws for your state. Look under adultery.
Looking back I should have left many many years ago, not 38 years after getting married.
All the best to you. :D :D