What rights does an unmarried father have?

My ex is giving limiting my visits with our daughter since I started seeing someone else. My ex won't allow our daughter to go anyplace with me.