I think you are likely safe for staying at the level you are at at four pumps (no guarantees of course) but I agree with the previous poster that you would probably have to pump more to create an increase in supply since lactation is a supply-demand process. Hope you find a balance that works for you!
Since you are still before the 12 week mark, it is possible you can still increase your supply.