It sounds like your biggest problem is with your dh. Like his brother already has, he needs to man up and realize YOU and your kids are his priority now.
that said it probably won't happen if you don't push the issue.
Everything Imotherother said....
Yup everything imotherothers and summergirl said.