If you are okay with it, why not? Just be careful in the grass, as mngirl says, aerating the grass isn't fun, when you are doing it with your shoes.
Outfit sounds sexy.. go for it! I wear pumps with my jeans all the time. Since you might be on uneven ground though, you could consider lower heels (2.5" or 3"?) as long as your jeans won't be dragging the ground.
Have fun and enjoy the look!
If you and your husband both like those heels, then wear them.