I have to agree w/ cat.alley on this one--what he says does not make sense.
He is using it as an excuse to break up with you. He acts like it is your fault when its 50% his fault too since his house is also off limits.
The alternative is for him to be an adult and wait until the opportunity presents itself again, then you can again be intimate. Don't you see the larger issue here???!!!