Not sure if these are red flags or not....

For me, a guy wanting me to go to his place on the first (ok, I understand the circumstances) and then the second date would be weird. I also think that he should have understood why you wouldn't want. He might be one of these guys who want it too easy. If he doesn't agree on meeting in a restaurant, I would say forget him, since you're not too attracted anyways.

It's funny how when we're not sure about someone, it's often more than just the lack of physical attraction. I'm going to see if I see more of the things I didn't like about the guy I met last week tonight (I wrote about it in the other thread of yours).

I do think you are overthinking it some.