am I being paranoid?

Newborn screening catches a lot, but it doesn't necessarily catch all hearing losses -- especially if they are progressive. You may want to go ahead and have his hearing checked. You may also have a speech/language evaluation done through your local child find or early intervention services to see if there is a receptive language issue.