Philosophers are just awkward in general. I'm obviously including myself in that generalisation, and realise that I too am quite awkward. I've had some pretty awkward interactions, and frankly, I get tired of only talking about what kind of philosophy I'm interested in. I won't think too far into it though, I know I take a while to warm up to people, and I'm inflicted with resting bitch face so people take a while to warm up to me.
I think we do have to disentangle uncomfortable from straight awkwardness, though. If the department feels uncomfortable and it's not something you think time will solve, then trust your gut.
PS. @Naruto, if it's any consolation, I thought you were better at casual conversation than I was when we met at Western