Should I transfer or wait it out? Will things just work out?

All the reasons you gave don't sound like you haven't given the school a chance. It just sounds like it's not the right school for you. Some people like the "one of many" atmosphere's of big schools. Clearly, you do not. I think the school in VT sounds like a perfect match for you.