The bees

we had bee's going into a small hole by our front door. i thought we should live and let live until i heard of people getting swarmed by bee's. so i asked the husband to seal them off, which is a sad thing to do since they will eventually die in there with their queen. well, he did that and the ones that got locked out kept trying to get into different holes. we kept killing the loners since no other hive would accept them and who knows they were not smart enough to go and start their own colony. we have no more bee's coming to my front door. today i am typing in a room and i hear the hum of bee's? what the hell! i think they are burrowing through the house and will come out of a vent or something. should i be scared?  yep.