Tell your guests to bring their broomsticks with them and leave them at the door. Anyone who arrives without a broomstick isn’t allowed inside. After all, this is a party only for wicked Hogwarts wizards...