I thought about this a lot, too but I mostly wondered about Anya part. IMO, Buffy/Xander/Willow/Giles were always the Scoobies. Even Anya and Tara weren't a complete pert of the gang. That bothered me a lot.

Spike is supposed to be a loner. That's the part of his charm.