For example, 500 people working long hours in dangerous conditions for terrible pay, but they make it possible for 5000 others to live in a utopian society. What about 50 workers and 50,000 benefactors? I think everyone can agree that it's wrong for there to be less benefactors than workers, but what about 50/50? What if it's 500 blue skinned people and a million red skinned?
I usually find myself internally preferring the species level ethical decisions, but I've never been brave enough to admit to it out loud because I know it makes me sound like a socio/psychopath.