To call someone an elite athlete, or part of an elite military unit, is a compliment. The descriptor distinguishes the individual or group as being in possession of superior talent or training than that of many contemporaries. Yet to say that someone is part of the elite is almost always contemptuous.