Populism and democratic elitism

Who rules in a democracy? The word itself is of course supposed to answer the question: democracy is the rule of the people. But who counts as "the people"?