Where did the people who were sent to the concentration camps/labour/extermination camps come from?

Germany, the Nazi's first order of "Cleansing" business was to round up the Jews in Germany. And it spread out from there.