Neither Settler nor Native - The Making and Unmaking of Permanent Minorities