Ben Carson and Barack Obama both referred to slaves as immigrants