There were native people living there (in ways that leave little trace in the archaeological record), I've heard it argued that many colonists may have chosen to join them.
Related, some good examples of this elsewhere during the colonies, with first person evidence cited in Tribe (http://www.sebastianjunger.com/tribe-by-sebastian-junger)