Move to the Phone Number tab under settings

Select the number you wish to remove and navigate to the routing tab.

Set the Phone Number to Unassigned, From there select save. Once saved press the delete button and select delete when prompted to make sure you want to delete the following number.