You can delete a fence in a couple of easy steps.
To delete a fence:
Select the fence. You can select multiple fence segments using Shift+click.
Press the Delete key on your keyboard, or right-click and select Delete, or select Edit > Modify Elements > Delete.