When logged in as a member and go to the address book you can edit the addresses but you can't delete any.
This is the same in admin under the customers tab, there is an address delete facility but it doesn't work. After saving the changes the deleted address is still showing.
Also when you edit an address in the members area or admin this does not change unless you refresh the page.