You can't delete bookmarks yet, but you will be able to in 0.8. In fact, they'll be totally bitching in 0.8. -Wil