Deleting pins on system design tab

When creating a block diagram in the System tab, it doesn’t seem like I can delete pins even if I was the one that added them to a block. Is there a way to do this?