When you hover over a chatbox, you find a cog wheel on the left side of the tab. Click that to open chat settings. From that menu at the bottom right corner you will find the block list, which you can either delete all or individual entries.