I would like to integrate an automation that whenever I sign a deal as won, this triggers the removal of specific types of activities still pending on that deal (e.g. follow up).

You can automate it to add activities when signing a deal won but you cannot remove them. It's kind of weird.