Wim,
If you leave it alone for some time, it will let go of the port and you can delete it. However, sometimes one does not have time to wait. Go to print spooler service and stop the service, then restart it. After that, try to delete the port again. This worked for me hopefully for you too.
Juan