Hi Joseph,
If you want to fully uninstall a plug-in then you can use the PluginManager to find the installation path for the plug-in and delete it from your machine.
For example, plug-ins installed via .RHI packages will end up in %APPDATA%\McNeel\Rhinoceros\5.0\Plug-ins\<name> (<id>).