Delete the associated .esp plugin files. This method ensures the mod doesn't contribute to increased BA2 usage and serves as a direct replacement for the DLC sound archives.
To avoid hitting the game's BA2 archive limit, advanced users can rename the mod archives to replace the vanilla files directly: fallout 4 english voice pack link