In the event of uninstaller failure or lack of Windows uninstaller, you can use DOS command line to uninstall Windows drivers manually.
The command line tool is: PNPUtil.exe
Under command line, you can type in: pnputil -e
It would list down all the drivers.
Search for the drivers that are related to CalDigit or the driver files that you want to remove.
To remove the driver, use: pnputil -f -d XXXXX.inf
Where XXXXX.inf is the name showing on the list.
You may need Administrator account to remove driver files manually. In Windows, the drivers stored in /Windows/System32/driver folder and /Windows/System32/DriverStore/FileRepository/ folder. You should always try to use pnputil to remove drivers first, not to delete them directly from File Explorer.
Additional Information:
How to Manage Device Drivers with Command Line