CUDA lazy loading is not enabled. Enabling it can significantly reduce device memory usage and speed
CUDAlazyloadingisnotenabled.EnablingitcansignificantlyreducedevicememoryusageandspeedupTensorRTinitialization.See“LazyLoading”sectionofCUDAdocumentationhttps://docs.nv