Maak
Reputation: 33
Will gpu be still used for training if I don't transfer tensor and model to gpu using to(device)?
I am using google colab, and I need to know if it uses any GPU for training if I don't do model.to('cuda') and data.to('cuda')?
Upvotes: 0
Views: 520
Answers (1)
khashayar ehteshami
Reputation: 187
If you do not use model.to(torch.device('cuda')) and data.to(torch.device('cuda')) your model and all of your tensors will be remaining on default device which is CPU, so they do not understand the existence of GPU. PyTorch uses CPU for its work.
You can see this Link for more information about torch.device.
Upvotes: 1
Related Questions
- pytorch when do I need to use `.to(device)` on a model or tensor?
- Are both the GPU and CUDNN required for Tensorflow
- Will switching GPU device affect the gradient in PyTorch back propagation?
- PyTorch CUDA: "to(device)" vs "device=device" for tensors?
- Are PyTorch-trained models transferable between GPUs and TPUs?
- Can a model trained using a GPU be used for inference on a CPU?
- Pytorch: What happens to memory when moving tensor to GPU?
- How to use GPU while training a model?
- Does TensorFlow use all of the hardware on the GPU?
- Can a model trained on gpu used on cpu for inference and vice versa?