To use multiple CPUs for training on CPU (not GPU) you can specify torch.set_num_threads(<num_cpu>). Also see: https://pytorch.org/docs/master/generated/torch.set_num_threads.html
torch.set_num_threads(<num_cpu>)
torch.cuda.device_count()