Running on Multiple Nodes with GPU Package

As I understand it from the manual the "-pk gpu 2" should mean 2 GPUS per node. Is that correct?

Yes, that is correct. To be safe you could specify something like
"--npersocket 8" but I don't think that is necessary since you are
using all of the cores per node.

Stan