ionut@ServerS:~$ mpirun -np 8 ./lammps-16Mar18/src/lmp_kokkos_cuda_mpi -in in.not_working_Si_cluster -k on g 8 -sf kk LAMMPS (2 Aug 2018) KOKKOS mode is enabled (../kokkos.cpp:45) using 8 GPU(s) Created orthogonal box = (-100 -100 -100) to (100 100 100) 2 by 2 by 2 MPI processor grid Lattice spacing in x,y,z = 5.4305 5.4305 5.4305 Created 1686 atoms Time spent = 0.00476867 secs Neighbor list info ... update every 10 steps, delay 0 steps, check no max neighbors/atom: 2000, page size: 100000 master list distance cutoff = 12 ghost atom cutoff = 12 binsize = 6, bins = 34 34 34 2 neighbor lists, perpetual/occasional/extra = 2 0 0 (1) pair reax/c/kk, perpetual attributes: full, newton off, ghost, kokkos_device pair build: full/bin/ghost/kk/device stencil: full/ghost/bin/3d bin: kk/device (2) fix qeq/reax/kk, perpetual, copy from (1) attributes: full, newton off, ghost, kokkos_device pair build: copy/kk/device stencil: none bin: none Setting up Verlet run ... Unit style : real Current step : 0 Time step : 0.25 WARNING: Fixes cannot yet send data in Kokkos communication, switching to classic communication (../comm_kokkos.cpp:463) Cuda const random access View using Cuda texture memory requires Kokkos to allocate the View's memory[ServerS:08920] *** Process received signal *** [ServerS:08920] Signal: Aborted (6) [ServerS:08920] Signal code: (-6) Cuda const random access View using Cuda texture memory requires Kokkos to allocate the View's memory[ServerS:08923] *** Process received signal *** [ServerS:08923] Signal: Aborted (6) [ServerS:08923] Signal code: (-6) [ServerS:08920] [ 0] /lib/x86_64-linux-gnu/libpthread.so.0(+0x11390)[0x7f606d636390] [ServerS:08920] [ServerS:08923] [ 0] [ 1] /lib/x86_64-linux-gnu/libc.so.6(gsignal+0x38)[0x7f606c9e3428] [ServerS:08920] [ 2] /lib/x86_64-linux-gnu/libpthread.so.0(+0x11390)[0x7f3ece096390] [ServerS:08923] [ 1] /lib/x86_64-linux-gnu/libc.so.6(abort+0x16a)[0x7f606c9e502a] [ServerS:08920] [ 3] ./lammps-16Mar18/src/lmp_kokkos_cuda_mpi[0x13ad7c1] [ServerS:08920] [ 4] ./lammps-16Mar18/src/lmp_kokkos_cuda_mpi[0x6588ba] [ServerS:08920] [ 5] ./lammps-16Mar18/src/lmp_kokkos_cuda_mpi[0x774f00] [ServerS:08920] [ 6] ./lammps-16Mar18/src/lmp_kokkos_cuda_mpi[0xf68acb] [ServerS:08920] [ 7] ./lammps-16Mar18/src/lmp_kokkos_cuda_mpi[0x560b27] [ServerS:08920] [ 8] /lib/x86_64-linux-gnu/libc.so.6(gsignal+0x38)[0x7f3ecd443428] [ServerS:08923] [ 2] ./lammps-16Mar18/src/lmp_kokkos_cuda_mpi[0xbce319] [ServerS:08920] [ 9] ./lammps-16Mar18/src/lmp_kokkos_cuda_mpi[0xbcc601] [ServerS:08920] [10] ./lammps-16Mar18/src/lmp_kokkos_cuda_mpi[0xbcd157] [ServerS:08920] [11] ./lammps-16Mar18/src/lmp_kokkos_cuda_mpi[0x424596] [ServerS:08920] [12] /lib/x86_64-linux-gnu/libc.so.6(abort+0x16a)[0x7f3ecd44502a] [ServerS:08923] [ 3] ./lammps-16Mar18/src/lmp_kokkos_cuda_mpi[0x13ad7c1] [ServerS:08923] [ 4] ./lammps-16Mar18/src/lmp_kokkos_cuda_mpi[0x6588ba] [ServerS:08923] [ 5] ./lammps-16Mar18/src/lmp_kokkos_cuda_mpi[0x774f00] [ServerS:08923] [ 6] ./lammps-16Mar18/src/lmp_kokkos_cuda_mpi[0xf68acb] [ServerS:08923] [ 7] ./lammps-16Mar18/src/lmp_kokkos_cuda_mpi[0x560b27] [ServerS:08923] [ 8] ./lammps-16Mar18/src/lmp_kokkos_cuda_mpi[0xbce319] [ServerS:08923] [ 9] ./lammps-16Mar18/src/lmp_kokkos_cuda_mpi[0xbcc601] [ServerS:08923] [10] ./lammps-16Mar18/src/lmp_kokkos_cuda_mpi[0xbcd157] [ServerS:08923] [11] ./lammps-16Mar18/src/lmp_kokkos_cuda_mpi[0x424596] [ServerS:08923] [12] /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf0)[0x7f606c9ce830] [ServerS:08920] [13] ./lammps-16Mar18/src/lmp_kokkos_cuda_mpi[0x439539] [ServerS:08920] *** End of error message *** /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf0)[0x7f3ecd42e830] [ServerS:08923] [13] ./lammps-16Mar18/src/lmp_kokkos_cuda_mpi[0x439539] [ServerS:08923] *** End of error message *** Cuda const random access View using Cuda texture memory requires Kokkos to allocate the View's memory[ServerS:08922] *** Process received signal *** [ServerS:08922] Signal: Aborted (6) [ServerS:08922] Signal code: (-6) [ServerS:08922] [ 0] /lib/x86_64-linux-gnu/libpthread.so.0(+0x11390)[0x7f8b2ae95390] [ServerS:08922] [ 1] Cuda const random access View using Cuda texture memory requires Kokkos to allocate the View's memory[ServerS:08925] *** Process received signal *** /lib/x86_64-linux-gnu/libc.so.6(gsignal+0x38)[0x7f8b2a242428] [ServerS:08922] [ 2] /lib/x86_64-linux-gnu/libc.so.6(abort+0x16a)[0x7f8b2a24402a] [ServerS:08922] [ServerS:08925] Signal: Aborted (6) [ServerS:08925] Signal code: (-6) [ 3] ./lammps-16Mar18/src/lmp_kokkos_cuda_mpi[0x13ad7c1] [ServerS:08922] [ 4] ./lammps-16Mar18/src/lmp_kokkos_cuda_mpi[0x6588ba] [ServerS:08922] [ 5] ./lammps-16Mar18/src/lmp_kokkos_cuda_mpi[0x774f00] [ServerS:08922] [ 6] ./lammps-16Mar18/src/lmp_kokkos_cuda_mpi[0xf68acb] [ServerS:08922] [ 7] ./lammps-16Mar18/src/lmp_kokkos_cuda_mpi[0x560b27] [ServerS:08922] [ 8] ./lammps-16Mar18/src/lmp_kokkos_cuda_mpi[0xbce319] [ServerS:08922] [ 9] ./lammps-16Mar18/src/lmp_kokkos_cuda_mpi[0xbcc601] [ServerS:08922] [10] ./lammps-16Mar18/src/lmp_kokkos_cuda_mpi[0xbcd157] [ServerS:08922] [11] ./lammps-16Mar18/src/lmp_kokkos_cuda_mpi[0x424596] [ServerS:08922] [12] /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf0)[0x7f8b2a22d830] [ServerS:08922] [13] ./lammps-16Mar18/src/lmp_kokkos_cuda_mpi[0x439539] [ServerS:08922] *** End of error message *** [ServerS:08925] [ 0] /lib/x86_64-linux-gnu/libpthread.so.0(+0x11390)[0x7fa0b0e2a390] [ServerS:08925] [ 1] /lib/x86_64-linux-gnu/libc.so.6(gsignal+0x38)[0x7fa0b01d7428] [ServerS:08925] [ 2] /lib/x86_64-linux-gnu/libc.so.6(abort+0x16a)[0x7fa0b01d902a] [ServerS:08925] [ 3] ./lammps-16Mar18/src/lmp_kokkos_cuda_mpi[0x13ad7c1] [ServerS:08925] [ 4] ./lammps-16Mar18/src/lmp_kokkos_cuda_mpi[0x6588ba] [ServerS:08925] [ 5] ./lammps-16Mar18/src/lmp_kokkos_cuda_mpi[0x774f00] [ServerS:08925] [ 6] ./lammps-16Mar18/src/lmp_kokkos_cuda_mpi[0xf68acb] [ServerS:08925] [ 7] ./lammps-16Mar18/src/lmp_kokkos_cuda_mpi[0x560b27] [ServerS:08925] [ 8] ./lammps-16Mar18/src/lmp_kokkos_cuda_mpi[0xbce319] [ServerS:08925] [ 9] ./lammps-16Mar18/src/lmp_kokkos_cuda_mpi[0xbcc601] [ServerS:08925] [10] ./lammps-16Mar18/src/lmp_kokkos_cuda_mpi[0xbcd157] [ServerS:08925] [11] ./lammps-16Mar18/src/lmp_kokkos_cuda_mpi[0x424596] [ServerS:08925] [12] /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf0)[0x7fa0b01c2830] [ServerS:08925] [13] ./lammps-16Mar18/src/lmp_kokkos_cuda_mpi[0x439539] [ServerS:08925] *** End of error message *** Cuda const random access View using Cuda texture memory requires Kokkos to allocate the View's memory[ServerS:08926] *** Process received signal *** [ServerS:08926] Signal: Aborted (6) [ServerS:08926] Signal code: (-6) Cuda const random access View using Cuda texture memory requires Kokkos to allocate the View's memory[ServerS:08924] *** Process received signal *** [ServerS:08924] Signal: Aborted (6) [ServerS:08924] Signal code: (-6) [ServerS:08926] [ 0] /lib/x86_64-linux-gnu/libpthread.so.0(+0x11390)[0x7f6c9a0bd390] [ServerS:08926] [ 1] [ServerS:08924] [ 0] /lib/x86_64-linux-gnu/libpthread.so.0(+0x11390)[0x7fbf61ac5390] [ServerS:08924] /lib/x86_64-linux-gnu/libc.so.6(gsignal+0x38)[0x7f6c9946a428] [ServerS:08926] [ 2] [ 1] /lib/x86_64-linux-gnu/libc.so.6(gsignal+0x38)[0x7fbf60e72428] /lib/x86_64-linux-gnu/libc.so.6(abort+0x16a)[0x7f6c9946c02a] [ServerS:08926] [ 3] ./lammps-16Mar18/src/lmp_kokkos_cuda_mpi[0x13ad7c1] [ServerS:08926] [ 4] ./lammps-16Mar18/src/lmp_kokkos_cuda_mpi[0x6588ba] [ServerS:08926] [ 5] ./lammps-16Mar18/src/lmp_kokkos_cuda_mpi[0x774f00] [ServerS:08926] [ 6] ./lammps-16Mar18/src/lmp_kokkos_cuda_mpi[0xf68acb] [ServerS:08926] [ 7] ./lammps-16Mar18/src/lmp_kokkos_cuda_mpi[0x560b27] [ServerS:08926] [ 8] ./lammps-16Mar18/src/lmp_kokkos_cuda_mpi[0xbce319] [ServerS:08926] [ 9] ./lammps-16Mar18/src/lmp_kokkos_cuda_mpi[0xbcc601] [ServerS:08926] [10] ./lammps-16Mar18/src/lmp_kokkos_cuda_mpi[0xbcd157] [ServerS:08926] [11] ./lammps-16Mar18/src/lmp_kokkos_cuda_mpi[0x424596] [ServerS:08926] [12] [ServerS:08924] [ 2] /lib/x86_64-linux-gnu/libc.so.6(abort+0x16a)[0x7fbf60e7402a] [ServerS:08924] [ 3] ./lammps-16Mar18/src/lmp_kokkos_cuda_mpi[0x13ad7c1] [ServerS:08924] [ 4] ./lammps-16Mar18/src/lmp_kokkos_cuda_mpi[0x6588ba] [ServerS:08924] [ 5] ./lammps-16Mar18/src/lmp_kokkos_cuda_mpi[0x774f00] [ServerS:08924] [ 6] ./lammps-16Mar18/src/lmp_kokkos_cuda_mpi[0xf68acb] [ServerS:08924] [ 7] ./lammps-16Mar18/src/lmp_kokkos_cuda_mpi[0x560b27] [ServerS:08924] [ 8] ./lammps-16Mar18/src/lmp_kokkos_cuda_mpi[0xbce319] [ServerS:08924] [ 9] ./lammps-16Mar18/src/lmp_kokkos_cuda_mpi[0xbcc601] [ServerS:08924] [10] /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf0)[0x7f6c99455830] [ServerS:08926] [13] ./lammps-16Mar18/src/lmp_kokkos_cuda_mpi[0x439539] [ServerS:08926] *** End of error message *** ./lammps-16Mar18/src/lmp_kokkos_cuda_mpi[0xbcd157] [ServerS:08924] [11] ./lammps-16Mar18/src/lmp_kokkos_cuda_mpi[0x424596] [ServerS:08924] [12] /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf0)[0x7fbf60e5d830] [ServerS:08924] [13] ./lammps-16Mar18/src/lmp_kokkos_cuda_mpi[0x439539] [ServerS:08924] *** End of error message *** Cuda const random access View using Cuda texture memory requires Kokkos to allocate the View's memory[ServerS:08921] *** Process received signal *** [ServerS:08921] Signal: Aborted (6) [ServerS:08921] Signal code: (-6) [ServerS:08921] [ 0] /lib/x86_64-linux-gnu/libpthread.so.0(+0x11390)[0x7fc0dc4e7390] [ServerS:08921] [ 1] /lib/x86_64-linux-gnu/libc.so.6(gsignal+0x38)[0x7fc0db894428] [ServerS:08921] [ 2] /lib/x86_64-linux-gnu/libc.so.6(abort+0x16a)[0x7fc0db89602a] [ServerS:08921] [ 3] ./lammps-16Mar18/src/lmp_kokkos_cuda_mpi[0x13ad7c1] [ServerS:08921] [ 4] ./lammps-16Mar18/src/lmp_kokkos_cuda_mpi[0x6588ba] [ServerS:08921] [ 5] ./lammps-16Mar18/src/lmp_kokkos_cuda_mpi[0x774f00] [ServerS:08921] [ 6] ./lammps-16Mar18/src/lmp_kokkos_cuda_mpi[0xf68acb] [ServerS:08921] [ 7] ./lammps-16Mar18/src/lmp_kokkos_cuda_mpi[0x560b27] [ServerS:08921] [ 8] ./lammps-16Mar18/src/lmp_kokkos_cuda_mpi[0xbce319] [ServerS:08921] [ 9] ./lammps-16Mar18/src/lmp_kokkos_cuda_mpi[0xbcc601] [ServerS:08921] [10] ./lammps-16Mar18/src/lmp_kokkos_cuda_mpi[0xbcd157] [ServerS:08921] [11] ./lammps-16Mar18/src/lmp_kokkos_cuda_mpi[0x424596] [ServerS:08921] [12] /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf0)[0x7fc0db87f830] [ServerS:08921] [13] ./lammps-16Mar18/src/lmp_kokkos_cuda_mpi[0x439539] [ServerS:08921] *** End of error message *** ------------------------------------------------------- Primary job terminated normally, but 1 process returned a non-zero exit code. Per user-direction, the job has been aborted. ------------------------------------------------------- -------------------------------------------------------------------------- mpirun noticed that process rank 3 with PID 0 on node ServerS exited on signal 6 (Aborted).