My NOMAD upload is stuck - it is processing data for 4 days already

NOMAD and FAIRmat
41

Ok, I try to do this ASAP. I let you know when I am done.

42

@mscheidgen thanx! and what about this link for util version which doesn’t work? After you publish uploads I need to upload missing data (by util version) and then publish that one too.

43

There are still 4 uploads that I need to publish.

You uploads have particular large processed data and they showed us that we have some kind of memory leak in the code that combine sall processed data while publishing the upload. The 9 uploads that passed yesterday only worked because I gave it a bit more ram. The last 4 are much bigger and failed again yesterday. But i still think I can publish them by just throwing even more memory on them. The first of the last 4 just passed a minute ago.

After this, i setup the util installation again for you to do the last upload. I let you know later today.

44

@mscheidgen thanx a lot for help this was quite a lot of work. I still try to figure did i forget to it load last dat in December or i deleted it by accident.

Will the link for util installation be same like before?

45

The link will be the same. But i still need to set it up properly. I get back to you on that one.

46

The 13 uploads should now all be published.

You can use the util deployment now. The urls should still be the same, e.g. https://nomad-lab.eu/prod/v1/util/gui/user/uploads

47

The last upload was uploaded, now waiting for it to get processed.

48

@mscheidgen the last data was uploaded, now you can publish it.

Greetings.

49

Ok, it is also published now.

50

Thank you!

51

I have pretty much the same question: My upload 3TrdblOERBqLvPZUV92hUg is “stuck”; I tried again, but it’s stuck somewhere else https://nomad-lab.eu/prod/v1/gui/user/uploads/upload/id/ZOGnOVa0R3SyxNz0hZowbA
And since it’s still being processed, I cannot cancel/delete it. Maybe there is one problematic file, but with these things being stuck, I don’t know how to figure it out…
Any help will be appreciated, but it’s not urgent at all.

52

Thanks for you message and we are sorry for the inconvenience.

Some of your larger VASP calculations where a bit too much for our processing in default settings. I now manage to process the upload. For reference a upload like your should process in a couple of hours. If you don’t see the number of processed entires increase for a long period of time, don’t hesitate to contact us like this, some manual steps on our side might just be necessary.

53

Thanks a lot; I’ll proceed as you suggested in the future!
Cheers
Stephan

54

Thanks again.
BTW: would it be possible and easy for you to delete my other trials that are still trying to complete? They are redundant with the one you fixed wonderfully!

Cheers
Stephan

55

Ideally you can give me the upload ids.

56

Sure, sorry for the delay:
d-jFznLdR0Wdzj0hy_eOuA
ji0PhoqyQwmI5UbXJg2fPA
ZOGnOVa0R3SyxNz0hZowbA
Are the three uploads that are “stuck” and no longer needed. So if you can simply delete them, I would be very glad!

57

I deleted these three uploads.

58

I am again facing an issue with a “stuck” upload:
Please delete the following one:
tBD5WGyoTZm0fG_bpKn4Cw
We came across some errors in the files and will upload a revised version.

59

I stop the processing of tBD5WGyoTZm0fG_bpKn4Cw and you should be able to delete the upload yourself.