Eval AI submission stuck at “Submitted”

[snowindog]

I uploaded a zip package for the 3D Detection challenge five days ago, but the submission status remains "Submitted" and has not progressed. I also tried the Prediction challenge and encountered the same issue— stuck in the "Submitted" state. However, submissions to the Tracking challenge work fine and typically complete within a few hours.
Could you please check if there is an issue with the evaluation server for the 3D Detection and Prediction test sets?

[mei0114]

Hello, has there been any change in your status? Approximately how long did it take for the change to occur? I submitted it seven days ago, and it's still submitted. @snowindog #

I uploaded a zip package for the 3D Detection challenge five days ago, but the submission status remains "Submitted" and has not progressed. I also tried the Prediction challenge and encountered the same issue— stuck in the "Submitted" state. However, submissions to the Tracking challenge work fine and typically complete within a few hours. Could you please check if there is an issue with the evaluation server for the 3D Detection and Prediction test sets?

[snowindog]

Hey 😱, the Detection job I submitted on Sept 12 just got flipped to “Cancelled” yesterday. All three links—Result, Stdout, Stderr—are up but totally blank (╯‵□′)╯︵┻━┻. No clue if the organizers even know it’s stuck…
If you has a result,please message me right away and let’s solve it together! @mei0114

[mei0114]

Hey 😱, the Detection job I submitted on Sept 12 just got flipped to “Cancelled” yesterday. All three links—Result, Stdout, Stderr—are up but totally blank (╯‵□′)╯︵┻━┻. No clue if the organizers even know it’s stuck… If you has a result,please message me right away and let’s solve it together! @mei0114

I'm glad that you replied me!! I'd like to know what kind of file you submitted to eval-ai? I only submitted a zip containing result.json. Did you do the same? @snowindog

[snowindog]

zip/json都传过，被cancelled的json/zip 都有 都是这个月12号的，就检测和预测卡那里了 其他的随便传了好歹会弹个failed，我在等15号上传的会不会也被cancel

之前根据evalai官方提供的渠道也发了 一点反应没有 ， nuscenes官方邮件我不知道是哪个我特想发来问问

[mei0114]

nuscenes官方不是这个nuScenes@motional.com吗？那你15号的那个现在还是卡在submmited？我22号提交的，到现在也是submmited，给这个邮箱发邮件也没啥消息，就只能干等。你是选择公开还是不公开评估呀?

[snowindog]

那我也往那个邮箱发发，都被取消了

这跑不了直接缺一个整个东西啊，如果训练打榜av2的话时间消耗也太大了 @mei0114

[mei0114]

不是说每年只能提交3个结果吗？为什么你可以提交这么多？是我理解错了，只能提交3个正常的结果？

你发了那个邮件吗？就那个提交结果之后还要发一个简单的邮件介绍模型的那个？你这都等了半个月才有结果啊

[snowindog]

取消就能传新的 这不是有结果，大概是太久被取消了 ；正常来说几个小时就行了 别的几个测试我随便传了个东西，几小时就给我弹failed了
@mei0114

[mei0114]

你上传的结果有后续了嘛？我的还是已提交，一点没动，我前天又传了一个上去，两天了，还是一样，一直卡在“submmited"

[snowindog]

一直卡着呢，太耽误事儿了 @mei0114

[mei0114]

我9.22提交的文件也被cancelled了，真没招了

[snowindog]

搞过AV2数据集吗 @mei0114 不然官方这样搞下去 实验妥妥不够啊 你给官方的邮件有消息没

[BigBoomDream]

@mei0114 @snowindog 现在还是一直被卡住么，官方一直没有回复么？

[mei0114]

@mei0114 @snowindog 现在还是一直被卡住么，官方一直没有回复么？

是的，提交半个月后被cancelled

[snowindog]

@BigBoomDream 啥都没有 兄弟

@mei0114 @snowindog 现在还是一直被卡住么，官方一直没有回复么？