Reproducibility Yahoo results

[chrisby]

Hello,

was anyone able to reproduce the Yahoo results from the paper? The results I am able to produce are not even close to the reported performance?

@authors, it would be great if you could provide the respective hyperparameter settings.

All the best,
Christian

[yazhubaixue]

same problem on KPI dataset, could anyone able to reproduce the results share the hyperparameter settings?

[Feynben]

same problem on KPI dataset, could anyone able to reproduce the results share the hyperparameter settings?

[Alessio-Siciliano]

News about the parameters?

[StCross]

Any score of your reproduction? Mine are quite low (f1=0.22) and I dont know why.
I set dely=7, thres=0.495

[mertcanboz]

I also could not reproduce the results on KPI dataset. Dear authors, could you please share the hyperparameters? Also for the 'coldstart' scenarios, what are baseline models that you stated in the paper that you have used? I failed to find them.

@guinao @amazonnnn @conhua @congruihuang @likebupt @sccc19

[oliveshell]

Me too in the kpi dataset, looking forward the response please.

[emerrf]

I am not the authors but I managed to reproduce the results for KPI dataset. I implemented a quick parameter search for SR approach and found slighlty better results than the paper (F1 in test: 0.675). However, the SRCNN was more challenging and managed to reach (F1 in test: 0.749).

I forked the repo and change it quite a bit to make it run on any machine. Please have a look at: https://github.com/emerrf/anomalydetector If you have any questions or wants to discuss my changes, feel free to open an issue there.

[wwulfric]

@emerrf thanks for your excellent work. It runs easier.