Machine Learning

1 readers

1 users here now

Community Rules:

Be nice. No offensive behavior, insults or attacks: we encourage a diverse community in which members feel safe and have a voice.
Make your post clear and comprehensive: posts that lack insight or effort will be removed. (ex: questions which are easily googled)
Beginner or career related questions go elsewhere. This community is focused in discussion of research and new projects that advance the state-of-the-art.
Limit self-promotion. Comments and posts should be first and foremost about topics of interest to ML observers and practitioners. Limited self-promotion is tolerated, but the sub is not here as merely a source for free advertisement. Such posts will be removed at the discretion of the mods.

founded 1 year ago

MODERATORS

communick@academy.garden

[D] ICLR 2024 Paper Reviews (alien.top)

submitted 1 year ago by zy415@alien.top to c/machinelearning@academy.garden

33 comments fedilink hide all child comments

ICLR 2024 paper reviews are visible on OpenReview. I thought to create a discussion thread for us to discuss any issue/complain/celebration or anything else.

There is so much noise in the reviews every year. Some good work that the authors are proud of might get a low score because of the noisy system, given that ICLR is growing so large these years. We should keep in mind that the work is still valuable no matter what the score is.

you are viewing a single comment's thread
view the rest of the comments

[–] Mindless_Lie_6720@alien.top 1 points 11 months ago (6 children)

Got initial score of 855 but the reviewers just won't reply to the rebuttal... I even asked the AC and they sent a reminder for the reviewers but no one will reply :(

I think this reviewing system really has to change. Some papers get reviewers that are active and actually consider raising the score after looking at the rebuttal, and some get lazy reviewers that never look at the rebuttal and the score remains.

The reviewers know nothing will happen to them and they will again be selected as a reviewer next year, even if they do 'minimal work'. So frustrating :(

[–] Altruistic_Milk_6609@alien.top 1 points 11 months ago (1 children)

In the same boat, stuck with reviewers who don't want to engage. Don't know what to do. Does anyone with advice on how to get a reply from reviewers who are active?

[–] AardvarkDowntown5013@alien.top 1 points 11 months ago (1 children)

There is basically no way. There are many reasons they might not reply, including being sick or occupied with their own borderline papers. Try to be professional about it: post a reminder and then let the Area Chairs (ACs) handle it. Most ACs are well aware of these types of situations. They will most likely place less weight on those non-engaging reviews. Good luck with your rebuttal!

[–] Altruistic_Milk_6609@alien.top 1 points 11 months ago

That's great, healthy POV and advice. Thank you.

Although my thought process was a bit different, that is what I did as well.

load more comments (4 replies)