this post was submitted on 20 Nov 2023
1 points (100.0% liked)

Machine Learning

1 readers
1 users here now

Community Rules:

founded 2 years ago
MODERATORS
 

EACL 2024 reviews will come out today (19 Nov aoe), so this is the discussion for them.

UPDATE: The author response period will be from 21 Nov to 28 Nov.

top 48 comments
sorted by: hot top controversial new old
[–] Street-Judgment7640@alien.top 1 points 2 years ago (1 children)

Now EACL hompage is updated. Discussion period is 23-28 Nov.

[–] liz262626@alien.top 1 points 2 years ago

It is strange that they havent sent even 1 notification to authors' mail boxes.

[–] Silly-Fox2014@alien.top 1 points 2 years ago (1 children)

so when will reviews get released?

[–] minhngh@alien.top 1 points 2 years ago

According to EACL 2024 website, I think the reviews will be available on 23 Nov (aoe).

[–] Silly-Fox2014@alien.top 1 points 2 years ago

so when will reviews get released?

[–] nohodlnodough@alien.top 1 points 2 years ago (1 children)

reviews are out. Does anyone know if we are allowed to make modifications to the paper or we are only allowed to answer directly to the feedbacks?

[–] minhngh@alien.top 1 points 2 years ago

I cannot access to openreview right now, openreview appears to go down

[–] Street-Judgment7640@alien.top 1 points 2 years ago (1 children)

333, seems right on the borderline. Is the soundness score affect the final decision?

[–] Standard_Letter_3196@alien.top 1 points 2 years ago

Are these scores based on the Soundness criteria or Overall Assessment from each reviewer?

[–] Standard_Letter_3196@alien.top 1 points 2 years ago (1 children)

What scores are more important? Overall Assessment or Soundness?

[–] SnooEpiphanies625@alien.top 1 points 2 years ago (1 children)

Soundness. Overall Assessment seems to be an alternate name for Excitement (https://2023.aclweb.org/blog/review-form/ and https://aclrollingreview.org/reviewform)

[–] Standard_Letter_3196@alien.top 1 points 2 years ago (1 children)

Thanks for replying. Do you think it is possible to get into the main conference with 3,4,3 for soundness?

[–] SnooEpiphanies625@alien.top 1 points 2 years ago

Pretty good chance but usually depends on the specific track

[–] AmbitiousSeesaw3330@alien.top 1 points 2 years ago (2 children)

2.5 2 and 2, seems pretty bad, should i just withdraw it?

[–] liz262626@alien.top 1 points 2 years ago (1 children)

Maybe we should revise and submit to naacl instead

[–] generous-blessing@alien.top 1 points 2 years ago (1 children)

Why do you think the chances in naacl will be higher?

[–] liz262626@alien.top 1 points 2 years ago

We see the comments and using those comments to submit naacl. Our baselines are for text. What else conferences we could submit? If we submit to other ml conf, they always ask why u dont do this algorithm on computer vision datasets? Pls tell me your idea if u have other confs to submit. My algorithm is a novelty one with outstanding experimental results. Reviewers also recognized that in the strength acknowledgement but they didnt give me high scores as my writing is not detailed enough. I also feel stressed with those kinds of comments.

[–] generous-blessing@alien.top 1 points 2 years ago (1 children)

What are the benefits of withdrawing?

[–] AmbitiousSeesaw3330@alien.top 1 points 2 years ago

To make it possible to submit to another conference before results are out

[–] liz262626@alien.top 1 points 2 years ago

2.5,2.5,2. Should i do the rebuttal phase?

[–] Background_Cookie_92@alien.top 1 points 2 years ago (1 children)

First submission of mine. I received ratings of 3.5, 3.5, and 3.5. Is it possible to pass the findings or main conf?

[–] Standard_Letter_3196@alien.top 1 points 2 years ago (1 children)

Are these scores based on Overall or Soundness?

[–] Background_Cookie_92@alien.top 1 points 2 years ago

overall, my soundness is 3.5/4/3.5

[–] Icy_Ad622@alien.top 1 points 2 years ago (2 children)

Can someone say, what are you watching: soundness or overall assessment?

Soundness: 3/4/3 Overall assessment: 3.5/3.5/2.5

Is it possible to pass for main or findings?

[–] Murky-Level-1527@alien.top 1 points 2 years ago (1 children)

Good soundness and fine overall.
It seems 2.5 rather than 3 is the borderline. In this way, 3 is a positive score. Did I understand correctly?

[–] No-Air-7100@alien.top 1 points 2 years ago

I think 3.0 is the boarderline and plus and/or minus 0.5 is a weak leaning.

[–] jojon-hebat-yipyip@alien.top 1 points 2 years ago

Huge chance of Findings (Fig 5a: https://aclanthology.org/2023.acl-long.report.pdf). The average soundness score is 3.3, and the average overall score is 3.17.

To me, the overall score seems similar to the excitement score (by its definition). Both overall and excitement score tends to be lower than the soundness score, and are more subjective.

[–] jojon-hebat-yipyip@alien.top 1 points 2 years ago (1 children)

Soundness: 4.5/3/3.5 and Overall: 4/2.5/3
Similar questions with others; which score is more important now?

[–] Murky-Level-1527@alien.top 1 points 2 years ago

Very good points in my opinion. Likely for Main and Findings.

[–] Alliswell2257@alien.top 1 points 2 years ago

My paper

  • Soundness: 2.5/4/3
  • Overall: 2/3/3

Paper I reviewed

  • Soundness: 3/3/2.5
  • Overall: 2/2.5/2.5
  • I gave 2.5/2.5 for soundness and overall.

Another Paper I reviewed

  • Soundness: 3/3/3.5
  • Overall: 2/2.5/3
  • I gave 3.5/3 for soundness and overall.
[–] DiligentChipmunk8389@alien.top 1 points 2 years ago (1 children)

My paper: Soundness: 3.5/2/3.5/3 Overall: 3.5/2/3.5/2.5

It’s always reviewer no. 2 😔 what are my chances? Reviewer 1,3,4 gave good reviews and asked only small clarification questions which can be easily addressed

[–] generous-blessing@alien.top 1 points 2 years ago

3.5/2/3.5/2.5

Is there an importance to the order of reviews a paper gets?

[–] ludwig5_outlook@alien.top 1 points 2 years ago

Does anyone know the maximal word count of the author response? Is the count the total number of words for all reviewer together or for each single reviewer? Thank you!

[–] Street-Judgment7640@alien.top 1 points 2 years ago

One reviewer suddenly lowered the score from 3 to 2 without fair justification. I wrote a confidential message to editors, but I want to more strongly appeal the capricious reviewer since it can contaminate whole ARR review system. Who should I contact? Do I have to maintain my anonymity when I sens a mail to editors-in-chief?

[–] optimizing_k_arm_a@alien.top 1 points 2 years ago (2 children)

I've got 3.5/4/3 for soundness and 3/2.5/2.5 for overall. Do I have chances for findings? Or to withdraw and submit to other venues?

[–] Murky-Level-1527@alien.top 1 points 2 years ago (1 children)

Good soundness score and not bad overall. It should have a chance for Finding maybe.

[–] generous-blessing@alien.top 1 points 2 years ago (1 children)

When a paper is submitted for the Main conference (long paper), it can be accepted to the Findings session?

[–] optimizing_k_arm_a@alien.top 1 points 2 years ago

i guess it is, the paper is considered as : main, findings or reject.

[–] jojon-hebat-yipyip@alien.top 1 points 2 years ago

It got some shots to Findings (Figure 5a at https://aclanthology.org/2023.acl-long.report.pdf). To me, the overall score seems similar to the excitement score (by its definition). Both overall and excitement score tends to be lower than the soundness score, and are more subjective.

Your average soundness score is 3.5 (high, i.e., in the range of the main and findings paper), and the averaged overall score is 2.7 (a bit lower than the average of the findings paper)

[–] Gold-Whole-7424@alien.top 1 points 2 years ago (2 children)

My Paper:

Soundness 4/4/2.5, overall 3/3/2. Does it stand a chance in any track ?

[–] Murky-Level-1527@alien.top 1 points 2 years ago

Likely, it is a very good score for findings in my opinion.

[–] Gold-Whole-7424@alien.top 1 points 2 years ago

Now changed scores are: Soundness 4/4/3, overall 3/3/3. Does it stand a chance in any track now?

[–] Alliswell2257@alien.top 1 points 2 years ago

I received an email that says the deadline for review updates to November 30th AOE.

[–] AmbitiousSeesaw3330@alien.top 1 points 2 years ago

Anyone knows if the correction of scores will be reviewed during the feedback session? Thinking of withdrawing instead of waiting

[–] Few_Lavishness_2755@alien.top 1 points 2 years ago

So, when will the meta review be released?

[–] Few_Lavishness_2755@alien.top 1 points 2 years ago (1 children)

Why I got four reviews? Sound/Overall: 3/2.5, 4/4, 4/3.5, 3.5/4. Is it possible to main conf?

[–] generous-blessing@alien.top 1 points 2 years ago

Feels like best paper ;)