this post was submitted on 20 Nov 2023
1 points (100.0% liked)

Machine Learning

1 readers
1 users here now

Community Rules:

founded 11 months ago
MODERATORS
 

EACL 2024 reviews will come out today (19 Nov aoe), so this is the discussion for them.

UPDATE: The author response period will be from 21 Nov to 28 Nov.

top 48 comments
sorted by: hot top controversial new old
[–] Street-Judgment7640@alien.top 1 points 10 months ago (1 children)

Now EACL hompage is updated. Discussion period is 23-28 Nov.

[–] liz262626@alien.top 1 points 10 months ago
[–] liz262626@alien.top 1 points 10 months ago

It is strange that they havent sent even 1 notification to authors' mail boxes.

[–] Silly-Fox2014@alien.top 1 points 10 months ago (1 children)

so when will reviews get released?

[–] minhngh@alien.top 1 points 10 months ago

According to EACL 2024 website, I think the reviews will be available on 23 Nov (aoe).

[–] Silly-Fox2014@alien.top 1 points 10 months ago

so when will reviews get released?

[–] nohodlnodough@alien.top 1 points 10 months ago (1 children)

reviews are out. Does anyone know if we are allowed to make modifications to the paper or we are only allowed to answer directly to the feedbacks?

[–] minhngh@alien.top 1 points 10 months ago

I cannot access to openreview right now, openreview appears to go down

[–] Street-Judgment7640@alien.top 1 points 10 months ago (1 children)

333, seems right on the borderline. Is the soundness score affect the final decision?

[–] Standard_Letter_3196@alien.top 1 points 10 months ago

Are these scores based on the Soundness criteria or Overall Assessment from each reviewer?

[–] Standard_Letter_3196@alien.top 1 points 10 months ago (1 children)

What scores are more important? Overall Assessment or Soundness?

[–] SnooEpiphanies625@alien.top 1 points 10 months ago (1 children)

Soundness. Overall Assessment seems to be an alternate name for Excitement (https://2023.aclweb.org/blog/review-form/ and https://aclrollingreview.org/reviewform)

[–] Standard_Letter_3196@alien.top 1 points 10 months ago (1 children)

Thanks for replying. Do you think it is possible to get into the main conference with 3,4,3 for soundness?

[–] SnooEpiphanies625@alien.top 1 points 10 months ago

Pretty good chance but usually depends on the specific track

[–] AmbitiousSeesaw3330@alien.top 1 points 10 months ago (2 children)

2.5 2 and 2, seems pretty bad, should i just withdraw it?

[–] liz262626@alien.top 1 points 10 months ago (1 children)

Maybe we should revise and submit to naacl instead

[–] generous-blessing@alien.top 1 points 9 months ago (1 children)

Why do you think the chances in naacl will be higher?

[–] liz262626@alien.top 1 points 9 months ago

We see the comments and using those comments to submit naacl. Our baselines are for text. What else conferences we could submit? If we submit to other ml conf, they always ask why u dont do this algorithm on computer vision datasets? Pls tell me your idea if u have other confs to submit. My algorithm is a novelty one with outstanding experimental results. Reviewers also recognized that in the strength acknowledgement but they didnt give me high scores as my writing is not detailed enough. I also feel stressed with those kinds of comments.

[–] generous-blessing@alien.top 1 points 9 months ago (1 children)

What are the benefits of withdrawing?

[–] AmbitiousSeesaw3330@alien.top 1 points 9 months ago

To make it possible to submit to another conference before results are out

[–] liz262626@alien.top 1 points 10 months ago

2.5,2.5,2. Should i do the rebuttal phase?

[–] Background_Cookie_92@alien.top 1 points 10 months ago (1 children)

First submission of mine. I received ratings of 3.5, 3.5, and 3.5. Is it possible to pass the findings or main conf?

[–] Standard_Letter_3196@alien.top 1 points 9 months ago (1 children)

Are these scores based on Overall or Soundness?

[–] Background_Cookie_92@alien.top 1 points 9 months ago

overall, my soundness is 3.5/4/3.5

[–] Icy_Ad622@alien.top 1 points 10 months ago (2 children)

Can someone say, what are you watching: soundness or overall assessment?

Soundness: 3/4/3 Overall assessment: 3.5/3.5/2.5

Is it possible to pass for main or findings?

[–] Murky-Level-1527@alien.top 1 points 10 months ago (1 children)

Good soundness and fine overall.
It seems 2.5 rather than 3 is the borderline. In this way, 3 is a positive score. Did I understand correctly?

[–] No-Air-7100@alien.top 1 points 10 months ago

I think 3.0 is the boarderline and plus and/or minus 0.5 is a weak leaning.

[–] jojon-hebat-yipyip@alien.top 1 points 9 months ago

Huge chance of Findings (Fig 5a: https://aclanthology.org/2023.acl-long.report.pdf). The average soundness score is 3.3, and the average overall score is 3.17.

To me, the overall score seems similar to the excitement score (by its definition). Both overall and excitement score tends to be lower than the soundness score, and are more subjective.

[–] jojon-hebat-yipyip@alien.top 1 points 10 months ago (1 children)

Soundness: 4.5/3/3.5 and Overall: 4/2.5/3
Similar questions with others; which score is more important now?

[–] Murky-Level-1527@alien.top 1 points 9 months ago

Very good points in my opinion. Likely for Main and Findings.

[–] Alliswell2257@alien.top 1 points 10 months ago

My paper

  • Soundness: 2.5/4/3
  • Overall: 2/3/3

Paper I reviewed

  • Soundness: 3/3/2.5
  • Overall: 2/2.5/2.5
  • I gave 2.5/2.5 for soundness and overall.

Another Paper I reviewed

  • Soundness: 3/3/3.5
  • Overall: 2/2.5/3
  • I gave 3.5/3 for soundness and overall.
[–] DiligentChipmunk8389@alien.top 1 points 10 months ago (1 children)

My paper: Soundness: 3.5/2/3.5/3 Overall: 3.5/2/3.5/2.5

It’s always reviewer no. 2 😔 what are my chances? Reviewer 1,3,4 gave good reviews and asked only small clarification questions which can be easily addressed

[–] generous-blessing@alien.top 1 points 9 months ago

3.5/2/3.5/2.5

Is there an importance to the order of reviews a paper gets?

[–] ludwig5_outlook@alien.top 1 points 10 months ago

Does anyone know the maximal word count of the author response? Is the count the total number of words for all reviewer together or for each single reviewer? Thank you!

[–] Street-Judgment7640@alien.top 1 points 10 months ago

One reviewer suddenly lowered the score from 3 to 2 without fair justification. I wrote a confidential message to editors, but I want to more strongly appeal the capricious reviewer since it can contaminate whole ARR review system. Who should I contact? Do I have to maintain my anonymity when I sens a mail to editors-in-chief?

[–] optimizing_k_arm_a@alien.top 1 points 9 months ago (2 children)

I've got 3.5/4/3 for soundness and 3/2.5/2.5 for overall. Do I have chances for findings? Or to withdraw and submit to other venues?

[–] Murky-Level-1527@alien.top 1 points 9 months ago (1 children)

Good soundness score and not bad overall. It should have a chance for Finding maybe.

[–] generous-blessing@alien.top 1 points 9 months ago (1 children)

When a paper is submitted for the Main conference (long paper), it can be accepted to the Findings session?

[–] optimizing_k_arm_a@alien.top 1 points 9 months ago

i guess it is, the paper is considered as : main, findings or reject.

[–] jojon-hebat-yipyip@alien.top 1 points 9 months ago

It got some shots to Findings (Figure 5a at https://aclanthology.org/2023.acl-long.report.pdf). To me, the overall score seems similar to the excitement score (by its definition). Both overall and excitement score tends to be lower than the soundness score, and are more subjective.

Your average soundness score is 3.5 (high, i.e., in the range of the main and findings paper), and the averaged overall score is 2.7 (a bit lower than the average of the findings paper)

[–] Gold-Whole-7424@alien.top 1 points 9 months ago (2 children)

My Paper:

Soundness 4/4/2.5, overall 3/3/2. Does it stand a chance in any track ?

[–] Murky-Level-1527@alien.top 1 points 9 months ago

Likely, it is a very good score for findings in my opinion.

[–] Gold-Whole-7424@alien.top 1 points 9 months ago

Now changed scores are: Soundness 4/4/3, overall 3/3/3. Does it stand a chance in any track now?

[–] Alliswell2257@alien.top 1 points 9 months ago

I received an email that says the deadline for review updates to November 30th AOE.

[–] AmbitiousSeesaw3330@alien.top 1 points 9 months ago

Anyone knows if the correction of scores will be reviewed during the feedback session? Thinking of withdrawing instead of waiting

[–] Few_Lavishness_2755@alien.top 1 points 9 months ago

So, when will the meta review be released?

[–] Few_Lavishness_2755@alien.top 1 points 9 months ago (1 children)

Why I got four reviews? Sound/Overall: 3/2.5, 4/4, 4/3.5, 3.5/4. Is it possible to main conf?

[–] generous-blessing@alien.top 1 points 9 months ago

Feels like best paper ;)