this post was submitted on 20 Nov 2023
1 points (100.0% liked)

Machine Learning

1 readers
1 users here now

Community Rules:

founded 1 year ago
MODERATORS
 

EACL 2024 reviews will come out today (19 Nov aoe), so this is the discussion for them.

UPDATE: The author response period will be from 21 Nov to 28 Nov.

top 48 comments
sorted by: hot top controversial new old
[–] Street-Judgment7640@alien.top 1 points 11 months ago (1 children)

Now EACL hompage is updated. Discussion period is 23-28 Nov.

[–] liz262626@alien.top 1 points 11 months ago
[–] liz262626@alien.top 1 points 11 months ago

It is strange that they havent sent even 1 notification to authors' mail boxes.

[–] Silly-Fox2014@alien.top 1 points 11 months ago (1 children)

so when will reviews get released?

[–] minhngh@alien.top 1 points 11 months ago

According to EACL 2024 website, I think the reviews will be available on 23 Nov (aoe).

[–] Silly-Fox2014@alien.top 1 points 11 months ago

so when will reviews get released?

[–] nohodlnodough@alien.top 1 points 11 months ago (1 children)

reviews are out. Does anyone know if we are allowed to make modifications to the paper or we are only allowed to answer directly to the feedbacks?

[–] minhngh@alien.top 1 points 11 months ago

I cannot access to openreview right now, openreview appears to go down

[–] Street-Judgment7640@alien.top 1 points 11 months ago (1 children)

333, seems right on the borderline. Is the soundness score affect the final decision?

[–] Standard_Letter_3196@alien.top 1 points 11 months ago

Are these scores based on the Soundness criteria or Overall Assessment from each reviewer?

[–] Standard_Letter_3196@alien.top 1 points 11 months ago (1 children)

What scores are more important? Overall Assessment or Soundness?

[–] SnooEpiphanies625@alien.top 1 points 11 months ago (1 children)

Soundness. Overall Assessment seems to be an alternate name for Excitement (https://2023.aclweb.org/blog/review-form/ and https://aclrollingreview.org/reviewform)

[–] Standard_Letter_3196@alien.top 1 points 11 months ago (1 children)

Thanks for replying. Do you think it is possible to get into the main conference with 3,4,3 for soundness?

[–] SnooEpiphanies625@alien.top 1 points 11 months ago

Pretty good chance but usually depends on the specific track

[–] AmbitiousSeesaw3330@alien.top 1 points 11 months ago (2 children)

2.5 2 and 2, seems pretty bad, should i just withdraw it?

[–] liz262626@alien.top 1 points 11 months ago (1 children)

Maybe we should revise and submit to naacl instead

[–] generous-blessing@alien.top 1 points 11 months ago (1 children)

Why do you think the chances in naacl will be higher?

[–] liz262626@alien.top 1 points 11 months ago

We see the comments and using those comments to submit naacl. Our baselines are for text. What else conferences we could submit? If we submit to other ml conf, they always ask why u dont do this algorithm on computer vision datasets? Pls tell me your idea if u have other confs to submit. My algorithm is a novelty one with outstanding experimental results. Reviewers also recognized that in the strength acknowledgement but they didnt give me high scores as my writing is not detailed enough. I also feel stressed with those kinds of comments.

[–] generous-blessing@alien.top 1 points 11 months ago (1 children)

What are the benefits of withdrawing?

[–] AmbitiousSeesaw3330@alien.top 1 points 11 months ago

To make it possible to submit to another conference before results are out

[–] liz262626@alien.top 1 points 11 months ago

2.5,2.5,2. Should i do the rebuttal phase?

[–] Background_Cookie_92@alien.top 1 points 11 months ago (1 children)

First submission of mine. I received ratings of 3.5, 3.5, and 3.5. Is it possible to pass the findings or main conf?

[–] Standard_Letter_3196@alien.top 1 points 11 months ago (1 children)

Are these scores based on Overall or Soundness?

[–] Background_Cookie_92@alien.top 1 points 11 months ago

overall, my soundness is 3.5/4/3.5

[–] Icy_Ad622@alien.top 1 points 11 months ago (2 children)

Can someone say, what are you watching: soundness or overall assessment?

Soundness: 3/4/3 Overall assessment: 3.5/3.5/2.5

Is it possible to pass for main or findings?

[–] Murky-Level-1527@alien.top 1 points 11 months ago (1 children)

Good soundness and fine overall.
It seems 2.5 rather than 3 is the borderline. In this way, 3 is a positive score. Did I understand correctly?

[–] No-Air-7100@alien.top 1 points 11 months ago

I think 3.0 is the boarderline and plus and/or minus 0.5 is a weak leaning.

[–] jojon-hebat-yipyip@alien.top 1 points 11 months ago

Huge chance of Findings (Fig 5a: https://aclanthology.org/2023.acl-long.report.pdf). The average soundness score is 3.3, and the average overall score is 3.17.

To me, the overall score seems similar to the excitement score (by its definition). Both overall and excitement score tends to be lower than the soundness score, and are more subjective.

[–] jojon-hebat-yipyip@alien.top 1 points 11 months ago (1 children)

Soundness: 4.5/3/3.5 and Overall: 4/2.5/3
Similar questions with others; which score is more important now?

[–] Murky-Level-1527@alien.top 1 points 11 months ago

Very good points in my opinion. Likely for Main and Findings.

[–] Alliswell2257@alien.top 1 points 11 months ago

My paper

  • Soundness: 2.5/4/3
  • Overall: 2/3/3

Paper I reviewed

  • Soundness: 3/3/2.5
  • Overall: 2/2.5/2.5
  • I gave 2.5/2.5 for soundness and overall.

Another Paper I reviewed

  • Soundness: 3/3/3.5
  • Overall: 2/2.5/3
  • I gave 3.5/3 for soundness and overall.
[–] DiligentChipmunk8389@alien.top 1 points 11 months ago (1 children)

My paper: Soundness: 3.5/2/3.5/3 Overall: 3.5/2/3.5/2.5

It’s always reviewer no. 2 😔 what are my chances? Reviewer 1,3,4 gave good reviews and asked only small clarification questions which can be easily addressed

[–] generous-blessing@alien.top 1 points 11 months ago

3.5/2/3.5/2.5

Is there an importance to the order of reviews a paper gets?

[–] ludwig5_outlook@alien.top 1 points 11 months ago

Does anyone know the maximal word count of the author response? Is the count the total number of words for all reviewer together or for each single reviewer? Thank you!

[–] Street-Judgment7640@alien.top 1 points 11 months ago

One reviewer suddenly lowered the score from 3 to 2 without fair justification. I wrote a confidential message to editors, but I want to more strongly appeal the capricious reviewer since it can contaminate whole ARR review system. Who should I contact? Do I have to maintain my anonymity when I sens a mail to editors-in-chief?

[–] optimizing_k_arm_a@alien.top 1 points 11 months ago (2 children)

I've got 3.5/4/3 for soundness and 3/2.5/2.5 for overall. Do I have chances for findings? Or to withdraw and submit to other venues?

[–] Murky-Level-1527@alien.top 1 points 11 months ago (1 children)

Good soundness score and not bad overall. It should have a chance for Finding maybe.

[–] generous-blessing@alien.top 1 points 11 months ago (1 children)

When a paper is submitted for the Main conference (long paper), it can be accepted to the Findings session?

[–] optimizing_k_arm_a@alien.top 1 points 11 months ago

i guess it is, the paper is considered as : main, findings or reject.

[–] jojon-hebat-yipyip@alien.top 1 points 11 months ago

It got some shots to Findings (Figure 5a at https://aclanthology.org/2023.acl-long.report.pdf). To me, the overall score seems similar to the excitement score (by its definition). Both overall and excitement score tends to be lower than the soundness score, and are more subjective.

Your average soundness score is 3.5 (high, i.e., in the range of the main and findings paper), and the averaged overall score is 2.7 (a bit lower than the average of the findings paper)

[–] Gold-Whole-7424@alien.top 1 points 11 months ago (2 children)

My Paper:

Soundness 4/4/2.5, overall 3/3/2. Does it stand a chance in any track ?

[–] Murky-Level-1527@alien.top 1 points 11 months ago

Likely, it is a very good score for findings in my opinion.

[–] Gold-Whole-7424@alien.top 1 points 11 months ago

Now changed scores are: Soundness 4/4/3, overall 3/3/3. Does it stand a chance in any track now?

[–] Alliswell2257@alien.top 1 points 11 months ago

I received an email that says the deadline for review updates to November 30th AOE.

[–] AmbitiousSeesaw3330@alien.top 1 points 11 months ago

Anyone knows if the correction of scores will be reviewed during the feedback session? Thinking of withdrawing instead of waiting

[–] Few_Lavishness_2755@alien.top 1 points 11 months ago

So, when will the meta review be released?

[–] Few_Lavishness_2755@alien.top 1 points 11 months ago (1 children)

Why I got four reviews? Sound/Overall: 3/2.5, 4/4, 4/3.5, 3.5/4. Is it possible to main conf?

[–] generous-blessing@alien.top 1 points 11 months ago

Feels like best paper ;)