I've found https://paperswithcode.com/ and github search & topics useful tools. In my experience implementing a paper from scratch is a fantastic way to gain a deeper understand of a paper. Don't be discouraged, I can't remember a single paper I've tried to implement that provided all the details necessary to implement.
this post was submitted on 23 Nov 2023
1 points (100.0% liked)
Machine Learning
1 readers
1 users here now
Community Rules:
- Be nice. No offensive behavior, insults or attacks: we encourage a diverse community in which members feel safe and have a voice.
- Make your post clear and comprehensive: posts that lack insight or effort will be removed. (ex: questions which are easily googled)
- Beginner or career related questions go elsewhere. This community is focused in discussion of research and new projects that advance the state-of-the-art.
- Limit self-promotion. Comments and posts should be first and foremost about topics of interest to ML observers and practitioners. Limited self-promotion is tolerated, but the sub is not here as merely a source for free advertisement. Such posts will be removed at the discretion of the mods.
founded 1 year ago
MODERATORS
Out of curiosity - What do you do, when you are missing some key information?
I think this is why implementing is such a useful learning tool. Papers I tried to implement I probably read cover-to-cover 10 or 20 times, as opposed just skimming abstract, method, results.
When missing key info, after searching the paper a few times:
- my first step was see if I could find anything on paperswithcode or github.
- failing that, google searches. see if I could find anything on forums, stack exchange sites, reddit.
- uni library or academic paper web search engines
- see if any papers that cite the paper I'm implementing give some clue
- last resort was to look into papers they cite.
That was all the tricks I had, keen to know any more.
You can also contact the authors to ask them. Most of us are not monsters and will happily talk about our work. :)
What do you do if you find a reference implementation? Just run it? Try to implement from scratch?
I tried to copy as much as possible from the paper, then fill in the blanks with how I would have solved it. I only had a partial solution but I still learnt heaps more than just reading the paper.
i found it helpful to read related papers and code, break down the model into smaller components, and slowly build it up. sometimes you just gotta experiment and fill in the gaps as you go.
I am also in that posture. i will be reading the comments. what i am currently doing is buildong from scratch most of the common Models.