Lemmy

13493 readers

51 users here now

Everything about Lemmy; bugs, gripes, praises, and advocacy.

For discussion about the lemmy.ml instance, go to !meta@lemmy.ml.

founded 5 years ago

MODERATORS

nutomic@lemmy.ml

I'm considering making a reddit to lemmy cross posting tool (lemmy.ml)

submitted 2 years ago by usernotfound@lemmy.ml to c/lemmy@lemmy.ml

7 comments fedilink hide all child comments

(attempt to cross-post from /c/programming )

Idea: Scrape all the posts from a subreddit as they're being made, and "archive" them on a lemmy instance, making it very clear it's being rehosted, and linking back to the original. It would probably have to be a "closed" lemmy instance specifically for this purpose. The tool would run for multiple subreddits, allowing Lemmy users to still be updated about and discuss any potential content that gets left behind.

Thoughts? It's probably iffy copyright-wise, but I think I can square my conscience with it.

you are viewing a single comment's thread
view the rest of the comments

[–] Barbarian@sh.itjust.works 0 points 2 years ago (1 children)

Just be aware that it might not work. Reddit implemented rate limits on page loads to combat the inevitable web scraping as they turn off the API. Test out how fast you can pull pages before putting in any real coding time.

load more comments (1 replies)