this post was submitted on 29 Oct 2023
1 points (100.0% liked)

Emacs

311 readers
2 users here now

A community for the timeless and infinitely powerful editor. Want to see what Emacs is capable of?!

Get Emacs

Rules

  1. Posts should be emacs related
  2. Be kind please
  3. Yes, we already know: Google results for "emacs" and "vi" link to each other. We good.

Emacs Resources

Emacs Tutorials

Useful Emacs configuration files and distributions

Quick pain-saver tip

founded 1 year ago
MODERATORS
rglullis
raphael
1
Does Emacs Support Parallel Processing in a Juypter Notebook Equivalent Environment? (alien.top)
submitted 1 year ago by AnalystOrDeveloper@alien.top to c/emacs
2 comments fedilink hide all child comments
 

Hello everyone,

Hope your weekend is off to a great start. I'm starting my journey on Vim and possibly Emacs (although, who am I kidding, seeing some of its capabilities it seems an inevitability). One thing that would accelerate my timeline to jumping into learning Emacs is if it handled a particular use case that is crucial to me.

See, I do a lot of work in Jupyter Notebooks (Python) for school and ML/prototyping in general. One thing I like about notebooks is that if you make a mistake and the program fails, well, your intermediate calculations are still stored in memory and accessible. It's a graceful fail. If you fail through terminal, well, could be the end of what you calculated.

The problem I have with Jupyter Notebooks is that they do not support parallel processing conveniently. I saw that Emacs has some interesting capabilities around notebook support; I believe org mode is what's used.

I was interested in knowing if anyone uses Emacs as a way to get the best of both worlds: a way to run things using multiprocessing, but should things fail, it store the states in memory to rerun it.

I appreciate any/all insight you have!

you are viewing a single comment's thread
view the rest of the comments
[–] karthink@alien.top 1 points 1 year ago

your intermediate calculations are still stored in memory and accessible

I don't understand this. Is each code block in Jupyter an "intermediate calculation"? If yes, then Org behaves the same way.

they do not support parallel processing conveniently

Parallel processing is the purview of your code, not Jupyter or Org.