this post was submitted on 02 Sep 2023
120 points (97.6% liked)

Rust

5953 readers
14 users here now

Welcome to the Rust community! This is a place to discuss about the Rust programming language.

Wormhole

!performance@programming.dev

Credits

  • The icon is a modified version of the official rust logo (changing the colors to a gradient and black background)

founded 1 year ago
MODERATORS
 

For a larger project requiring the ability to work with my computer in 3D, I developed a 3D terminal emulator. It uses the wonderful alacritty_terminal crate from the Alacritty terminal for VTE parsing and PTY initialization, and it uses wgpu and rend3 for the rendering code. The actual text rendering is done using multichannel SDF rendering, generated lazily at runtime to a texture atlas using the msdfgen crate.

A project like this would've been impossible if not for Rust's friendly library ecosystem and the Alacritty project's efforts to make their core terminal emulator code reusable for other means.

top 10 comments
sorted by: hot top controversial new old
[–] nottheengineer@feddit.de 15 points 1 year ago (2 children)

Looks nice, but I'm more interested in what project would make this useful. I can only think of VR stuff, but then you'd probably use a VR framework for it.

[–] d_k_bo@feddit.de 22 points 1 year ago

Imagine being stuck in VR Vim.

[–] marcelinecramer@programming.dev 13 points 1 year ago (1 children)

It is a VR project! I needed fast, highly-legible text from a variety of viewing angles and MSDFs fit the bill.

I'm curious, when you say a VR framework, do you mean something like Stereokit?

[–] nottheengineer@feddit.de 3 points 1 year ago (1 children)

I don't actually know anything about VR development, I just assumed that you'd be working with something like a game engine to handle the play area, controls, stereo 3D rendering and generally as a platform for using multiple applications in one headset.

Stereokit looks like it's exactly that. I'm wondering, how do you solve those things if you're not using a framework?

[–] marcelinecramer@programming.dev 8 points 1 year ago (1 children)
cargo add blood
cargo add sweat
cargo add tears

The go-to API to use these days for VR (or XR more broadly) is OpenXR, which is a standard for AR/VR developed by the Khronos Group, who also standardized OpenGL and Vulkan. OpenVR is an older, SteamVR-specific VR library that has been phased out in favor of OpenXR. Oculus also had its own Oculus SDK for developing VR apps for both desktop VR and Quest that has also been deprecated for OpenXR.

When you initialize OpenXR, whichever API loader you've instantiated connects to its compositor, which is typically a daemon process. The OpenXR API has extensions for whether you're rendering using OpenGL, Vulkan, DirectX, whatever, and then you hook into the compositor with your graphics-specific extension to exchange GPU objects for compositing.

OpenXR also handles frame synchronization (which is a tricky subject in VR because of how tight latency needs to be to not give the user motion sickness) and input handling, which is compositor- and hardware-specific.

For Rust's purposes, you can find an example of how to plumb OpenXR's low-level graphics to wgpu here: https://github.com/philpax/wgpu-openxr-example

Once you can follow OpenXR's rules for graphics and synchronization correctly, you're off to the races, and there isn't much of a difference, at least on the lowest level, between your XR runtime and any other game engine or simulator.

Stereokit is really cool because it builds on OpenXR with a bunch of useful features like a UI system and virtual hands rendered where your controllers are. It also supports desktop mode.

If you're interested in this kind of stuff I highly recommend reading the OpenXR specification. Despite it being made by the same consortium that wrote the OpenGL and Vulkan specs, the OpenXR spec is highly-readable and is a really good introduction to low-level VR software engineering.

[–] Metriximor@lemmy.ml 2 points 1 year ago

Bro thanks for the intro to vr dev, this is really cool stuff

[–] Cwilliams@beehaw.org 9 points 1 year ago (1 children)

Where's the code? I'm sure everyone interested in VR development could benefit

Thank you for the encouragement! Unfortunately, I'm not able to share the source code just yet, but I do intend to license it under the Apache license as soon as I can. Please refer to this comment for more info: https://programming.dev/comment/2568603

[–] Pavi@lemmy.world 4 points 1 year ago

Isn't that the Skybox from Learnopengl.com ? Recognized it almost immediately

[–] toomanyjoints69@lemmygrad.ml 2 points 1 year ago

This is useful enough for me to want to use it now. Any way that we can? I likebto write stuff in vim and this seems immersive.