instant ngp on the web

[Jiakui]

Dear author,

I want to run instant ngp in the web browser, just the rendering part , not including the training part.

Can you give me some suggestion how to do it ?

Thanks

[Tom94]

I'm afraid this is quite complicated and would require much engineering effort. Short of baking the NeRF into a data structure more amenable to webgl rendering (such as PlenOctrees), you'd have to re-implement the entire inference pipeline of tiny-cuda-nn in glsl, express the trained weights of the hash encoding + neural network in terms of textures, and then run that.

[pwais]

do you think you'll ever do a WebGPU port of tiny-cuda-nn ? ;)

[Tom94]

Not in the near future. But if support for low-level GPU primitives (like tensorcores) in webgl / webcl gets better, there might be a time!

[nosy-b]

@Tom94 Isn't there a way with the RGBA_slices? Would be pretty limited in terms of rendering quality but simple to implement in WebGL, WDYT?

[Tom94]

Sure, but I wouldn't consider this to be "instant NGP on the web". It's just a volumetric light field texture that could be obtained by any means (including other NeRF methods) -- similar to what https://phog.github.io/snerg/ or https://alexyu.net/plenoctrees/ already did (the latter even having a webgl demo).

[zba]

May be just webrtc stream ?

[Lanson426]

Hello, have you made it? I also need this technology now. Could you give me some advice