Just a progress update / early show an tell since this is took a few weeks to get working. Unfortunately I think this is still only going to be usable for me for a few more weeks as I work through cleaning up the bindings and work on a higher level API.
- Linked is an example video of h264 encoded frames being converted to dash-mpeg fragments using ffmpeg + mojo bindings and dash js
As part of a robot sim / training project ash dynamics pr 1 that I’m working on. First goal is I need to be able to visualize sims from a remote machine, ideally through a browser.
Some notes:
- Depends on [stdlib] feat: Add unsafe_ptr to StaticTuple by josiahls · Pull Request #5715 · modular/modular · GitHub being merged.
- Watching Add pico http refactor, clean up libc bindings, introduce QoL structs to wrap libc structs... by thatstoasty · Pull Request #275 · Lightbug-HQ/lightbug_http · GitHub pretty closely. Hoping to remove the temporary python server into a more perminant lightbug API
- UX is a buggy nightmare be warned and will be for a while unless you’re comfortable with ffmpeg low level apis + forking projects. No where close to opencv style video writing.
- There are memory leaks / origin issues since so many of the objects are alloced via ffmpeg and so are external origins. The test script is pretty quick and short, so the memory issues aren’t a visible problem if you’re doing short one off video runs, but my next steps is removing all the
_ = some_dl_alloced_objwith better integrated mojo origin friendly APIs.