Hi guys,
I'm PhD researcher and I have been using FG for a while to view simulated drone flights, using ardupilot SITL. Now, I want to train my UAV autopilot computer vision based AI using flightgear footage from the cockpit camera. In order to do it, my autopilot sends the UDP packages to FG with its telemetry data (it is already doing it through SITL), but it also needs to receive the image feedback from the camera footage in realtime.
As a short term solution, I'm pointing a camera connected to my autopilot to my computer screen to close the loop. Now I'm wondering if there is a way to grab the FG framebuffer of each frame and connect directly to my AI through OpenCV, GL, or other.
So is somebody did it or know how it can be done, please let me know. Otherwise, if somebody can give me a tip where to start in the source code I will also appreciate.
Thanks!
Aislan