[QUESTION] Project shots over flat plane.

Hello, and thank you for the project and your efforts on this project. 🙂

I would like to know if you could, please, throw some light to how to project all the images over a plane. More precisely I have some drone pictures taken at high altitude (no perspective affected) and I would like to put them all together like it can be seen in the viewer. I’m setting the use_altitude_tag to True in the config during the reconstruction.

My code so far is:

project_path = </path/to/project>
data = DataSet(project_path)

rec: Reconstruction = data.load_reconstruction()[0]
ref: TopocentricConverter = rec.reference

# Plane will be created at the mean altitude (z position) of 3D points
points = rec.get_points().values()
plane_altitude: LandmarkView = np.median([p.coordinates[2] for p in points])

for shot_id in rec.get_shots():
    
    shot: Shot = rec.shots[shot_id]
    cam: Camera = shot.camera
    pose: Pose = shot.pose

   # Scale

    x,y,z = pose.get_origin()
    z_scale = z - plane_altitude

   # Rotation

    # I think the main problem is here (?):
    # I ignore the Z axis because I suppose shot is "almost" facing down
    rot_matrix = pose.get_rotation_matrix()[:2,:2].T
    rot_matrix /= z_scale   # Set scale at floor level so images have correct size (is it correct?)

    # Translation

    x,y,z = ref.to_lla(x,y,z)  # Convert to GPS coordinates
    
    # Internal camera parameters

    K = cam.get_K()

    # Create affine to georeference image

    affine = np.eye(3)
    affine[:2,:2] = rot_matrix  # Insert rotation and scale
    affine[:2,2] = np.array((x,y))  # Insert translation
    
    K_inv = np.linalg.inv(K) 
    affine = affine.dot(K_inv)  # Add K to image

    ## Follows the code to insert Affine into TIF ##

Is this approximation correct? Once this is solved I would really like to help improving OpenSFM docs. Thank you in advance.

[Matesanz]

Hello @pierotofy and thank you so much for the answer. (btw: I admire you so much for your work at ODM.)

I’ll check it out 😃

[pierotofy]

A bit off-topic perhaps, but you could use a tool such as ddb geoproj to do this: https://docs.dronedb.app/commands/geoproj.html

(disclaimer: I wrote the tool).