TSA Client Guide - Photogrammetry Issue 2 - HR
TSA Client Guide - Photogrammetry Issue 2 - HR
PHOTOGRAMMETRY
ISSUE 2 The Survey Association’s Client Guides are primarily
OCTOBER 2018
©TSA aimed at fellow professionals such as engineers,
Endorsed by: architects and planners. They are not intended to be an
‘in depth’ source but to act as a basic guide on a specific
topic and, in particular, on procedures which may govern
how a certain aspect of a survey is carried out.
Executive Summary
The purpose of this guide to photogrammetry is to provide a framework for the practice
of photogrammetry for the client commissioner. It covers theory, practical examples and
a wide range of applications for which photogrammetry can be used. Recent advances
in the technology have brought the discipline up to date with higher resolution cameras,
unmanned aircraft, and faster and more autonomous processing for managing large
volumes of data.
Figure 1
DJI Phantom SUA
wide angle image
Contents
1. Photogrammetry – Introduction and Definition
2. Scope of the Document
3. Basic Principles and Procedures of Photogrammetry
4. Photography
5. Data Processing and Photogrammetric Products
6. Mapping and Vectorisation
7. Advances in SUA Photogrammetric Solutions
8. 3D City Modelling
9. Earth Observation Photogrammetric Solutions
10. Workflow Example
11. Photogrammetric Applications
12. Summary
13. References and Further Reading
14. Acknowledgements
15. Tendering Considerations
16. Tender Returns
17. The Survey Association
18. Using a TSA Member
19. TSA Contact Details
20. TSA Disclaimer
21. Glossary of Terms
The latest developments have seen the rapid progress of more fully automated
user-friendly software at a lower cost, making itself accessible to a wider number of
customers including the end users of the products. The impetus for change is due to
the incorporation of computer vision algorithms and improved workflows, the relative
affordability of good quality cameras, computers and storage media and the increased
use of SUA, capable of carrying lightweight cameras. The software may be known as
SfM (Structure from Motion), convergent or multi-photo systems.
The distribution and quality of the imagery also has a primary bearing on the outcomes
and an explanation of some camera settings and photographic requirements will be
covered in Section 4.
Processing on digital workstations is through dedicated software, with input from the
Figure 2
operator limited to identification and observation of control points, and the setting of
Permanent calibration
frame set up at The various parameters in line with the requirements of the project. End products can be
University of Nottingham produced automatically or semi-automatically and consist of dense point clouds (similar
(left) and A4 sheets
to laser point clouds), triangular meshes, image rendered surfaces (3D models) and
of coded targets for
Photomodeler Scanner orthophotography (image maps). These data processing stages will be considered
software (right) in Section 5.
Inner orientation is the procedure that determines the interior geometry of the
camera by calibration. The calibration can be computed automatically within the
photogrammetric software and the relevant parameters, in some systems, can even
be calculated individually for all photographs. This allows for greater flexibility in
the camera settings and lenses used on any one project. For higher precision work
The exercise produces an overall fit with a few thousand tie points very quickly. This
relative orientation of many images simultaneously is also called aerial triangulation or
bundle adjustment. These terms are derived from the older pair by pair procedures and
subsequent rigorous mathematical adjustments of traditional stereo photogrammetry.
When viewed, the triangulation tie point dataset forms a coarse 3D model of the object
or topography and is sometimes known as the sparse point cloud. See Figure 3.
4. Photography
As the quality of the photography has a critical bearing on the final product, a brief
guide follows. It is a general rule that the higher the quality of the camera/lens
combination the better will be the resulting output. This is largely due to the pixels
Figure 4 being larger in larger format cameras (digital SLRs, medium format cameras and
An example of the range dedicated aerial cameras) than in compact and phone cameras. The greater the area
of cameras available for
that can accept light the more accurate will be the rendition of colour and tone and less
photogrammetry from left
to right: Airbus Pleiades noise will be generated in low light conditions. See an example of the range of cameras
50cm GSD satellite available in Figure 4.
system, Leica DMCIII 390
megapixel aerial camera, Cameras are familiar objects. We take their point and shoot ability for granted and
Canon 5DS 50 megapixel
DSLR and Samsung Galaxy expect to take a perfect shot every time. However, for photogrammetric purposes there
S6 smartphone with 16 are a number of factors to consider.
megapixel camera
It is important to know how to use the camera settings to maximise the quality of
the imagery.
Focus
For feature extraction, automatic image matching and for the production of any image-
based products, such as orthophotography, it is essential that the area of interest is
sharply focussed. This is usually straightforward for aerial imagery where the distances
are greater but for terrestrial subjects there may be significant depth. This is usually
solved by using a smaller aperture which automatically increases the depth of field.
Illumination
It is also important to have enough light available and by closing down the aperture,
as in the example above, less light will enter the lens. This can be solved by artificial
illumination, such as on-board flash, but this is not always appropriate or powerful
enough. For the higher quality cameras the ISO setting can be increased which
Storage
It is important to ensure that the highest quality images are stored on the camera and
if the camera has a Raw setting this should be used. This setting retains the original
image and is not subject to any compression artefacts that may occur when storing
the image in the JPEG format. Although image enhancement is not recommended,
as the automatic matching procedures can be affected, the Raw format allows better
adjustment of brightness, contrast, exposure and white balance.
4.2 Lenses
Prime lenses are normally recommended in preference to zoom lenses due to the
superior quality of manufacture and the reduced number of moving parts. The lack of
robustness of zooms can mean that the focus setting used in the calibration may slip
unknowingly and potentially affect the accuracy of the calculations.
Wide angle lenses produce better coverage and the better conditioned internal
geometry improves the mathematical solution. The narrow cone of light entering a
telephoto lens significantly affects the accuracy. Very wide angle and fisheye lenses
should also be avoided due to the severe distortions which cannot always be mapped
accurately, especially near the edges of the frame.
The distribution or arrangement of the imagery was mentioned earlier in the context
of improving the geometry of the solution for multi-photo systems.
The distribution for standard stereo mapping is different and it is important that
successive images in a run of photography maintain a near parallel axis. This is the
normal case for standard aerial photography as the camera is pointing vertically
downwards but should also be considered for terrestrial imagery when digital stereo
workstations are to be employed for feature collection. The stereo software is designed
for this case and, as the operator spends a great deal of time collecting data,
it is important that the viewing resembles that of a pair of eyes for comfort.
Feature collection on multi-photo systems is less common and in all cases the
process takes place observing the 3D model or one image at a time. The standard
stereo case for aerial and terrestrial imagery is shown in Figure 6.
Figure 7
The distribution of
5. Data Processing and Photogrammetric Products
photography for multi-
photo methods. On the 5.1 Stereo photogrammetry
left a rotary SUA has taken
a circular set of obliques of If the object of a survey is to produce detailed digital drawings of an urban area,
a large building to cover
both the roof and the a listed building, an archaeological excavation or an iron bridge, the project should
elevations. On the right an specify a conventional stereo photographic survey.
elevation is photographed
from three angled
positions (De Luca, Veron
and Florenzano 2006)
If the project is on a much smaller scale or the deliverables consist mainly of automated
or semi-automated products, the employment of multi-photo methods using terrestrial
or SUA imagery can become more efficient and, as the client is normally more closely
involved, controllable.
It was seen at the relative orientation stage above that a coarse model of the object
was produced when viewed in 3D using the newer multi-photo systems. The number
of points created is usually in the order of 10,000 to 100,000. After it has been geo-
referenced (absolute orientation stage), the data acts as a seed to produce the dense
point cloud familiar to users of laser scanners. There are a number of parameters that
can be set to provide control over the resolution and quality of the point cloud and
the area of interest. These combine to optimise the dense point cloud production
of many millions of points which can take several hours of computer processing.
Figure 8
3D model construction
from 64 SUA images
using ContextCapture
Figure 9
A triangular mesh and
shaded surface of a
vaulted arch using
ContextCapture
The dense point cloud of 18 million points for the dataset of Figure 3 is shown in Figure
8 and was constructed from 64 10megapixel images. It is interesting to note that the
elevations of the buildings are quite well rendered considering the imagery was vertical.
The reason is that the lens was a wide angle (20mm lens 35mm camera equivalent) and,
therefore, recorded the elevations well at the edges of the frame. The phenomenon can
be seen in Figure 1. For more complete and detailed coverage of the elevations a set of
oblique photos would also be taken.
The dense point cloud is then used to produce a triangular mesh of the surface and
if the triangle count is unnecessarily high to define the surface it will be decimated,
either automatically or under the control of the operator. This helps to reduce the size
of the overall dataset. A surface is then created by filling the triangles with a controllable
degree of smoothing and is normally shaded to show relief. An example of a triangular
mesh is shown in Figure 9. The results of the decimation can be seen where the
triangles are larger on the flatter surfaces of the wall.
The final stage in the production of a rendered (textured) model is prepared and
the resolution of the rendering can be set to closely resemble the original imagery
if required. This will be at the expense of some additional processing time. A textured
model is shown in Figure 10.
Fully digital stereo workstations have been in common use since the 1990s and
Figure 13 shows an example of a twin screen system. Note the stereo glasses worn
by the operator and the large 3D mouse. The stereo eyewear is synchronised with the
transmitter next to the keyboard so that both the left and right lens open and close
alternately, at sixty times per second. This enables the brain to see the data in 3D and
is fast enough to avoid flicker.
Utilising a stable modern SUA platform, a high resolution 100 megapixel camera,
low flying heights of between 25m to 40m, a Ground Sample Distance (GSD) of
1-2 mm can be achieved.
High accuracy Ground Control Points are still required to tie the photogrammetry to
the survey grid, but the data processing will be a combination of off the shelf processing
software and bespoke algorithms to enhance pixel matching.
The above figures are taken from Table 1 and it should be noted that the theoretical
accuracies are based on hard and textured surface observations. They are also
dependent on image quality, control distribution and control accuracy. The plan
accuracy is based on a pointing precision of 1 pixel but may be worse under sub-
optimal conditions. The height accuracy is based on the pointing precision and the ratio
between camera base (the distance between successive images) and the flying height
for 80% forward overlap. This overlap is commonly used for SUA datasets. Automated
algorithms and multiple manual observations can improve these height accuracies.
Table 1 For feature extraction there are now automatic algorithms that can be utilised with
numerous software packages available that accommodate this approach. For example
for a railway mapping project, the height of the crown of a rail and plan position of the
edge of the rail can be automatically extracted from the 3D point cloud. BIM models
and topographic mapping can also be extracted from the point cloud.
To verify the accuracy, Ground Truthing Points (GTP) or Data Validation Points (DVP) will
be required at regular intervals throughout the site and surveyed with a total station.
Ground control points deployed for the photogrammetric process should not be used
for these GTP or DVP. Additional control points will need to be collected and only used
as an accuracy check against the photogrammetry results. These may be collected at
the time of the aerial survey, or be derived from previously collected data or third party
information, provided that there is high confidence in the quality of this data and that it
satisfies the project accuracy requirements. For the example shown in Figure 15, ground
truthing points were placed at approximately 10m intervals.
2. The Camera – for high quality mapping, a high quality camera, avoid very
wide angle or telephoto lenses to minimise distortion and artefacts
4. The Pilot – The pilot is not always a surveyor but needs to understand and
follow the survey flight plan and must be aware of and adhere to Civil Aviation
Authority (CAA) legislation. The pilot needs to have a CAA Licence for the
weight of the SUA being flown (<7kg or <20kg) and Public Liability insurance
must be in place.
8. 3D City Modelling
Multi image nadir and oblique cameras are available to capture 3D city models as
shown in Figure 16.
Figure 16 These multiple oblique image concepts such as Octoblique MIDAS contain 8 oblique
3D city modeling from images
cameras spaced at 45 degrees to complete a 360 degree view without blind spots as
taken from Track Air Octoblique
MIDAS “9 camera rigs” shown in Figure 17.
and processed automatically
with Pix4Dmapper. The imagery results in 8 views from various stations that cover the Nadir view in the
centre. It acquires images at an interval of less than 1 second producing a fully 3D aerial
capture reality in a single flight. It is made possible by having a stabilised suspension
system allowing the cameras to move freely without the need for a bulky old fashioned
circular mount. The powerful computer control centre operates the cameras, IMU,
navigation mount and power to the system.
Off the shelf high end SLR cameras are used instead of expensive medium format
cameras.
With almost 200 remote sensing spacecrafts in orbit or planned, over 200 digital
cameras in use, the increase in SUA solutions, several thousand terabytes of data
need to be processed annually. This increasing demand is forcing industrial
production methods.
Multi Sensor inputs allow for Multi Product outputs in the form of DSM, DTM Ortho
images, True Ortho images, Cloud free mosaics, 3D TIN models and 3D City models.
A Digital Surface Model (DSM) is a representation of the earth’s surface and all points on
it such as buildings, bridges and trees. A Digital Terrain Model (DTM) is a representation
of the bare ground surface with no objects present. The creation of a DTM usually
Figure 18
Pixel Factory Neo
providing industrial scale
photogrammetric production
The cross sections in Figure 21 also show the difference between a DSM and a DTM.
Figure 19 (left)
DSM High performance and intuitive open architecture allow for automatic processing of
Figure 20 (right) vast volumes efficiently. This system is adaptable, can be deployed inside a private
DTM Cloud, and has flexibility to interface with existing third party software and tools.
Figure 21
DSM/DTM
• Fieldwork
o Height checks of critical known values e.g. heights of cars and lamp-posts
• Photogrammetry
o Process mesh
o Process texture
o Export products
o Project brief
o QA reports
o D
etails of any problems encountered, resolved and any other useful
information
• Asset management
• Change detection
• Architectural survey
• Archaeological survey
• Animation
• Orthophotography
• Flood Mapping
• Emergency response
• Surveillance
12. Summary
The advantages and disadvantages of photogrammetry can be summarised as follows:
Advantages
• Capture of layered CAD and surface data directly from the imagery
• 2D or 3D information options
• Field operation times are lower than all other methods for the amount
of data normally captured
RICS Vertical Aerial Photography and Derived Digital Imagery 5th edition Guidance
Note 2010 (GN 61/2010) at:
http://www.rics.org/uk/knowledge/professional-guidance/guidance-notes/vertical-aerial-
photography-and-digital-imagery1
Historic England (2015). Metric Survey Specifications for Cultural Heritage (3rd Edition)
at:
https://historicengland.org.uk/images-books/publications/metric-survey-specifications-
cultural-heritage
The software suppliers provide guides, tutorials, blogs, FAQs, etc on their websites:
www.agisoft.com
https://www.bentley.com/en/products/brands/contextcapture
https://pix4d.com/
www.photomodeler.com
14. Acknowledgements
• Obaid Alblooshi
• Agisoft LLC
• Canon Inc
• Leica Geosystems
• Samsung Group
• Pix4D
• TSA
• Plowman Craven
• Geomatics World
• Track Air
TSA wish to thank Clive Boardman, MA MSc FRSPSoc FCInstCES, in the preparation
of this Guide.
• Delivery dates for the final data and any interim deliverables
> To provide a vehicle for members to act effectively together on agreed
courses of action.
> To promote the interests of the profession to all those who determine
the economic and social conditions in which the industry operates.
Professional attention from a TSA surveyor will reduce risk, repetition, possibly save
you money and will ensure that your project receives the best possible attention.
Email: [email protected]
Website: www.tsa-uk.org.uk
In no event shall TSA and its employees and agents be liable for any special, incidental,
indirect or consequential damages of any kind, or any damages whatsoever, including,
without limitation, those resulting from loss of use, data or profits, whether or not
advised of the possibility of damage, and on any liability, arising out of or in connection
with the use or performance of this publication or other documents which are
referenced by or linked to this publication.
TERM EXPLANATION
SfM Structure from Motion – computer vision term for the automated
and semi-automated 3D modelling software from imagery