86959
86959
7,500
Open access books available
195,000
International authors and editors
215M
Downloads
154
Countries delivered to
TOP 1%
most cited scientists
14%
Contributors from top 500 universities
Abstract
Many effective quality systems to maintain the robots’ autonomous task expansion
process in construction industries for various applications over the years have yet to
be well established. This study, therefore, presents a simple deep/neural network
algorithm to diverse robotics tasks on building construction—bricklaying, grasping,
cutting materials, and aerial robot obstacle avoidance and highlight the strengths of
these algorithms in real-world robotics applications in building sites. Our findings
revealed that the amount of tasks robots encountered in real-world environments is
extremely challenging for existing robotic control algorithms to handle. Also, our
algorithm when evaluated against other conventional learning algorithms can be a
more powerful tool with the capacity to learn features directly from data, making it an
excellent choice for such robotics applications in building construction. In other
words, our algorithm can teach robots the ability to “work,” “think,” “know,” and
“understand” their surroundings. It can also improve customer satisfaction, speed up
the building process, and improve the productivity of building development teams.
This chapter, however, contributes to classifications of autonomous robotics applica-
tion development in construction literature. Although the problem addressed in this
chapter is based on building construction, the algorithms presented are designed to be
generalizable to related tasks.
1. Introduction
historically been slow to onboard automated solutions [3]. The reason could be linked
to product features and complexity (project size, lifetime and uniqueness, versatile
construction environments). According to Ref. [4], several other phenomena could
add to the characteristics of these construction industries that often contribute to the
complexity of projects. This phenomenon includes client needs that are sometimes
imprecise and changing, causing significant change in costs; little overall learning
because of few repetitions; high risks due to novelty; technical, climatic, and even
societal uncertainties; coordination and complex decision-making processes between
the teams involved; and changing conditions of realization. The weak capital budgets
in R&D and the reluctance of strategies related to construction automation are other
important factors [5].
These phenomena have remained unresolved for a variety of reasons. First,
building nowadays are complex entities, and construction entails many different
trades coming together to work in perfect sync with each other [6–9]. A replica of
human-like dexterity, intelligence, and situational awareness, developed over hun-
dreds of millions of years, is needed to break even [10]. Secondly, building construc-
tion project sites is often chaotic, disorganized spaces with materials, tools, debris, and
wires spread about. Many areas of the sites have unpaved soft soil, into which a
builder may sink if he steps off the beaten path. There are some environmental factors
such as dust, rain, ice, and storms. There are humans walking around, etc. All these
have not improved for so long because construction industries are the least digitized
sector [3, 5].
Nevertheless, several ongoing initiatives suggest a gradual change in practices
in this industry for rapid industrialization, which is enabled thanks to robotics
and automation. According to Ref. [11], rapid industrialization is always based
on quantity and quality that includes prefabrication, mechanization, automation,
robotics, and finally reproduction. This gradual change toward rapid
industrialization is driven by a concern to change the narrative and to be in line
with the innovations observed at the international level that will respond to
important building construction challenges: workforce, competitiveness,
sustainable development, etc. In view of this, digital transformation with robotics
technologies is one of the preferred avenues to improve the sector’s overall perfor-
mance over the long term [12]. This digital transformation is expressed in different
ways. One of the strong currents is based on the so-called concept of the Fourth
Industrial Revolution (4IR), based on unsupervised robotics utilization in building
constructions.
While the robotics use in building construction will only continue to grow
from traditional design through final inspection and maintenance, the full
benefits of construction robotics have yet to be realized. For example, as
robotics begins to move from the lab to the real world, robots face many new
challenges. A building construction assistant robot, for instance, must perform
many complex tasks such as bricklaying, foaming, sorting, operating appliances,
picking up, and cleaning materials in the site. It must also handle the huge variety of
objects, materials, and the likes associated with these tasks such as picking up differ-
ent objects, some of which it may never have seen before. For all of these problems,
there exists only an abstract relationship between the robot’s visible inputs and the
task at hand.
2
Deep Neural Networks for Unsupervised Robotics in Building Constructions: A Priority Area…
DOI: http://dx.doi.org/10.5772/intechopen.111466
training data. This approach will allow us to model concepts, which might be difficult
or impossible to properly hand-model. It will also allow for adaptable models—as long
as the form of the model is general, meaning it can be adapted to more or different
cases simply by providing training data for these new cases.
However, by using unsupervised feature learning algorithms, deep learning
approaches are able to pre-initialize these networks with useful building construction
features, thus avoiding the overfitting problems commonly seen when neural net-
works are trained without this initialization. This machine learning algorithm can
therefore work very well on a wide variety of construction projects.
Nevertheless, we begin with a general description of deep learning algorithms
for unsupervised feature learning as well as their strengths and particular
advantages as learning algorithms for robotics applications on building constructions.
Finally, we present a simple deep/neural network algorithm to diverse robotics tasks
on building construction—bricklaying, grasping, cutting materials, and aerial robot
obstacle avoidance—highlighting the strengths of these algorithms in real-world
robotics applications in building sites. It is our hope that these algorithms will
demonstrate a more appropriate computation model where, for instance, robots’
artificial intelligence and ability to detect obstacles and carry out multiple
construction tasks unsupervised are no longer isolated from the subjective experience
of the body.
2. Literature review
Figure 1.
Multi-layer artificial neural network.
Figure 2.
Deep neural network for deep learning.
Figure 3.
Classification and clustering.
Few numbers of references are reported in the literature regarding use of drones/
UAVs technologies in construction by many authors [3, 25–27]. The reports show that
the use of drones highlights the essential role of humans in robotics, as drones are
being utilized for a range of tasks from painting to identifying safety concerns on
work sites. See Figure 4. These robotic manipulators are appropriate for the different
spraying activities involved in construction work. For example, high-rise building
coating, fireproofing application, and shot blasting can all be done without the need
for a human operator to be physically present. With the aid of drone robots, a variety
Figure 4.
Drone in construction work site.
6
Deep Neural Networks for Unsupervised Robotics in Building Constructions: A Priority Area…
DOI: http://dx.doi.org/10.5772/intechopen.111466
Bricklaying work is one of the most arduous jobs in construction [40, 41] since it
includes a mason standing, kneeling, and lifting. In addition, the mason works
almost exclusively outside and undergoes the weather conditions (rain, wind, heat,
humidity). The mason sometimes works in height scaffolding or in trenched soils,
which may put his life in jeopardy. However, in the last two decades, some
research projects focused on the development of a bricklaying robot [42]. Bricklaying
work follows predefined steps and thus is favorable for automation. However, the
process cannot be fully automated and requires the supervision of a worker nearby to
adjust/control the robot. Tan et al. [43] stressed the importance of the environment
when designing a robot. They support the idea that robot level of autonomy should be
in line with the environment (actively/passively/not assisted environment). For
that, the authors proposed a framework to help categorize the robot/environment
interaction.
Recent advancements in masonry work automation technology include Australian
Hadrian X and Construction Robotics’ SAM100 also known as semi-autonomous
mason are robotic bricklaying machines [44, 45]. Hadrian X uses an intelligent control
system alongside Computer Aided Drawing (CAD) to function and is capable of
building a standardized home every two days on average. The robot is capable of
laying the bricks with a high accuracy thanks to a laser guidance system. It is also able
to work on almost any block size. The advantage of such a design is the flexibility in
mobility: The robot can work under difficult circumstances linked to the environ-
ment. That is to say, by deploying Hadrian on a construction project, one can benefit
from faster masonry work, least material wastage, and overall cost-efficacy. Hadrian
X closely resembles a truck crane (Figure 5).
SAM100 (Semi-Automated Mason) on the other hand is designed to work collab-
oratively with masons to increase productivity by 3 to 5 times while reducing lifting by
80% and so on [45]. The robot has successfully passed the prototyping phase and is
Figure 5.
Bricklaying robot “HADRIAN X.” source: Pivac and Pivac [44].
8
Deep Neural Networks for Unsupervised Robotics in Building Constructions: A Priority Area…
DOI: http://dx.doi.org/10.5772/intechopen.111466
Figure 6.
SAM100 robot onsite screenshot. Source: Podkaminer and Peters [45].
now commercially available. Figure 6 shows the utilization of SAM100 onsite. This
robot is by far the most complete masonry robot realized until now. It can lay bricks
with precision and includes the binder in the process of laying as well. SAM100 is
capable of laying 800–1.200 bricks a day. The robot performs in a straight line with a
limited height capacity. SAM100 costs around 500.000$ (442.030 €).
Figure 7.
FUNAC robots with long arms placing bricks and other materials.
Figure 8.
The FANUC M-10ia and the FANUC R-2000ib six-axis robots.
10
Deep Neural Networks for Unsupervised Robotics in Building Constructions: A Priority Area…
DOI: http://dx.doi.org/10.5772/intechopen.111466
• It ought to function in dangerous conditions, in the dark, and without issues with
administration or motivation that would be profitable [48].
Sensing and control, mobility and manipulation, human aspects and task factors,
expert systems, and task flexibility are some of the qualities. The following sections
describe these qualities in more detail.
The main motivation for the development of construction robots for use in severe
settings, high and deep locations, boiling seas, and radiation zones is safety [51]. In
these applications, the robots could operate alone or in tandem with a human operator
working remotely from a secure location. Man or machine must have overall control
for safety reasons. However, it is important to consider the current state of telecontrol
to prevent delay issues when dealing with challenging tasks and to provide accurate
manipulation feedback to the operator. During teleoperation, human factors are very
crucial, even though automation reduces manual labor, it often requires more mental
and cognitive effort. At this stage, the human-machine interface is particularly
important for machine control and display.
The construction industry will not benefit much from robotics on its own. Real
progress can only be made when the construction process is completely organized.
Expert systems, CAD/CAM, and database technologies are crucial in robots for task
flexibility in civil engineering applications [52]. This field is now conducting in-depth
research on unique programming environments, engineering graphics, logic, compu-
tation, and control requirements. The loadings, material properties, components,
connectors, assembly, and geometric reasoning system all play a role in how con-
struction components are represented in three dimensions by an expert system. A
computerized work-control system will be necessary for robotic work to be employed
efficiently. This system must include the construction site organization and sophisti-
cated processing of commodities from the site to the robot.
Figure 9.
Proposed architecture of the neural networks in the work of Levin and Narendra [55].
system at index k, as indicated in Eq. (1). The proposed design of the neural networks
is shown in Figure 9.
u ¼ NN ψ ðv, zÞ
ðz, vÞ ¼ εRn xRr (2)
z ¼ NN φ ðxÞ
However, Sontag tested and used this model to examine the potential and ultimate
constraints of alternative neural networks designs [56]. He asserts that nonlinear
systems like robots in general may be stabilized using neural networks with two
hidden layers. Their conclusion seems to go against neural networks approximation
theories, which contend that neural networks with a single hidden layer are the best
approximators. In contrast to approximation problems, Sontag’s solutions are based on
the representation of the control problem as an inverse kinematics problem.
3. Method
3.1 Building deep learning algorithm for unsupervised robotics for construction
industries
However, the model specification p (y|x) = N (y; x w + b, 1), and, in most cases, the
optimization algorithm defined by solving Eq. (3) for where the gradient of the cost is
zero. By recognizing that these components can be replaced independently, a broad
range of algorithms can be obtained. The cost function typically includes at least one
term that causes the learning process to perform statistical estimation. Thus, the most
common cost function is the negative log-likelihood, so that minimizing the cost
function causes maximum likelihood estimation. The cost function may also include
additional terms, such as regularization terms. For example, we can add weight decay
to the linear regression cost function to obtain
13
Avantgarde Reliability Implications in Civil Engineering
Jðw, bÞ ¼ λkwk E, p log p yjx : (4)
This still allows closed-form optimization. For example, if we change the model to
be nonlinear, then most cost functions can no longer be optimized in closed form. This
requires us to choose an iterative numerical optimization procedure, such as gradient
descent. The recipe for constructing a learning algorithm by combining models, costs,
and optimization algorithms supports both supervised and unsupervised learning. The
linear regression example shows how to support supervised learning. Unsupervised
learning can be supported by defining a dataset that contains only x and providing an
appropriate unsupervised cost and model. However, we can obtain the first PCA
vector by specifying that our loss function is
while our model is defined to have w with norm one and reconstruction function r
(x) = w xw. In some cases, the cost function may be a function that we cannot actually
evaluate, for computational reasons. In these cases, we can still approximately minimize
it using iterative numerical optimization so long as we have some way of approximating
its gradients. Most machine learning algorithms make use of this recipe, though it may
not immediately be obvious. If a machine learning algorithm seems especially unique or
hand-designed, it can usually be understood as using a special-case optimizer. Some
models such as decision trees or k-means require special-case optimizers because their
cost functions have flat regions that make them inappropriate for minimization by
gradient-based optimizers. Recognizing that most machine learning algorithms can be
described using this recipe helps to see the different algorithms as part of a taxonomy of
methods for doing related tasks that work for similar reasons, rather than as a long list
of algorithms that have separate justifications.
4. Discussion
These feature learning approaches are one of the major strengths of modern deep
learning methods. Since these algorithms are able to learn good features from data,
they are much less sensitive to input representations than other conventional learning
algorithms such as support vector machines, Gaussian processes, and others. Deep
learning algorithms are able to learn good representations and solve problems even
from basic representations such as raw pixels, avoiding the need to hand-design
features as with other learning algorithms, saving significant engineering effort for
many of the complex problems encountered in robotics, where features can be
unintuitive and hard to design.
5. Conclusion
The branch of computer science that is now permeating the construction sector is
robotics. It is crucial to automate construction sites so that robots can perform risky
tasks for workers in dangerous environments like high altitudes, deep water, high
radiation zones, inclement weather, and deep oceans. It is also beneficial in terms of
avoiding the disruptive effects of strikes, issues with administration and motivation,
safety and health regulations, a lack of skilled labor, and the need to perform
14
Deep Neural Networks for Unsupervised Robotics in Building Constructions: A Priority Area…
DOI: http://dx.doi.org/10.5772/intechopen.111466
repetitive, dirty, and dangerous work as well as the completion of projects or tasks
with quality control, on schedule, and economically. Despite the fact that this tech-
nology is helping the construction industry, much research is still needed in the areas
of sensing and control, human factors, task flexibility, and the software support to
integrate robots into a larger construction-based management. Our feature learning
approach is one of the major strengths to achieve this. Since this algorithm is able to
learn good features from data, they are much less sensitive to input representations
than other conventional learning algorithms such as support vector machines, Gauss-
ian processes, and others. Our deep learning algorithm is able to learn good represen-
tations and solve problems even from basic representations such as raw pixels,
avoiding the need to hand-design features as with other learning algorithms, saving
significant engineering effort for many of the complex problems encountered in
robotics, where features can be unintuitive and hard to design.
Acknowledgements
The authors express their gratitude to all that helped in the actualization of this
research.
Conflict of interest
Author details
© 2023 The Author(s). Licensee IntechOpen. This chapter is distributed under the terms of
the Creative Commons Attribution License (http://creativecommons.org/licenses/by/3.0),
which permits unrestricted use, distribution, and reproduction in any medium, provided
the original work is properly cited.
15
Avantgarde Reliability Implications in Civil Engineering
References
[7] Hussain CM, Samiha N, Paulraj MS. [15] Herrmann J, Pawelzik K, Geisel T.
Source reduction and waste minimization. Learning predictive representations.
In: Advanced Zero Waste Tools: Present Neurocomputing. 2000;32-33:785-791
16
Deep Neural Networks for Unsupervised Robotics in Building Constructions: A Priority Area…
DOI: http://dx.doi.org/10.5772/intechopen.111466
[23] Wehle H-D. Machine learning, deep [30] Siegwart R, Nourbakhsh IR,
learning, and AI: What’s the difference? In: Scaramussa D. Introduction to
Conference Paper July 2017. Germany: Autonomous Mobile Robots. Cambridge,
New Generation Books. 2017 Massachusetts London, England: MIT
Press; 2004
[24] Lorenc SJ, Handlon BE, Bernold LE.
Development of a robotic bridge [31] Giordan D, Adams MS, Aicardi I,
maintenance system. Automation in et al. The use of unmanned Areial
Construction. 2000;9:251-258. vehicles (UAV) for engineering geology
DOI: 10.1016/S0926-5805(99)00040-0 applications. Bulletin of Engineering
Geology and the Environment. 2020;79:
[25] Ajayi OG, Salubi AA, Angbas AF, 3437-3481. DOI: 10.1007/s10064-020-
Odigure MG. Generation of accurate 01766-2
17
Avantgarde Reliability Implications in Civil Engineering
[32] De Melo RRS, Costa DB, Alvares JS, [39] Gogu G. Structural Synthesis of
Irizzary J. Applicability of unmanned Parallel Robots—Part 5: Basic over-
aerial system (UAS) for safety inspection Constrained Topologies with schönflies
on construction site. Safety Science. Motions. New York: Springer; 2014
2017;98:174-185. DOI: 10.1016/j.ssci
2017.06.008 [40] Hess J, Weinstein M, Welch L.
Ergonomic best practices in masonry:
[33] Vieri GS, Gianluca B, Emilio C. Regional differences, benefits, barriers,
Autonomous Reinforcement and recommendations for dissemination.
Learning of Multiple Interrelated Tasks. Journal of Occupational and
IEEE; 2019 Environmental Hygiene. 2010;7:446-455.
DOI: 10.1080/15459624.2010.484795
[34] Rajkumar R, Roshini C, Sadhana S,
Saranya S. Robotics in civil engineering. [41] Vink P, Miedema M, Koningsveld E,
International Journal of Scientific & van der Molen H. Physical effects of new
Engineering Research. 2017;8:10 devices for bricklayers. International
Journal of Occupational Safety and
[35] Screpanti L, Miotti B, Monteriu A. Ergonomics, Taylor & Francis. 2002;8:
Robotics in education: A smart and 71-82. DOI: 10.1080/
innovative approach to the Chalenges of 10803548.2002.11076515
the 21st century. In: Scaradozzi D,
Guasti L, Di Stasio M, Miotti B, [42] Pritschow G, Dalacker M, Kurz J,
Monteriu A, Blikstein P. (editors). Zeiher J. A mobile robot for on-site
Makers at School, Educational Robotics
construction of masonry. In: Proceedings
and Innovative Learning Environments.
of IEEE/RSJ International Conference on
Lecture Notes in Networks and Systems.
Intelligent Robots and Systems (IROS’94).
2021; 240. Springer, Cham. doi: 10.1007/
Vol. 3. Piscataway, NJ: IEEE; 1994, 1701–
978-3-030-77040-2_3
1707. DOI: 10.1109/IROS.1994.407628
[36] Attuquayefio S, Addo H. Review of
obstacles which inhibit ICT adoption in [43] Tan N, Mohan RE, Watanabe A.
higher education. European Scientific Toward a framework for robot-inclusive
Journal. 2014;10(13):1857-7881 environments. Automation in
Construction. 2016;69:68-78.
[37] Chauhi BA, Chausi A, Dka Z. ICT for DOI: 10.1016/j.autcon.2016.06.001
higher education: An outlook on the cost
saving IT projects and information [44] Pivac M, Pivac M. Fastbrick
systems. Conference: Managing robotics. 2016. Available from: https://
intellectual capital and innovation for www.fbr.com.au/
sustainable and inclusive society. In:
Proceedings of the MakeLearn and TIIM [45] Podkaminer N, Peters L. S.
Joint International Conference. Bari, Construction robotics. 2015. Available
Italy: International Academic Publisher; from: https://construction-robotics.com/
2015. p. 63
[46] Pritschow G, Dalacker M, Kurz J,
[38] Odia LO, Omofonmwan SI. Gaenssle M. Technological aspects in the
Educational system in Nigeria problems development of a mobile bricklaying
and prospects. Journal of Social Sciences. robot. Automation in Construction.
2007;14(1):86-85. DOI: 10.1080/ 1996;5:3-13. DOI: 10.1016/0926-5805
09718923.2007.11978347 (95)00015-1
18
Deep Neural Networks for Unsupervised Robotics in Building Constructions: A Priority Area…
DOI: http://dx.doi.org/10.5772/intechopen.111466