DevSecOps Survey Gitlab 2022 PDF
DevSecOps Survey Gitlab 2022 PDF
Thriving in an
insecure world
2
Whatʼs inside?
Introduction 03 Security 19
Security top findings
Overview 04 Security and DevSecOps
2022 DevSecOps Survey top findings Roles are changing
The starting point Shifting left
Software development today Who’s in charge?
The root causes of release delays A look at testing
The increasing role of AI/ML Looking to the future
Of toolchains and popular tools
The role of the DevOps platform Operations 23
Operations top findings
Developers 14
Operations
Develoment top findings
Still so many tools
Devs and DevOps
Working with development
Developer daily life
Looking to the future
Security
Looking to the future
Keeping the DevOps momentum 27
3
Introduction
For six years now we’ve been asking DevOps teams to share
31%
their stories, successes, solutions, and struggles. In May 2022, of teams are using AI/ML for code review, 16 points
5,001 people offered us a snapshot of “their DevOps,” and this higher than last year.
60%
time it was set against a backdrop of sweeping socio-economic
challenges.
of developers are releasing code faster than before.
With so many forces out of their control, it’s clear DevOps teams
We also heard about the challenges, including pandemic-based
focused on what could be accomplished: from deployment
culture changes, hiring and retention struggles, and the level of
velocity to automation, as well as release speed and adoption of
effort required to integrate complex new technologies like artificial
new technologies, the momentum was obvious.
intelligence.
47%
of teams have full test automation, nearly double
But if there was one overarching concern, it was the very real threat
the number in 2021.
security breaches represent. While security continues to “shift left”
70%
of teams release code continuously, once a day, in many teams, it also is, perhaps for the first time, a driving force
or every few days, up 11% from last year. for many decision makers when it comes to choosing a DevOps
platform or other technologies. The threat of security breaches is
Nearly three-quarters of DevOps teams are using a DevOps also top of mind for many DevOps teams.
platform or plan to this year.
As always, a reminder this is our survey so it’s no surprise some
DevOps roles continue to shift: Developers are taking on ops participants use our products. Also, roughly 60% of respondents
jobs, ops is cloud or platform-engineering focused, and security have been “doing” DevOps for at least three years, so their
pros are “hands on” inside dev teams. experiences may feel aspirational for newer, less seasoned teams.
Overview
Gender Industry
45% 3%
26% Female
Computer Hardware / Services / Banking / Financial Services
72% Male Software / SaaS
2%
1% Non-binary/third gender
11% Biotech/pharm
1% Prefer not to say Automotive
2%
0% Prefer to self describe 5% Consumer products mfg
Industrial manufacturing
2%
5% Insurance
Telecommunications
2%
Age 4% Healthcare
Retail
56%
18-34 Business Services / Consulting
4% Government
2%
1%
3%
36% Energy & utilities
Aerospace & defense
35-44 1%
3% Other
7% Media & Entertainment
45-54 3%
Education
2%
55+
6
9% 3% 37%
Site Reliability Engineer Development/Engineering Leadership Not the primary decision maker but on the
team that makes the decisions
8% 3%
Operations Leadership DevOps Leadership 8%
Provide decision making input
8% 3%
Technology Executive - CIO / CTO/VP Systems Engineer / Network Engineer 2%
Not decision makers
6% 2%
Project Manager Release Manager
5% 2%
Operations engineer App security engineer
4% 2%
DevOps Engineer Quality Assurance
4% 2%
Network security specialist Database engineer
4% 1%
Security engineer Technical writer/in charge of documentation
4% 1%
Security leadership Site availability engineer
4% 1%
Product Manager Other
4%
Systems Administrator
7
13%
1%
England 25-49 people
Ireland 5% 245 The Netherlands
69 1% 40 21%
50-99 people
29%
100-249 people
Germany 11%
Canada 1% 73
3% 137 Korea 250-499 people
Austria <1% 20
US 1% 34
75% 3761 2% Japan 9%
1% Pakistan <1% 22
France 75 500-999 people
88
Philippines 5%
2% 110
1000-2499
3% India
161 5%
5000+
Australia
2% 82
New
Other 1% Zealand
1% 30 32
8
What do today’s DevOps implementations look like? A DevOps platform was the
most likely to be part of the process (44%), followed by DevSecOps (42%), CI/
CD and test automation at 34%, and observability/monitoring at 30%. Last year,
11.5% of survey takers used AI/ML; this year the percentage more than doubled
to 24%.
For the third year in a row, respondents said devs are the most likely to benefit
from a DevOps practice (64%), followed by ops (63%), and security (53%).
The top three reasons to choose DevOps? Better code quality, developer
productivity and operational efficiency were called out by 37% of survey takers,
followed very closely by better security/more secure applications. Other clear
benefits from a DevOps practice included increased time to market, better
communication/collaboration, and happier developers/DevOps team members.
An impressive 70% of survey respondents said their teams deploy multiple times
a day, once a day, or once every few days, up 11% from 2021. All told 27% deploy
continuously (multiple times a day), while 14% deploy once a day, and 29%
deploy every few days.
Developers
It’s easy to think software developers are insulated from real- “We have experienced significant difficulty in finding and retaining
world fluctuations; after all, every company is a software company qualified staff”
today and demand for DevOps talent seems insatiable. “4G, 5G, AI, Metaverse, virtual space—developers have to support all of
this”
But in 2022, it’s clear reality has crept in.
“The ‘Covid effect’”
We asked developers to tell us the most challenging parts of their “Too many software frameworks”
role, and their answers were far less likely to be about learning a “QA, undefined quality standards”
new programming language than dealing with big picture trends,
“Technology is rapidly changing” (mentioned very frequently)
including security/hackers, the economy, Covid-19, an insufficient
labor force, and more. There was a strong sense of culture change Shared thoughts:
and dread of looming, complicated technologies, with a clear
Supply chain issues (a common response)
undercurrent of “we may not be ready for this.”
Personnel turnover
In their own words: The economy
All that automation has translated into a huge list of things devs
told us they no longer have to do, including:
Developer daily life
In a trend that we saw beginning in 2020, developer roles continue
“I’m no longer testing my code. “We no longer manually review code”
I ask my peer to review the code.” to shift, taking on more responsibility for what were traditionally
“Write a detailed plan before you ops roles. Fully 38% said they instrument the code they’ve written
“Less infrastructure handholding” develop the code”
for production monitoring (up from 26% in 2021 and just 18% in
“I don’t need a proofreader for my Input, processing, testing and 2020), while 36% define and/or create the infrastructure their
code and the collaboration has analyzing code app runs on, roughly the same as in 2021. But 38% now monitor
calmed down.”
and respond to that infrastructure (up 25% in just one year) and
“We are no longer writing messy code
The code once written will not be and ignoring code quality” 36% say they’re on call for app-in-production alerts. Devs also
tested again and again. said they’re writing the runbooks for apps in production, and that
Shared thoughts:
“Planning and architecture…our tickets
they’re now serving as an escalation point when incidents occur.
have all the necessary steps already Testing
outlined” This year, the largest percentage of devs (27%) said they review
Manual testing code weekly, while 21% either review it with every commit or daily.
“Develop some functionality from
scratch where there’s already library/ A full 76% of developers said code reviews are “very valuable”
Code review
functionality available”
while the remainder said they were “somewhat valuable.”
Documenting
“I am no longer in charge of tasks like
running integration tests as there is Devs are also spending more time than ever before on maintaining
a dedicated QA team for that now” Deploy to production
or integrating toolchains. Nearly 40% said they spend between
Maintaining other peoples’ code one-quarter and one-half of their time on these tasks (more than
“Planning docs - at this point it’s open
up the IDE and hit the ground running” double the 2021 percentage), while 33% are spending at least half
Commented out code
their time and as much as all of their time on toolchain integration
“Design and design documentation
are no longer part of the software Hard coding and maintenance.
development process”
Debugging Who sets devs’ priorities? In 2022, 44% of devs said product
“We use cucumber coding so more
code is reused and less time is
managers while 41% said devs set their own priorities. When
Manual drafting
spent writing it” prioritizing work and features, cost of development is the most
important priority to developers (32%), followed by ROI, developer
workload, and the product roadmap timeline.
18
But, by a single percentage point, devs were the most optimistic about the future
of their careers, despite ongoing changes and shifts. Just over three-quarters
(76%) said they feel “somewhat” or “very” prepared for the future; in fact, 43% of
devs said they feel very prepared, strikingly higher percentages than either ops
(37%) or security (30%).
19
Security
Not as optimistic
Concern about security has never been higher, so perhaps
it’s not surprising 43% of sec pros feel “somewhat” or “very”
unprepared for the future.
20
Shifting left
The great shift left continues: 57% of sec team members said
their orgs have either shifted security left or are planning to
this year. One-third of teams, though, aren’t thinking about a
shift left until at least two years from now.
But all that scanning hasn’t translated into devs having more
Roles are changing data in their workflows, which is an ongoing problem we’ve
seen over the past few years. In fact, just 30% of teams put
As we saw starting last year, security roles are evolving. SAST lite scanners in a web IDE, and only 29% pull scan
Nearly 29% of sec pros said they’re now part of a cross- results into a web pipeline report for devs. Nearly 30% of
functional team (identical to 2021’s findings), while 28% DAST and dependency scans are easily available to devs and
are now more focused on compliance and 35% are more 30% do the same for container scans. Scan availability has
involved in daily tasks/more hands-on, an 11-point jump improved about 10% on average since 2021, but there clearly
from last year. About 48% of survey takers said their roles is substantial room for improvement.
aren’t changing, but 10% said they have more budget, and
7% have more influence over engineering decisions.
21
And, while it may be a bit simplistic to suggest sec and dev really
don’t get along, year after year the data continues to support that
they at least don’t always see eye to eye. For the third year in a row,
the largest percentage of sec pros (47%) said devs find 24% or less
of the available bugs that could be found in existing code…to put
it another way, 75% of the bugs were left for sec to find. Less than
20% of security team members said devs found between half and
How responsible do you feel
three-quarters of the bugs.
for application security in your
A full 57% of survey takers agreed security is a performance metric organization?
for developers in their organization but 56% said it was difficult to
43%
get devs to actually prioritize fixing code vulnerabilities. In the end,
Completely responsible
59% said security vulnerabilities were most likely to be found by the
security team after the code is merged in a test environment. These
53%
aren’t new opinions—we’ve heard them since 2020, but this year the
Responsible, but as part of a bigger team (everyone)
percentage of security pros “complaining” was down dramatically
from last year’s 80%+ view, perhaps a sign of improving relations. 3%
I do my part but someone else owns it
Who's in Charge? 1%
Not particularly responsible
While dev and ops are taking on a larger share of security
ownership, it’s not so straightforward on the sec team. In 2020
and 2021, the percentage of security pros who said they were
fully responsible for security was roughly the same as those who
said everyone was responsible. This year the picture has changed
dramatically: 43% of sec team members admitted to full ownership
of security (a 12% jump from last year) but a resounding majority
(53%) said everyone was responsible, a 25% increase from 2021.
22
Operations
Moving forward
Ops pros continue to think programming and soft skills will be the
most important skills they can have.
24
Operations
At the nexus of every single change that happens in DevOps, And that’s just the beginning. When asked what DevOps
operations pros need to be prepared for anything, particularly has added to ops roles that didn’t exist before, options
shifting roles and responsibilities. We asked them to describe were nearly evenly divided among the seven choices.
their primary job responsibilities in 2022. Managing the cloud was the top response, but managing
hardware/infrastructure, maintaining the toolchain, DevOps
coaching, responsibility for automation, overseeing all
compliance, and platform engineering were almost equally
mentioned.
54% 32%
are managing hardware manage hardware Of all of those newer tasks, managing audit and compliance
infrastructure all or infrastructure requirements is becoming increasingly critical. The majority
most of the time “sometimes”
of respondents said they spend between one-quarter and
half their time on audit and compliance, a 15% increase
from 2021. Almost one-quarter of ops pros said they spend
between half and three-quarters of their time dealing with
audit and compliance.
52% 31%
manage cloud manage cloud
services all or most services
of the time “sometimes”
25
Metrics is the most important monitoring But that visibility brings information and it’s increasingly clear ops is struggling
category followed by logging. with true information overload: 39% of ops respondents said the DevOps data they
need exists but accessing and managing it is difficult, while 27% went further and
The top choice for capturing and viewing acknowledged being “overwhelmed” by the amount and scope of data available.
logs is Datadog (47%), followed by LogDNA Another 14% either don’t know what data is available or say their organization
(43%), and Splunk (41%). Datadog was doesn’t track what they need. Just 18% report they have all the data they need and
also the first choice for tracking traces, find it easy to access.
followed by AppDynamics and Dynatrace.
And Datadog was also the tool of choice In a continuing sign of shifting roles, nearly 77% of ops pros said their devs are
for capturing time-series metrics, followed able to provision testing environments, which is an 8% increase from last year. And
by Solar Winds. there is more actual DevSecOps happening: Just over 76% of ops teams agree at
some level that devs are able to receive and address security issues during the
A majority of ops teams (58%) use Google development process (that’s a 10% jump from last year).
Cloud Platform, up 35% from 2021,
followed by Azure and AWS. Just 4% of There’s no question that ops pros are experiencing an increasing sense of urgency
respondents currently don’t use a cloud and ownership around security. An impressive 48% of operations team members
provider or don’t know which one it is, said they were solely responsible (up from 28% last year), while 40% believe they
down 9 points from last year. are responsible but as part of a bigger team, a 6% increase since 2021.
26
More globally, dev, sec, and ops agreed that their top area of investment in 2022 would be
security. A close second priority will be cloud computing (21%), followed by DevOps, AI, and
blockchain (all 20%). Combine AI with its technology cousin machine learning/MLOps and
that was the clear investment winner at 30%.
Priorities varied depending on where in the DevOps team respondents were. Ops pros
plan to double down on cloud computing (24%), followed by security at 23% and DevOps
(21%). Interestingly a full 24% of devs want to put their focus on DevOps this year, followed
by AI (22%), and cloud computing and a DevOps platform (21% each). The security team is
primarily interested in blockchain (36%) followed by security (25%) and cloud computing and
AI (both 17%).
Management’s top areas of investment were blockchain (23%), security (22%), and cloud
computing (21%).
Today’s teams are clearly doing the planning, thinking, and work to move DevOps and
software development forward, even during stressful world events. Use this survey and
see how your team compares, and then share with colleagues also on the DevOps journey.
DevOps isn’t a destination, it’s a process.