Microsoft Ondemand Setupassessment Guide
Microsoft Ondemand Setupassessment Guide
Setting up and configuring On-Demand assessments is a complex process. There are several steps to complete
in a specific order to ensure successful assessment setup and execution. This article aims to provide the details
required that are applicable across all the On-Demand assessments available on Services Hub.
This article is organized in four major sections which should be followed in order to ensure successful
configuration and execution of On-Demand assessments.
There are also configuration details applicable to each individual assessment that are referred to in the Configure
Microsoft On-Demand Assessment(s) section of this article with links to the relevant content.
Ensure that you have reviewed the information in the assessment(s) prerequisites and configuration
documentation before continuing the setup in this document. Download the prerequisites for your
assessment(s) at On-Demand Assessments Prerequisites if not already downloaded.
For general information about On-Demand assessments, see the On-Demand Assessment FAQs
! Important – Migration: Documentation on how to migrate MMA based Assessments to AMA can be found by
accessing the following article: On-Demand Assessments - Migration
This document was last updated on May 30th, 2023. To ensure you have the latest version of this document, check here:
Assessment Setup Guide
Introduction ............................................................................................................................................................................ 1
Table of Contents .................................................................................................................................................................... 2
Getting Started with On-Demand Assessments .................................................................................................................. 3
Sign up for On-Demand Assessment Initial Setup and Configuration Service ................................................................. 3
Azure Subscription .............................................................................................................................................................. 4
Services Hub Registration.................................................................................................................................................... 5
Linking of the Azure Subscription and Log Analytics workspace to Services Hub workspace ............................................ 6
Configuration Methods ....................................................................................................................................................... 9
Networking ........................................................................................................................................................................ 16
Azure VM as data collector machine ............................................................................................................................... 17
Offline – Disconnected Environment ............................................................................................................................... 18
Add the Assessments in Services Hub ............................................................................................................................... 21
Providing Access to Azure Log Analytics workspace ......................................................................................................... 23
Configure Microsoft On-Demand Assessment(s) .............................................................................................................. 23
Configuring the required Group Policy Objects ................................................................................................................ 23
Creation of the Assessment Scheduled Task ..................................................................................................................... 25
Download On-Demand Assessment Prerequisites ............................................................................................................ 28
Working with Assessment Results ..................................................................................................................................... 29
Validate Successful Assessment ........................................................................................................................................ 29
Services Hub Assessment Page ......................................................................................................................................... 32
Downloading the reports from Services Hub .................................................................................................................... 32
Remediation Plan creation in Service Hub ........................................................................................................................ 33
Assessments are available through the Services Hub to help you assess and optimize the availability, security,
and performance of your on-premises, hybrid, and cloud Microsoft technology environments. These assessments
use Microsoft Azure Log Analytics tables, Azure Workbooks and Azure ARC/Azure VM extensions, which are
designed to give you simplified IT and security management across your environment.
Note: On average, it takes two hours to initially configure your environment to run an On-Demand Assessment.
After you run an assessment you can review the recommendations in Azure Workbooks. This will provide you with a
prioritized list of recommendations, categorized across six focus areas. This allows you and your team to quickly
understand risk levels, the health of your environments, act to decrease risk, and improve your overall IT health.
Use the following checklist to ensure all steps in this section are completed before moving onto the next section.
▪ Azure Subscription
▪ Provide access to Azure Log Analytics workspace (Required for CSA Delivery only)
An initial setup and configuration service with a Microsoft engineer is available to simplify the assessment setup
process as part of the Microsoft Unified Support base contract offering. We help you link, enable, install, and
configure a Services Hub On-Demand Assessment. To learn more, see our Data Sheet. You can get started by
clicking ‘Sign up’ on the top right tile of your Services Hub dashboard under ‘Setup & Configuration’. This sends
an email to your Microsoft representative to request scheduling of this service.
Whether using the On-Demand Assessment – Setup and Config Service or not, all the steps in this article and the
assessment(s) prerequisites documents needs to be completed to ensure successful setup and execution of
OnDemand assessments. Complete the steps in this guide, then select an On-Demand Assessment from the
table of contents on the left, under Getting Started with On-Demand Assessments, to see details, configuration
instructions, and links to download data sheets and detailed prerequisites for selected On-Demand Assessments.
On-Demand Assessments ingest their recommendations and supporting details into Azure Log Analytics. The
Azure
Log Analytics service requires an Azure subscription owned by the organization. If there is already an Azure
subscription, then a customer representative (their registered email address) with the required Azure Log
Analytics access and/or Azure Subscription access will need to be invited to the Services Hub workspace by the
CSAM.
If there is no Azure subscription, Microsoft will sponsor one for the customer. The ideal owner for the sponsored
subscription is the main point of contact IT professional that will be working with the assessment results. There
are a couple of options to have a sponsored Azure subscription provisioned.
The preferred option is to share an organizational email address to be provisioned as owner of a no-cost Azure
sponsorship with the organization's CSAM. Once the Azure sponsorship is created, an email with an invitation
to activate the subscription will be sent to the provided organizational email address. Activate the Azure
subscription through the link provided in the email. This account will be invited to the Services Hub workspace
by the CSAM.
An alternative option is to request for one directly by creating a support ticket by contacting Services Hub
Support and providing an organizational email address to be provisioned as owner of a no-cost Azure
sponsorship.
Note: Customers can choose to use any Azure Subscription for this purpose as long as the user has the required Azure
Subscription and/or Log Analytics role to perform the required actions. The Azure Subscription can be an EA or
PayAsYou-Go or trial azure subscriptions. Azure subscriptions created merely due to presence of Office 365 licenses
cannot be used as they don’t have active azure credits.
Tip: No-cost sponsored Azure subscriptions by default have a validity of 1 year. These subscriptions can be extended
before expiry if needed in case of renewals. You can read more about how to manage these subscriptions in this
Azure Rollover article.
CSAM tasks:
1. The CSAM invites customer and CSA (for engineer lead assessment deliveries). Log in to Services Hub
using Microsoft Edge and go to Management > Manage Users.
2. Add customer’s email addresses and CSA with [email protected] and ensure the Health and
Programs options are selected to allow the user to see the assessment tab and create a remediation
plan.
1. Review your email inbox for an email from your CSAM inviting you to register on Services Hub
1. Log into Services hub with user credentials with the required access. Go to IT Health -> On-Demand
Assessments.
Organizations that have an Azure subscription but lack the required permissions will see:
Please work with your company's Services Admin, CSAM, or Support Account Coordinator to have the customer
representative with the required permissions within Azure register on Services Hub and pre-configure your
assessments. Organizations without an Azure subscription refer to Azure Subscription to get your Microsoft
sponsored subscription.
4. Choose the Azure Log Analytics workspace that the assessment(s) you choose will be enabled in. Or use the
Create New to create a dedicated workspace for the assessment(s) if desired. Then click next.
There are 3 scenarios available to configure the assessment. Determine which scenario fits best for your
organization.
• Azure VM Extension
• Disconnected Environments
Minimum requirements for a successful configuration: Local Administrator on the data collection machine and Azure
Contributor role at subscription level
On-premise machines can be easily enrolled to Azure Arc via Azure Portal by following the steps below:
1. Go to the Azure Portal and look for Azure Arc, under Getting Started, go to Add your infrastructure for free and
click on the Add button
3. You can choose between Add a single server or Add multiple servers and click on the Generate script matching
your selection
Note: Before running the script, make sure to set your execution policy to remove signed (set-executionpolicy
remotesigned)
Servers – Azure Arc –> Select your server – > Go to Extensions and click on Add. Search for Azure Monitoring Agent for
Widows:
Select Next –> Review + Create –> Create. After deployment has been completed, the Agent will show up in the list of
installed extensions:
! Note: Currently the recommendation is to ensure all extensions are uninstalled before disconnecting a machine. If an
extension request is stuck with deleting or creating status, please reach out to us and we will investigate. From the
Azure Arc Server panel -> Select your Machine -> Scroll down to New Support Request:
During installation and runtime, the agent requires connectivity to Azure Arc service endpoints. If outbound connectivity is
blocked by the firewall, make sure that the following URLs are not blocked:
If you are planning to use an Azure VM as a data collector machines for on demand assessments, there is no
requirement for the VM to be associated with Azure ARC as the assessment can be activated as a simple extension.
The following article describes how to create a Windows virtual machine in the Azure portal: Quickstart: Create a
Windows virtual machine in the Azure portal
After creating your Azure VM, you’ll first need to install the Azure Monitoring Agent for Windows. The following
article describes the process: Manage Azure Monitor Agent - Azure Monitor | Microsoft Learn
- To remove the AMA extension from your Azure VM, follow the same procedure as above and run the following
PS command:
More information about Virtual Machine extensions and features for Windows can be found by accessing the following
• There is zero connection allowed from the assessed environment to the Internet or to any other machine
that has Internet access
• One is the data collection machine and needs to fulfill prerequisites from the assessment.
• The other is the machine that has Internet access and can upload data to Azure Log Analytics.
o This machine needs to be enrolled into Azure Arc in order to upload the batch of data from the
first machine that did not have an internet connection.
To successfully execute On-Demand assessments via this method, an offline secure file copy process is necessary
to transfer files to and from the Internet connected machine and the environment being assessed.
- Set the scheduled task to start manually, removing the weekly schedule.
- Start the scheduled task, this will download the assessment executable and the assessment package.
o Go to the Working Directory that was entered in the assessment setup. <Working
Directory>\XXAssessment Where XX is different for each assessment.
o A numbered folder will appear. As soon as you see this folder, stop the OMSAssessment.exe
process in Task Manager.
- Go to: C:\ODA\Packages
2. Find the assessment package for the technology you need, open the file location and copy that
Execpkg file to the same location as where you stored the “OMSAssessment” folder.
This concludes the actions on the machine with Internet access until we want to upload data.
Create a folder on the local drive that has enough free disk space to store all collected data, up to 10GB.
- C:\MicrosoftAssessment\Collect
Copy the Execpkg file and OMSAssessment folder to the C:\MicrosoftAssessment folder.
Copy the files that are named new.* over to the machine with Internet access
Our Azure DCR (data collection rules) will detect the new set of recommendations and upload the data to the Workbooks as
soon as possible.
Review data afterwards on the portal, it may take up to one hour after the data is submitted to show up.
Note: More information regarding our data collection configuration (DCR) can be found by accessing the
following article: Data collection rules in Azure Monitor
To configure an assessment, go to Services Hub, IT Health, and On-Demand Assessments. Browse through
the assessment catalog and choose the Assessments that best fit your organization’s needs.
Select an assessment of your choice from the list of available assessments and click on the assessment title. For
example, Windows Client.
Choose your data collection machine based on your method of configuration (Azure Arc Server or Azure VM) and
input
the logging path:
Once the solution has been installed on your data collection machine, you will be able to find the following folders on
your Local C:\ drive, these contain the Assessment specific binaries and Solution packages:
Note: All Azure Arc enrolled machines and VM extensions associated with your Azure Subscription, will show up in
your Services Hub Workspace(s), even if these are configured in a different Log Analytics Workspace or Resource
Group.
Granting access to the Log Analytics workspace to Microsoft personnel is necessary for CSA lead deliveries of
OnDemand assessments and must be completed by the Azure subscription owner. We recommended you add
users as a Log Analytics Reader to grant @microsoft.com users access to your Azure Log Analytics workspace to
view your assessments. They will not have access to your Azure subscription.
Note: This step is not required for self-consumption of assessments without CSA lead delivery.
Provide access to the Log Analytics workspace by adding an account and granting access as mentioned in the
following guide: Add Users to Azure Log Analytics through the Azure portal
Use the following checklist to ensure all steps in this section are complete.
Successful execution of assessment scheduled tasks requires some policy configuration on the data collection
machine to mitigate issues/risks known to degrade the successful collection of assessment data from your
environment. The following configurations are applicable to all assessments.
Once the solution has been installed on your data collection machine, you will be able to find the following folders on
your Local C:\ drive, these contain the Assessment specific binaries and Solution packages:
1. Validate and configure the environment being assessed and the account and access required for
successful collection per prerequisite documents for the respective assessments.
2. Create the assessment scheduled task for the assessments being configured.
Active ✔ ✔ https://docs.microsoft.com/en-
Directory us/serviceshub/health/gettingstartedad#prerequisites
Active ✔ https://docs.microsoft.com/en-
Directory us/serviceshub/health/gettingstartedadsecurity#prerequisites
Security ✔
SCCM ✔ ✔ https://docs.microsoft.com/en-
us/serviceshub/health/gettingstartedsccm#prerequisites
✔
Exchange ✔ ✔ https://docs.microsoft.com/en-
us/serviceshub/health/gettingstartedexchange#prerequisites
✔
(Optional)
SQL ✔ ✔ https://docs.microsoft.com/en-
us/serviceshub/health/gettingstartedsql#prerequisites
✔
SharePoint ✔ ✔ ✔ https://docs.microsoft.com/en-
us/serviceshub/health/gettingstartedsharepoint#prerequisites
SCOM ✔ https://docs.microsoft.com/en-
us/serviceshub/health/gettingstartedscom#prerequisites
✔ ✔
Complete the assessment setup by following the “Getting Started” documentation for the assessments being configured,
then return to this documentation for post setup details below.
This page contains prerequisites documents for the various Assessment solutions running on Azure Log
Analytics and Microsoft Services Hub. These documents will help you prepare your environment to setup and
configure the Assessment solution.
Active Directory
Microsoft Azure
Exchange Server
SQL Server
Windows Client
SharePoint Server
Assessment recommendations may be reviewed once an assessment scheduled task has run and its
recommendations and supporting details ingested into Azure Log Analytics – Workbooks.
Complete the steps in this section to navigate and work with assessment recommendations
Go to data collection machine On-Demand assessment working directory (e.g. c:\ActiveDirectory for the
configured assessment(s) and click on the assessment folder (example: ADAssessment).
After the conclusion of the assessment execution, several files should be observed. For example:
new.prerequisites.37508ed7ad62-485f-9f22-d5d6fae783fd.assessmentadrecs new.processingmodel.37508ed7-ad62485f-
9f22d5d6fae783fd.ad.assessmentpm new.rawdata.37508ed7-ad62-485f-9f22-d5d6fae783fd.assessmentadrawdata
new.recommendations.37508ed7-ad62-485f-9f22-d5d6fae783fd.assessmentadrecs new.trace.37508ed7-ad62-485f-
9f22d5d6fae783fd.adassessment.assessmenttrace
After several minutes, the Azure DCR will begin ingesting these files into Azure Log Analytics.
After 3 to 4 hours, check if you can view the results from the Azure portal.
Once you've linked your Services Hub to an Azure Log Analytics workspace and configured an assessment you
can access and view your assessment information from the Services Hub. To view your personalized assessment
page, select IT Health from the primary navigation, and then click On-Demand Assessments. Here you'll find all
your configured assessments with top-level data pulled from Azure Log Analytics.
Note: Only users that have access to Azure Log Analytics will be able to see the assessment data as we are following the security
rules in place for Azure Log Analytics. For access, please contact the Azure owner in your organization.
3. Select the type of Program you wish to create and click Next
d. Target Date: Select a future Date by which you want to finish the remediation execution and click
Save
6. Once the recommendations are added, these will have all the issues from Azure portal with respect to
the
Focus areas.
7. Synchronize Recommendations is an important feature that allows you to sync the latest set of data
collection. This will highlight all resolved issues and any new issues found on your environment.
9. Now you have a few options that you can use when browsing a specific task. A common practice for
complex tasks is to clone it, edit the owner and assign two different stakeholders to complete it.