Doug Ware

Anthropic's 3.5 Sonnet's "Computer Use" feature is pretty interesting. It can now interact directly with a computer's desktop environment, replacing much of what traditional RPA used to handle. Imagine AI not just running scripts but manipulating your desktop like a human would—that’s where things are heading. It’s a big leap for automation, and I’m excited to see how this changes the landscape. https://lnkd.in/dYw8Tify. The "computer use" naming is meh, but despite the naming convention, the use case possibilities are endless.

7

We are just hours away from Dynamics User Group (DUG) NW Florida Meetup hosted by Brittany Burke! I'm super excited to be presenting at this VIRTUAL event tonight on tips and tricks for using Copilot for Power Automate! Will I see you there?? 👀 Registration 🔗- https://lnkd.in/dtS2iZ4v #communityrocks #powerplatform #powerautomate #copilot #powerplatformpartner #microsoftpowerplatform #microsoftcopilot

41

🚀 Exciting News! Azure AI now features over 1,550 Hugging Face models, marking a significant milestone! 🎉 With these models, you can deploy on MaaP (Model as a Platform), which means you simply need to bring your own GPU-enabled VM. Azure handles the provisioning, so no extensive GPU infrastructure knowledge is required. Just select the VM size and apply for the necessary quota. You have many options for deployment: - Use AI Studio to deploy online endpoints manually. - Use Terraform or Azure Developer CLI for infrastructure as code - A CLI first approach with the Azure ML CLI - A code-first approach with the Azure ML Python SDK to deploy your endpoints with application logic Happy deploying! #AzureAI #HuggingFace #MachineLearning #AI #CloudComputing #PythonSDK #AIStudio

10

1 Comment

When did you last reconcider your decission of #ERP software? I’ve recently been in contact with some lost cases and it is shocking to see projects beeing pushed through over budget when even they realized the decission was poor. One customer picking a major ERP competitor has even gone live, but understood that #Dynamics365 was the way they should have gone, and are starting a new project just 1 or 2 years into production. Don’t get fooled into spending too much effort into a bad decission. Be open for reevaluation!

9

Catch up on what you might have missed with Copilot for Microsoft 365 updates May 2024 blog from Seth Patton! https://lnkd.in/g2xgF6Uk Some of my favorites from May and links to deep dive explainers and how-to's: - AI Hub in Microsoft Purview (Mechanics deep dive: https://lnkd.in/gCygn3BQ) - Restricted SharePoint Search (Mechanics deep dive: https://lnkd.in/gCygn3BQ) - Microsoft Copilot extensions (Mechanics deep dive: https://lnkd.in/g_z_eZMQ)

10

1 Comment

If you love technology as much as I do, you’d be amazed at what’s unfolding here at #MSIgnite. Satya Nadella shared updates set to redefine the way you and I work. Here's the lineup: ↗️ Copilot - Pages, Actions, Analytics & Devices ↗️ M365 Agents (Meeting Facilitator, Project Manager, Self-Agent, SharePoint Agent, Field Service Agent), M365 Link ↗️ Azure Local, AI Foundry & Sales Agents ↗️ Fabric Databases And that's just scratching the surface - be it automation, AI-led analytics or quantum computing, the future of work is here. Excited to see how these innovations evolve! Are you at #MSIgnite too? Let’s connect and share insights! #Microsoft #MicrosoftFabric #Copilot #Azure #AzureSQL #Database #AI #QuantamComputing #Automation #innovation #technology

515

13 Comments

Given #Microsoft's focus on security, I can't be the first to see this retro opportunity to have some fun - perhaps there's an unofficial theme song to be had here (but you'd need to rewrite some of the lyrics - secret agent person?) - seriously though - AWESOME progress! Copilot Agents are cooler than secret agents. https://lnkd.in/ecnSfk8T #MicrosoftCopilot #MicrosoftCopilotAgent

1

Not used #AzureAIStudio before?? Take 10 mins to watch this video then go get access - you’ll have your own copilot built before you know it! #copilot #genai #azure #azureai

17

New Video! INTERVAL data types are cool in the Oracle Database...until you want to aggregate them over a set of rows.  That restriction has been lifted in 23ai plus a number of other DATE / TIMESTAMP enhancements have also been added! #database #sql https://lnkd.in/g3vPkQqF

37

So you belong to an organization with a Microsoft365 account, and after applying the October update - Copilot is no longer an option on the Windows menu, and when you access copilot in edge you get this message: "Web search is off for your organization. Copilot responses won't include the latest data from the web." So what to do if you want to continue to use CoPilot: * Option 1 - what they WANT you to do - sign up for a CoPilot license. You have to have one for EACH INDIVIDUAL that wants to use CoPilot in your organization. The good news is that once you do this your admin can control how CoPilot is used and what information is available to it. In general, if desired, the Admin can allow CoPilot to see anything you can see (documents, email, etc) and act on that, AND this also enables CoPilot within your apps. This can be really handy, and eventually may allow all sorts of additional features as MS adds them. The first time that a CoPilot user is added to a tenant, it scans the whole tenant, applies permission information to that tenant, then determines each user's available information based on those permissions. The bad news is this option costs more than your office license probably costs: $30/month/user. * Option 2 - in the Edge browser create a new PROFILE that does NOT login to your corporate account, if your admin allows this (this is controllable via inTune restrictions). Tie this login to a Microsoft Live account (outlook.com, hotmail.com etc). This will allow you to use CoPilot (for now anyway) without additional charge (not guarantee this won't change in the future). It will not add local or MS Live content to the copilot database so results won't show up there, nor will it show up in your apps. It does share the content of your questions and queries with Microsoft, attached to your live account, and may have semi-anonymized data shared with advertisers. * Option 3 - Use a different browser if you don't want to be signed in at all, use a browser like Chrome and access copilot thorugh https://lnkd.in/gS6M5zQa - your discussion lengths and reply detail may be limited. * Option 4 - Use a different LLM - there are dozens out there, though most insist on you eventually creating an account on them. In all cases choose carefully as you are probably going to be sharing at least your queries with the platform. The best privacy is probably through the paid corporate account. Why? Well those results will only be stored within your tenant - not outside it for corporate privacy reasons. Though that does mean sharing your search history with your employer if you're not the employer themselves - it still means that queries are not shared with the general public platforms.

1

6 Comments

So you've built a great new prompt in AI Builder....now what? Check out this video from Daniel Laskewitz to see how to share and distribute your AI prompts so everyone in your organization can use the prompt in their Power Apps and Power Automate flows.  #AIinAction #PowerPlatform #Prompts https://lnkd.in/gnRsX87b

48

A little bit later after Power BI full alm scenarios are now available on the Power Platform

1

Article #2 was inspired by the anxiety I endured while trying to join #Config2024 live conference and how to improve the user experience by designing for cognitive disabilities. I’m excited for day 2 of Config, so far I’m most eager to test out Figma’s ai capability to rename layers. #AccessibilityDesign #CognitiveDisabilities #UXDesign #Neurodiversity #Sca11ywag #Figma #DesignForAll

14

2 Comments

Ryan, thanks for your post. It's great to see the numbers, but even more the issues around security with basic Power Platform Licensing. Most organizations would be shocked to discover the amount of confidential and PIx stored in their organizations insecure locations. Using basic/free licensing without extensive lockdowns, governance and continued oversight brings considerable risk to their organization, employees and customers. We would be happy to help with your Power Platform journey.

4

#HoustonFabricUserGroup Find out how to control #MicrosoftFabric capacities with #LogicApps or #PowerAutomate. Signup 👉🏽 https://lnkd.in/g7-knfVs WHAT TO EXPECT Comprehensive Walkthrough: The session will delve into the capabilities of Logic Apps in managing Microsoft Fabric capacities. We’ll explore scenarios such as scheduled scaling for peak periods, on-demand scaling for specific workloads, and automating routine operations during office hours.

25

Do you always draw the short straw and end up with the job of writing meeting summaries? Good news — you've got help. Watch this video to see how Copilot in Microsoft Teams can put together a meeting summary in less than a minute. DM us for more details.

2

This is an interesting Microsoft DevBlogs article as it details the prompts that Microsoft engineers were using for their research into #multimodal #RAG Their experimentation tailored the prompts to ensure the LLM focused on the relevant information each image contained. Example Prompt: "You are an assistant whose job is to provide the explanation of images which is going to be used to retrieve the images. Follow the below instructions: If the image contains any bubble tip then explain ONLY the bubble tip. If the image is an equipment diagram then explain all of the equipment and their connections in detail. If the image contains a table, try to extract the information in a structured way. If the image is a device or product, try to describe that device with all the details related to shape and text on the device. If the image contains a screenshot, try to explain the highlighted steps. Ignore the exact text in the image if it is just an example for the steps and focus on the steps. Otherwise, explain comprehensively the most important items with all the details on the image." There are other prompt examples and a lot of detail in what the research team learned about multimodal RAG in the (comprehensive) DevBlogs article including: 👉 Including document metadata improved source recall performance. 👉 Storing image descriptions as separate chunks rather than inline improved retrieval metrics. 👉 Using a classifier to filter out less informative images (such as logos) reduced ingestion time without compromising retrieval accuracy. 👉 Including surrounding text context for image descriptions improved quality but had limited impact on retrieval metrics. 👉 Enrichment during ingestion outperformed inference-time multimodal processing for image understanding. 👉 GPT-4 outperformed GPT-3.5 for inference, with better image citations and correctness scores. 👉 GPT-4o showed improvements over GPT-4 in citation recall, correctness, latency and cost for inference. 👉 GPT-4v remained superior to GPT-4o for image description generation during enrichment. The Dev Team engineers emphasize the need for a solid experimental foundation, including a robust ground truth dataset and configurable framework, to systematically improve retrieval and generation performance. The findings also highlight the tradeoffs between different model choices and processing approaches. It's particularly interesting to see how different models excel at different tasks (e.g. GPT-4v for image description vs GPT-4o for inference). For enterprises working on similar systems, this post is a helpful guide when conducting their own experiments and optimizations. #entepriseai https://lnkd.in/ey-23PhC

4

Attention IT Leadership: Azure is getting more secure by retiring TLS 1.0 and 1.1. Matt Hansen has all the details here.

11