We covered how to train and publish the object detection AI model in another blog. This blog will go through how to use the AI model in a real-world situation.
- We’ll submit the input from SharePoint in our demonstration.
- A user must first build a list item and then upload the image to SharePoint.
- The Power automate flow will be activated next.
- The next step is to deliver the data or file content to the AI Model via Power automation.
- The result/output is returned by the Next AI model.
- Finally, Power automates the modification of the result in the SharePoint List, allowing us to double-check the data
How to use Power Automate to consume AI models step by step
1. Generate a SharePoint list with the fields listed below. These are the picture and AI objects/data elements that will be collected.
a. Soccer Ball Count – Integer
b. Confidence – Decimal
c. Analyze Complete – Boolean
2. Develop automated cloud flow
a. Go to https://make.powerapps.com to get started.
b. Choose a suitable setting.
c. Make a new solution (If not exist already)
Note: There are some limitations in the default setting.
d. Click New to create Cloud Flow
e. Source: SharePoint
f. It Triggers when an item is created or modified
g. Type in the name flow.
h. To get SharePoint Attachments, add a new action.
- Choose the same Site and list
- The id from the Trigger step should be used.
I. Add an action to access the content of a SharePoint file.
- Choose the same site.
- The ‘Id’ from the “Get attachments” step should be used as the File Identifier.
j. Add action to AI Builder
- Action: Predict
k. Choose your AI model for object detection that we trained in our previous article.
- Set the image from Step #9 as the file content.
l. Add a SharePoint action to update an item.
- Source: SharePoint
- Action: Update Item
- From the trigger, set the Id and Title.
- Update other fields
- Soccer Ball Count
- Formula: length(outputs(‘Predict’)?[‘body/responsev2/predictionOutput/results’])
- Confidence %: mul(items(‘Apply_to_each_2’)?[‘confidence’],100)
- Analyze Complete – This is to avoid recursive (infinite loop)
- Because we may gather or anticipate several objects from the same image, another “Apply to each 2” has been included.
m. Put the AI Model to the Test
- To create a list in SharePoint,
- Go to the Add List item
- Click save
3. Test Image
4. We should be able to observe the outcome in a matter of minutes at most.
5. The end result is as follows:
6. The degree of confidence is 78 percent. To boost confidence, we need to practice with more photos.