Scoring and Analyzing Assessments in TITAN AI

Hello. In this video, we are gonna be going over how to score and analyze a questionnaire or assessment inside of the Titan platform. As you can see, we have a vendor directory which can house high level information and detailed information about your vendor ecosystem. If we were to navigate the templates, a template is the centralized location where the scoring and analysis takes place. It is also where you set that criteria. If I were to click in to an assessment that is currently active or a template that is currently active and hit edit, I will have the ability to enable risk scoring, which can help me identify which responses are pass or fail that have multiple select options. You can have multiple different risk matrix with different scoring and waiting for pass and fail responses to ensure the risk level is appropriately determined based on the vendor’s responses. We also have the ability to enable LLM evaluations. These evaluations can be split between policy check or evidence check and ultimately can help measure the vendor’s answer against your policy requirement or can confirm the vendor’s answer is actually supported by the uploaded evidence within their profile or alongside of the assessment. The key benefit is that we can set this risk determination at the template level to ensure that once an assessment is completed and responded to by your supplier, you do not need to spend time and effort manually reviewing and coming to a risk conclusion. So, ultimately, I can then have a questionnaire health score and a risk score implemented alongside an assessment. If I were to click in to an assessment that has been completed, I have the ability to view the assessment, review the answers, see which answers have passed or failed, and run the analysis to get that health score. As you can see by the criteria I’ve set at the template level, 36 of these answers have passed, two have failed, four are partial, and four have empty responses. I can then, of course, drill into each section, better understand why an answer failed, why something passed or had a partial response. In addition, the analysis and questionnaire scoring that we can provide within the Titan platform, there’s a couple other key pieces that tie all of this together. Ultimate be… Ultimately being, if I were to kick off a new assessment to a supplier like I am doing now, where I’ve selected my vendor, selected the template, selected a due date, and and hit save. Ultimately, I now have the questionnaire in front of me to send to the supplier. If you do have documentation that you already have collected from the supplier or know that the supplier may not engage in terms of a response time as swiftly as you would like, and once again, you have that questionnaire documentation, you can actually leverage documents from within the vendor profile that you have collected to prefill the questionnaire process. The key piece here is this can also be tied to our automated workflows to ultimately send an assessment when needed, collect evidence, collect information, and run the analysis after the prefill is completed. I won’t stay here for the duration of the prefill. As you can see, it is moving quite quite swiftly. I have this actually completed in another view. But, ultimately, once it is completed and the vendors responded, it’ll be toggled as needs review, which will lead into my next section, which is the remediation aspect or review of this d in terms of questionnaire health where there may be items and issues that have been flagged or do not align with our policies or controls that we may need to address with this potential supplier.