*Check "Explanations" and “Definitions” sections for more information. Note that 100% performance level does NOT mean a system is fully ethical. It means only that the minimal set of guidelines that are applicable to your AI system’s decision classification is fully met.
We are currently working on a way of providing a full and automated results download service for this self-assessment tool. This will be available very soon. If you require your detailed results immediately, please use the ‘contact us’ section below.
Your applicable ethical performance level measures the general ethics level of the system. A score higher than 70% is considered to be a decent level. Fifty to 70% is moderate, though improvements are encouraged. A score lower than 50% means more mitigations should be taken before the project is taken forward. Scores can be improved by meeting more guideline requirements, especially those with a higher recommendation level.
Performance alerts show any important gaps that merit attention. They indicate whether measures were taken to deal with guidelines (1) applicable to this type of decisions, and (2) to which a high level of recommendation is attached. The numbers shown in the red boxes (ex. 1.1.2, 1.2.4) are the guidelines that are important to pay attention to and for which no measures were taken. More mitigations to the given guidelines (see AI Ethics Guidelines document) should be made before the project is brought forward.
For more definitions and more information on guidelines please download our Dubai AI Ethics guidelines from smartdubai.ae/initiatives/ai-principles-ethics/
Recommendation levels correspond to whether the guidelines are phrased as "should" (high recommendation level) or "should consider" (moderate recommendation level);
Applicability indicates if this guideline is applicable to the specified type of decision (non-significant, significant, or critical);
Performance points are measurements of performance against a single guideline:
Self assessed performance is “Full”, then performance point = 1;
Self assessed performance is “Partial”, then performance point = 0.7;
Self assessed performance is ”None” or “Not applicable”, then performance point = 0;
Applicable performance score is calculated for each of the applicable guidelines, as Recommendation level*Performance point
Note: This means that highly recommended guidelines are given higher weight in score calculation.
Applicable ethical performance level is then calculated as a standardised percentage score for all applicable guidelines, "Total required score/Full required score". Therefore, a required performance level of 100% does NOT mean a system is fully ethical. It means that this minimal set of guidelines is fully met.