👥 General public, civil society, local tech service providers, journalists, local entrepreneurial ecosystem.

🔗🛠 Global Digital Health Index and Maturity Model - A platform for countries to document, benchmark, and track their maturity in adopting digital health across a series of defined metrics. It includes an interactive digital resource to assess, monitor, and improve the environment for effective use of digital health technology, to strengthen health systems and improve health outcomes. The tool also provides a maturity model with five levels to set a baseline, generate a scorecard and a benchmark against global averages, and learn from other countries to inform and target investments in digital health at the country, regional, and global levels.

📚Government AI Readiness Index 2021 - Yearly index ranking countries based on 42 indicators across three pillars: Government; Technology Sector; and Data and Infrastructure. The index answers the following question: how ready is a given government to implement AI in the delivery of public services to their citizens?

📚🛠Framework of Multi-layered Innovation Ecosystem Mapping (MIEM) - Framework to explore and identify both knowledge and business ecosystems.

🛠 Open Data Ethnography - TThis tool is designed to build understanding of in-depth and context-specific experiences of individuals in seeking, accessing and using information. This granular understanding is important for designing relevant interventions that speak to user needs (community or individual) and their social and cultural context.

❌ Tools to assess human capacities (e.g. digital literacy of the local population and stakeholders that will adopt such technology:

• See step 1, Decision 3 (stakeholder mapping)

👥 Legal experts, in-country government ministries, people in the community who might not use / benefit directly from the product but may be indirectly impacted.

🔗📚OECD AI Policy Observatory - Live repository of over 700 AI policy initiatives from 60 countries, territories and the EU. This information can be accessed by policy instrument (such as a national strategy, a regulation or a grant), or by group targeted by the policy (such as SMEs). A list of stakeholder initiatives is also provided.

🛠 Algorithmic Impact Assessment Tool - A questionnaire that determines the impact level of an automated decision-system. It is composed of 48 risk and 33 mitigation questions. Assessment scores are based on many factors including systems design, algorithm, decision type, impact and data.

🛠 Practical Framework for Public Agency Accountability - The Algorithmic Impact Assessment (AIA) framework proposed in this report is designed to support affected communities and stakeholders as they seek to assess claims made about these systems, and to determine where – or if – their use is acceptable.

❌ AI/ML inclusive risk assessments to help communities understand their levels of risk exposure when providing their data; tools to assess the political, social, and economic implications of adopting an AI/ML solution; tools to evaluate specific risks (e.g., disparate impact on protected groups, arbitrary results, mischaracterizations, privacy harms) and measures to mitigate them, assessments of funding and technical expertise required to maintain and update solutions over time.

👥 Ecosystem actors, local government, local entrepreneurs and businesses, local and international software developers.

🛠 USAID Scorecard: "Is ML Worth Trying Out as an Approach to Solving Our Problem? " (see 'Managing Machine Learning Projects' pg. 24) - guidelines and checklist to assess whether ML is a suitable solution to a given problem.

🛠 Nethope and USAID: AI Suitability Toolkit - tool to increase NGOs' internal expertise and capacity to evaluate, develop, procure, and use AI /ML in their work to ensure that people in need are aware of the technologies that affect them and their communities. The toolkit includes materials on AI / ML capabilities and on how to evaluate suitability of AI/ML for programs and projects.

🔗 ML Hub - open source platform making artificial intelligence (AI), machine learning (ML), and data science accessible to everyone

❌ Benchmark for performance of existing AI/ML programs.

👥 Civil society, local population, general public, end users.

📚 UN OHCHR guide on conducting interviews

📚WHO focus group on “AI for Health” - Case study of focus group conducted by ITU/WHO to establish a standardised assessment framework for the evaluation ​of AI-based methods for health, diagnosis, triage or treatment decisions.

🛠 Designing for Motivation, Engagement and Wellbeing in Digital Experience - Framework grounded in psychological research designed to enable researchers and practitioners to form actionable insights with respect to how technology designs support or undermine basic psychological needs.

❌ Linguistic and epistemological translation tools to understand both local languages, values, and technical systems.