5 Essential Tools for AI and Algorithm Auditing

A summary of BABL AI’s new online AI And Algorithm Auditor certification.

BABl AI is offering an online certificate on artificial intelligence and algorithm auditing for future auditors to develop the necessary skills to identify relevant risks of using algorithmic systems, best practices for governance, and common techniques and workflows involved in modern AI/ML development. The course, taught by CEO Dr. Shea Brown, is meant to lay the foundation for further on-the-job learning opportunities under the supervision of a more experienced auditor.

The course, starting May 8th 2023, is divided into five courses that cover various aspects of AI and algorithm auditing, and includes a mini course on finding your place in AI Ethics. The program does not require any previous technical understanding, and is meant to reach a wide range of applicants. Whether you are looking to learn new skills to bring into your current role, or hoping to venture into the new field of algorithmic auditing, this program offers an exciting opportunity to learn.

The Courses:

Finding your place in AI ethics consulting

This mini-course, available now, provides an overview of the most common tasks performed in AI ethics consulting and offers practical advice for those interested in pursuing a career in this rapidly growing field. Drawing on BABL AI’s training material, the course outlines the skills needed to perform these tasks, and helps students identify which skills can be acquired through self-study and which might require further training. By the end of the course, students will be able to develop a roadmap for acquiring expertise, establish a niche, and bring value to clients and humanity in the field of AI Ethics and Governance. The Algorithmic Bias Lab conducts research and training in algorithmic auditing and the responsible production and governance of artificial intelligence.

Algorithmic Risk and Impact Assessments

This course, starting May 8th, is designed to teach a systematic approach to algorithmic risk and ethical impact assessments, which is essential for practitioners in emerging technology. It covers identifying socio-technical components of an algorithmic system that are relevant for risk analysis, producing a narrative for algorithmic transparency, engaging with stakeholders to determine their interests and potential harms, and developing assessment strategies for metrics. Although developed primarily for BABL AI employees and consultants, this course is also suitable for AI Ethics and Governance consultants, risk professionals, procurement specialists, employees at VC firms and anyone working in technology.

AI Governance and Risk Management

This online course, starting May 22nd, covers topics in AI governance, risk management, and regulations of algorithmic systems that are essential for AI auditors. The course provides an in-depth understanding of accountability, the regulatory landscape at the US Federal, State, and Local levels, the regulatory landscape in the European Union, and standards and best practices for AI risk management, including model risk management, ISO, and NIST frameworks. Additionally, the course covers transparency standards, including data documentation, model documentation, disclosure, and explanation.

Bias, Accuracy, and the Statistics of AI Testing

This online course, starting sometime after May 22nd, focuses on Bias, Accuracy, and Statistics of AI Testing, covering technical testing topics that AI auditors need to know. The course covers performance metrics for algorithmic systems, including quantitative, qualitative, sampling, and estimation techniques. It also covers the definition and types of bias and fairness, which are critical to ensuring that AI systems are free from prejudice and discrimination. The course is designed to provide AI auditors with a comprehensive understanding of how to test AI and algorithmic systems for accuracy and bias.

Algorithm Auditing and Assurance

This online course, starting sometime after May 22nd, focuses on Algorithm Auditing and Assurance, covering essential topics related to AI and algorithm audit and assurance. The course covers audit, assurance, and assessment techniques, independence requirements, audit procedures, audit evidence, audit opinions, audit risk, and documentation. It is designed to provide a comprehensive understanding of how to audit AI and algorithmic systems to ensure they meet the required standards and regulations. The course is suitable for individuals who wish to work in AI auditing or as assurance consultants, as well as for anyone interested in gaining a deeper understanding of how AI auditing works.

Algorithms, AI and Machine Learning

This online course, available now, is a technical crash course that aims to bring non-technical consultants, risk, and policy professionals up to speed on emerging technologies such as Automated Decision Systems. The course is designed to provide a sufficient understanding of modern techniques to perform risk analysis and governance. It is suitable for individuals working on the ethics and governance of AI and emerging technologies or those looking to transition into the field, as well as people who need to interface between technical teams and executives or senior management, and those lacking a deep technical background in algorithms, AI, and machine learning.

In conclusion, BABl AI’s new online certificate program covers various aspects of AI and algorithm auditing. The program is designed for future auditors to develop the necessary skills to identify relevant risks of using algorithmic systems, best practices for governance, and common techniques and workflows involved in modern AI/ML development. It is divided into five primary courses, covering topics such as AI ethics consulting, algorithmic risk assessments, AI governance and risk management, bias and accuracy in AI testing, and algorithm auditing and assurance. The courses are suitable for a wide range of applicants, including those without any previous technical understanding. The program offers an exciting opportunity for learners to gain new skills to bring into their current roles or venture into the new field of algorithmic auditing.

The full cost of the program is $2,4000, however, scholarships are available to apply for before the start date of May 8th for Economically Disadvantaged Groups of people and Historically Disadvantaged Groups of people.

--

--

Jeffery Recker
π€πˆ 𝐦𝐨𝐧𝐀𝐬.𝐒𝐨

I am the COO of BABL AI, a company that audits AI algorithms for ethical bias and legal compliance. Follow me on LinkedIn www.linkedin.com/in/jeffery-recker