AI Boss Courses / Course 03

AI at Work: Safe, Secure, Effective

Courses 01 and 02 taught you how the machines work. This one teaches you how to run them inside a real organization, where the data is confidential, the attackers are creative, and the budget has your name on it. People first, problem second, AI last: the manifesto, operationalized.

View Curriculum
6Modules
~3 hrsSelf-paced
6Labs & games
20 QsFinal exam
FreeNamed certificate

Outcomes

What You Will Be Able to Do

The Evidence

What the Numbers Say

74%

of companies report struggling to achieve and scale measurable value from AI. Adoption is easy; value is a leadership problem.

BCG, "Where's the Value in AI?" (2024)
$4.9M

average cost of a data breach in 2024. A careless paste into the wrong tool is a data transfer like any other.

IBM, Cost of a Data Breach Report 2024
#1

Prompt injection holds the top spot on the OWASP list of security risks for LLM applications. Every AI system that reads external content inherits it.

OWASP Top 10 for LLM Applications
+14%

productivity from one well-chosen deployment (support agents with an AI assistant), concentrated among newer staff. Chosen well, the gains are real.

Brynjolfsson, Li & Raymond, NBER 31161 (2023)

Curriculum

The Six Modules

Each module opens as its own page: the lecture, its labs and games, and next and previous controls. Your progress is saved on this device, so you can leave and pick back up any time.

0 of 6 modules complete
1 The Method: People First, Problem Second, AI Last Why most AI initiatives stall, and the ordering that fixes it

Most organizations run the sequence backwards. They buy the tool, announce the initiative, then wander the building looking for a problem worthy of the invoice. BCG's 2024 study of over a thousand companies found 74% struggling to get scaled value from AI, and the blockers were rarely technical: they were people, process, and unclear problems.

The AI Boss method inverts the sequence:

  1. People first. Who does the work today? What do they hate about it? What would they do with the freed hours? Adoption lives or dies here, before any tool is chosen.
  2. Problem second. Define one specific, measurable problem. "Reply time to customer emails averages 9 hours" is a problem. "We need an AI strategy" is a slogan wearing a problem's clothes.
  3. AI last. Only now ask whether AI is the right tool, and be genuinely willing to hear "no, a spreadsheet fixes this".
The frontier is jagged, and that is the whole game. In the Harvard/BCG field experiment with 758 consultants, AI use on suitable tasks produced 25% faster work at 40% higher quality. On a task deliberately chosen to sit outside the model's competence, consultants using AI were 19 percentage points more likely to deliver a wrong answer. Same people, same tool, opposite outcomes. Task selection is not an implementation detail; it is the strategy. Dell'Acqua et al., "Navigating the Jagged Technological Frontier" (2023)
Augmentation vs automation: automation replaces the human step entirely; augmentation gives the human a power tool and keeps them in charge. Most durable early wins are augmentation, because the human absorbs the error rate.
Stop and think Name one process in your own organization where you can state the problem as a number ("X takes Y hours", "Z% error rate"). If you cannot name one, what measurement would you need to start collecting this week?
2 Task Triage: Delegate, Collaborate, or Keep The four-question filter • Task triage game

Every task that crosses your desk can be sorted with four questions:

  1. Stakes: if the output is wrong, what breaks? A draft breaks nothing; a wire transfer breaks everything.
  2. Verifiability: can a human check the output faster than doing the work? Summaries: yes. A thousand-row calculation: no.
  3. Data sensitivity: what would the AI need to see, and is it allowed to see it in the tool you have?
  4. Frontier position: is this a language-and-pattern task (inside the frontier) or does it need exact arithmetic, real-time facts, or accountability (outside)?

The answers map to three buckets. Delegate: low stakes, easy to verify, AI drafts and a human skims. Collaborate: meaningful stakes but verifiable, AI accelerates and a human owns every output. Keep human: high stakes, hard to verify, or ethically loaded. The bucket is a property of the task, not of how impressive the technology feels this quarter.

Game 1

Task Triage

Eight tasks from a real week. Sort each into Delegate, Collaborate, or Keep Human. Reasonable people can argue edges; the scoring follows the four-question filter.

Stop and think Which bucket holds most of YOUR week? If "collaborate" is nearly empty, you are probably either over-trusting the tool or not using it at all. Both are losses.
3 The Honest Business Case Value, adoption, and the verification tax • ROI calculator lab

The research numbers are real: 40% faster writing tasks (Noy & Zhang, Science 2023), 14% more tickets resolved per hour (Brynjolfsson et al., 2023), 55.8% faster coding (Peng et al., 2023). But those are gains on suitable tasks, for people who actually use the tool, after someone checks the output. An honest business case multiplies by all three discounts before it promises anything.

The verification tax: the time humans spend reviewing and correcting AI output. Treat it as the price of the safety you learned in Courses 01 and 02, never as overhead to trim away. Budget it, or your "savings" quietly become unreviewed risk.

Interactive Lab 1

The Honest ROI Calculator

Model a team. Move the sliders and watch what actually drives value. Try this experiment: max out the time savings, then drop adoption to 20%. Now fix adoption at 80% with modest savings. Which lever mattered more?

Net hours freed per week: ?

Net value per year: ?

Freed hours only become value if they are redirected to work that matters. That redirection is a management decision, not a software feature.

What the calculator teaches

  • Adoption is the master lever. Doubling adoption beats doubling the per-task savings in almost every configuration. Training and champions are not soft extras; they are the ROI.
  • Measure a baseline first. No before-number, no credible after-number. Pick one metric per pilot (reply time, tickets per hour, drafts per week).
  • Report net of the tax. Leaders trust numbers that include their own costs.
4 Guarding the Data Classification before conversation • Data classification game

Security teams found that a meaningful slice of what employees paste into public AI tools is confidential: source code, client records, strategy documents (Cyberhaven measured roughly 11% of pasted content as sensitive back in 2023, when the tools were new). Samsung learned it publicly. A ban makes this worse: bans create shadow AI, where staff use personal accounts silently and your visibility drops to zero. The fix is classification plus an approved path.

The four-level ladder

  • Public: already published or intended to be. Any tool.
  • Internal: non-public but low harm (process docs, drafts without secrets). Approved business-tier tools.
  • Confidential: customer data, financials, contracts, code. Only enterprise deployments with no-training guarantees, and only when needed.
  • Restricted: credentials, health data, legal privilege, material non-public information. No general AI tool, full stop, absent a specific approved system.

Game 2

Classify Before You Paste

Eight items from a normal workday. Assign each a classification level. Get 7 of 8 and you outperform most real-world compliance audits.

Voxel Game

Vault Sort: Speed Round

Same ladder, more speed. A data cube rolls up to the gate; send it to the right vault. Eight cubes, no explanations until the end. Trust the reflex you just built.

Leader moves that actually work

  1. Give people a sanctioned tool that is as good as the ones you are worried about. Water flows around dams.
  2. Publish the ladder above with examples from YOUR business, not generic ones.
  3. Make the safe path the easy path: single sign-on, pinned templates, one-line rule of thumb ("if you would not email it to an outside vendor, do not paste it").
  4. Treat incidents as process failures to fix, not employees to shame, or people will stop reporting them.
5 The Adversary: Prompt Injection and Synthetic Social Engineering Attacks that target the model and the human • Find-the-injection puzzle

An LLM cannot fundamentally distinguish "instructions from my boss" from "instructions that arrived inside the content I was asked to read". That is prompt injection, and OWASP ranks it the number one security risk for LLM applications. The moment your AI reads emails, resumes, webpages, or documents from outside, every one of those documents is a potential attacker with a microphone.

The realistic defenses are architectural, and they are your questions to ask any vendor: least privilege (the AI can read the inbox, why can it also send wire transfers?), human approval gates on consequential actions, separation of untrusted content from instructions, and logging. Perfect injection-proofing does not exist today; containment does.

Game 3

Find the Injection

Your company's AI assistant reads incoming documents and drafts responses. Each round shows a document it is about to process. Click the line that is an injection attack before the assistant obeys it.

Synthetic social engineering: deepfaked voices and video used to impersonate executives and vendors. The Arup case (about US$25 million, 2024) used a fully deepfaked video meeting. Defense is procedural: payments and credential changes require verification through a separate channel that the requester does not control, with no exceptions for urgency. Urgency IS the attack.
Stop and think Your AI email assistant can read mail and send replies. An attacker emails it an injection. What is the worst action it could take with those two permissions? Now answer the same question if it also had access to the shared drive. This is why least privilege is question one.
6 Rollout: From Pilot to Policy Making it stick without making it scary • Rollout decisions game

The pilot playbook

  1. One team, one problem, one metric, four to six weeks. Not "everyone gets licenses and we will see".
  2. Pick a problem from Module 1's filter: measurable, inside the frontier, data-safe.
  3. Baseline before, measure after, net of the verification tax.
  4. Recruit champions, not police. The Brynjolfsson study's insight cuts here too: AI spreads best when it carries the best performers' patterns to everyone else. Your champions are the people whose prompts and workflows get copied.
  5. Ship the story. A pilot that worked, told with real numbers by the team that ran it, recruits the next three teams better than any mandate.

The one-page policy that gets read

  • Approved tools and who to ask for new ones.
  • The data ladder from Module 4, with five examples from your own business.
  • Verification rules: what must be human-checked before it leaves the building (claims, code, numbers, anything customer-facing).
  • Disclosure norms: when to say AI helped (customer-facing content, hiring decisions, anything regulated).
  • Payment/credential protocol: the out-of-band verification rule, in writing, signed by the CEO who promises to never be offended by being verified.
  • Accountability: the human who ships it owns it. "The AI did it" is not a sentence that exists in your company.

Game 4

The Rollout Gauntlet

Four leadership moments from a real rollout. Pick the stronger move. Your team's trust is the score.

Stop and think You now hold the whole method: people, problem, AI; triage; honest numbers; the data ladder; the adversary; the rollout. Which single module, applied next Monday, would create the most value in your organization? That is your homework, and nobody grades it but reality.

Demystified

Glossary: Every Term, Plain Words

Augmentation
AI as a power tool with a human in charge. The human absorbs the error rate.
Automation
AI replacing a human step entirely. Demands low stakes or strong guardrails.
Jagged frontier
The uneven boundary of AI competence: brilliant on one task, misleading on its neighbor. Task selection is navigating this line.
Verification tax
Human time spent checking AI output. The price of safety; budget it in every business case.
Shadow AI
Unsanctioned AI use through personal accounts, usually created by bans without alternatives.
Data classification
Sorting information by harm-if-leaked (public, internal, confidential, restricted) before deciding where it may go.
PII
Personally identifiable information: anything that identifies a real person. Heavily protected by law in most jurisdictions.
Prompt injection
Malicious instructions hidden in content an AI reads, hijacking it away from its operator's intent.
Least privilege
Granting a system only the permissions its job requires. The first question to ask about any AI agent.
Human in the loop
A required human approval between AI output and consequential action.
Out-of-band verification
Confirming a request through a second channel the requester does not control. The deepfake killer.
Pilot
A scoped experiment: one team, one problem, one metric, a few weeks, then a decision.

Final Exam

Prove It: 20 Questions

Twenty multiple choice questions covering all six modules. You need 80% (16 of 20) to earn the certificate. Explanations follow every question, and retakes are unlimited.

Ready? Most people take 15 minutes. Your certificate will carry the name you enrolled with.