AI Literacy Study Guide

A general-purpose guide to the core ideas of an introductory AI literacy course: what AI is, how it works, where it fails, and how to use it responsibly.

Start here: the 8 ideas most likely to be tested

  1. AI ⊃ Machine learning ⊃ Deep learning, which powers most generative AI and all LLMs. Know the nesting and one example of each. Review
  2. Models learn patterns from data; they are not programmed rule by rule. Training data shapes everything a model does. Review
  3. LLMs predict the next token. Fluent text is not proof of understanding or truth. Review
  4. Hallucinations: confident, plausible, false output — including fake citations. Always verify. Review
  5. Bias in → bias out. Skewed or unrepresentative data produces unfair results. Review
  6. Privacy & data: what you type into an AI tool may be stored or used; don't share sensitive information. Review
  7. Human judgment and accountability stay with people, not the tool. Review
  8. Academic integrity: follow your course's AI policy and disclose or cite AI use. Review

1. What AI is (and isn't)

Artificial intelligence (AI)

The broad field of building computer systems that perform tasks normally associated with human intelligence: recognizing images and speech, understanding language, making predictions, and making decisions.

Machine learning (ML)

A subset of AI where systems learn patterns from data instead of following hand-written rules. Example: a spam filter trained on labeled emails.

Deep learning

A subset of ML using neural networks with many layers. Powers modern image recognition, speech recognition, and language models.

Generative AI

AI that creates new content — text, images, audio, video, code — based on patterns in its training data. Examples: chatbots, image generators.

Narrow AI vs. general AI

Predictive vs. generative AI

RememberAI you already use: search ranking, streaming and shopping recommendations, social media feeds, spam filters, voice assistants, autocorrect, navigation apps, and face unlock.

2. How machines learn

The basic pipeline

  1. Data: collect examples (text, images, numbers). Quality and representativeness matter more than almost anything else.
  2. Training: an algorithm adjusts the model's internal numbers (parameters or weights) to reduce its errors on the examples.
  3. Model: the trained result — a mathematical function that maps inputs to outputs.
  4. Testing / evaluation: measure performance on data the model has not seen.
  5. Inference: using the trained model on new inputs (e.g., you asking a chatbot a question).

Three main types of machine learning

TypeHow it learnsExample
SupervisedFrom labeled examples (input + correct answer)Photos labeled "cat"/"dog"; spam vs. not spam
UnsupervisedFinds structure in unlabeled dataGrouping customers by shopping habits (clustering)
ReinforcementTrial and error with rewards and penaltiesGame-playing AI; robot control; tuning chatbot behavior

Neural networks in one paragraph

Loosely inspired by the brain, a neural network is layers of simple connected units ("neurons"). Each connection has a weight. Input flows through the layers to produce an output; during training, the weights are nudged to make outputs closer to the correct answers. Modern models have millions to hundreds of billions or more of these weights.

Common misconception"The AI was programmed to say that." Usually no one wrote that specific response — the behavior emerged from patterns in training data and the training process. This is also why AI decisions can be hard to explain (the black box problem).

Overfitting

When a model memorizes its training data instead of learning general patterns, it does well on training examples but poorly on new data. This is why models are tested on held-out data.

3. How large language models (LLMs) work

Chatbots such as ChatGPT, Claude, Gemini, and Copilot are built on LLMs.

  1. Tokens: text is split into small chunks (words or pieces of words). Models read and write tokens, not letters or ideas.
  2. Pretraining: the model reads a huge amount of text and learns to predict the next token. From this it picks up grammar, facts, styles, and patterns of reasoning — and also errors and biases in that text.
  3. Fine-tuning and human feedback: the model is further trained to follow instructions and be helpful and safe, often using human ratings of responses (reinforcement learning from human feedback, RLHF).
  4. Generating a response: the model produces one token at a time, each chosen based on probabilities given everything before it. Some randomness (temperature) means the same prompt can give different answers.
Key ideaAn LLM generates the most plausible-sounding continuation, not a checked fact. It has no built-in way to know whether what it says is true.

Terms to know

Grounding, tools, and agents

4. Limitations and risks of AI output

Hallucinations

Confident but false or made-up output: wrong facts, invented quotes, fake sources and citations, nonexistent court cases or studies.

Bias

Models reproduce stereotypes and gaps in their training data. More in Ethics.

Outdated knowledge

Without live search, a model doesn't know events after its training cutoff and may not say so.

Inconsistency

The same question can get different answers; small wording changes can change results.

Reasoning and math errors

Models can make logic, counting, and arithmetic mistakes while sounding certain.

Sycophancy

A tendency to agree with the user or tell them what they want to hear, even when the user is wrong.

Exam trapSounding confident, fluent, or detailed is not evidence that an AI answer is correct.

5. Ethics and societal impact

Bias and fairness

If training data is skewed, AI can discriminate — for example, in hiring, lending, policing, or healthcare. Facial analysis systems have been shown to be less accurate for some demographic groups, especially darker-skinned women (Gender Shades study, Buolamwini & Gebru, 2018). Fairness requires diverse data, testing across groups, and human oversight.

Privacy and data

Misinformation and deepfakes

Generative AI makes it cheap to produce realistic fake text, images, audio, and video. Deepfakes can be used for scams, impersonation, harassment, and political manipulation.

Copyright and intellectual property

Many models were trained on copyrighted work without permission, leading to lawsuits from authors, artists, and news organizations. Who owns AI-generated content is also unsettled; in the U.S., the Copyright Office has said works need human authorship to be protected.

Transparency, explainability, and accountability

Regulation and governance

Work, environment, and access

6. Using AI effectively and responsibly

Writing good prompts

Verifying AI output

  1. Check claims against reliable sources (library databases, official sites, reputable news, textbooks).
  2. Confirm every citation actually exists and says what the AI claims.
  3. Use lateral reading: open new tabs to see what other trusted sources say.
  4. Be extra careful with numbers, dates, quotes, medical, legal, and financial information.

Academic integrity

Rule of thumbUse AI as an assistant, not an authority: you make the decisions and verify the facts.

7. Key milestones

YearMilestone
1950Alan Turing proposes the "imitation game," later called the Turing test.
1956Dartmouth workshop launches AI as a field. The term "artificial intelligence" comes from its 1955 proposal (McCarthy, Minsky, Rochester, Shannon).
Mid-1970s; late 1980s–early 1990s"AI winters": periods of reduced funding after hype outpaced results.
1997IBM's Deep Blue defeats chess champion Garry Kasparov.
2012AlexNet wins the ImageNet image recognition challenge, launching the deep learning boom.
2016DeepMind's AlphaGo defeats Go champion Lee Sedol.
2017The Transformer architecture is introduced ("Attention Is All You Need").
2022OpenAI releases ChatGPT (November), bringing generative AI to the mainstream.

8. Glossary

AGI
Artificial general intelligence: hypothetical AI with human-level ability across any task.
AI agent
An AI system that uses tools and takes multi-step actions toward a goal.
Algorithm
A set of step-by-step instructions for solving a problem or doing a task.
Bias (algorithmic)
Systematic, unfair outcomes from an AI system, often caused by its data or design.
Chatbot
A program that converses with users in natural language.
Context window
The maximum amount of text a model can take into account at once.
Deep learning
Machine learning using neural networks with many layers.
Deepfake
AI-generated or altered media that realistically imitates a real person.
Fine-tuning
Additional training of a pretrained model on specific data or tasks.
Generative AI
AI that creates new content such as text, images, audio, or code.
Hallucination
Confident AI output that is false or fabricated.
Inference
Using a trained model to produce outputs from new inputs.
LLM
Large language model: a model trained on vast text to predict and generate language.
Machine learning (ML)
AI that learns patterns from data instead of following hand-written rules.
Natural language processing (NLP)
The AI field focused on understanding and generating human language.
Neural network
Layers of connected units with adjustable weights that learn from data.
Overfitting
When a model memorizes training data and performs poorly on new data.
Parameters (weights)
The internal numbers a model adjusts during training.
Prompt
The input or instructions given to an AI model.
RAG
Retrieval-augmented generation: the model looks up documents or search results and uses them in its answer.
RLHF
Reinforcement learning from human feedback: training a model using human ratings of its responses.
Supervised learning
Learning from labeled examples that include the correct answer.
Temperature
A setting controlling how random a model's word choices are; higher means more varied output.
Token
A chunk of text (word or word piece) that a language model processes.
Training cutoff
The date after which a model's training data ends.
Training data
The examples a model learns from.
Transformer
The neural network architecture behind modern LLMs, based on "attention."
Unsupervised learning
Finding patterns in data that has no labels.

9. Self-test

Answer out loud or on paper first, then open each question to check.

What is the relationship between AI, machine learning, and deep learning?

They are nested: deep learning is a type of machine learning, which is a type of AI. Most generative AI, and all LLMs, are built with deep learning.

What is the difference between supervised and unsupervised learning?

Supervised learning uses labeled examples with correct answers; unsupervised learning finds patterns in unlabeled data.

At its core, what task is an LLM trained to do?

Predict the next token in a sequence of text.

What is a hallucination, and why does it happen?

Confident output that is false or made up. It happens because LLMs generate plausible-sounding text from patterns rather than looking up verified facts.

Give two ways bias can enter an AI system.

Unrepresentative or historically biased training data; design choices such as what the model optimizes for or how labels were assigned; lack of testing across different groups.

Why might a chatbot give wrong answers about recent events?

Its knowledge stops at its training cutoff unless it is connected to live search.

Is today's AI "narrow" or "general"?

Narrow (not general). General-purpose models like LLMs handle many tasks, but AGI is hypothetical and does not currently exist.

Name three steps for checking an AI-generated answer.

Verify claims in reliable sources; confirm citations exist and say what is claimed; use lateral reading; be extra careful with numbers, quotes, and high-stakes topics.

Why shouldn't an AI detector's result be treated as proof of cheating?

Detectors are unreliable: they produce false positives, especially for non-native English writers, and can be fooled.

What should you avoid typing into a public AI tool?

Passwords, financial or health information, and other people's private or confidential data.

Who is responsible when AI-generated content in your assignment is wrong?

You are. The person who submits or acts on AI output is accountable for it.