Econometrics bridge: Estimator, model selection, simulation
Estimated time: 60 min
Lab: Open browser lab
Code: Python · R

Why this should feel familiar

Modern AI is not a separate mathematical universe. Most of the course can be understood as familiar statistical estimation plus three extensions: representations can be learned, models can be deeply composed, and decisions can affect future data.

Mathematical core

Start from empirical risk minimization:

\[ \hat\theta=\arg\min_\theta \frac1n\sum_{i=1}^n L(y_i,f_\theta(x_i)). \]

OLS uses squared loss and a linear f. Logit uses Bernoulli likelihood with a logistic link. A neural network keeps the same outer estimation pattern while making \(f_\theta\) a composition of many learned transformations.

A second recurring object is a conditional distribution, \(p(y \mid x)\). Language models estimate \(p(token_t \mid \text{previous context})\); policies estimate \(\pi(\text{action} \mid \text{state})\); mixture-of-experts gates estimate weights over experts conditional on the current input.

Plain-English translation

The goal of this module is to stop translating “AI” as “mysterious new mathematics.” Translate it instead into probability models, optimization, dynamic systems, and learned representations.

What changes when we move from econometrics to AI?

The recurring shift is from a small, analyst-specified representation toward a larger learned representation. The underlying statistical questions do not disappear: What is the sample? What is conditioned on? What is estimated? What objective is optimized? Which observations were used to choose hyperparameters? How will uncertainty and distribution shift be handled?

AI terminology becomes much easier when these questions are kept explicit. Whenever you encounter a new architecture, identify four objects: inputs, parameterized transformation, training objective, and evaluation design.

Interactive browser lab

Use the concept-map lab. Select a familiar econometrics concept and inspect the AI concepts connected to it.

Before changing a control, predict the direction of the effect. Then manipulate one control at a time. The goal is not merely to produce a pretty visualization; it is to connect a parameter change to a mathematical statement.

Python and R lab

The Python and R examples implement the same core object as the browser lab. The Python code intentionally favors NumPy and explicit matrix operations. The R code favors base R and explicit loops/matrix algebra. Once the mechanics are clear, the same ideas can be implemented with PyTorch, TensorFlow, JAX, torch for R, or other frameworks.

Check your understanding

  1. Identify the random variables, observed variables, and estimated parameters in this module.
  2. State the objective function or equilibrium condition.
  3. Name the closest concept you already knew from econometrics and one important difference.
  4. Predict one failure mode caused by poor data, poor optimization, or poor evaluation.

Learner output

Write a one-page map containing five familiar concepts and their AI counterparts.