← Lab

Explore or exploit?

CPU · Python 3.12.13 · 5.97 s · 2026-10-22 08:56:13 UTC+8

Saved run results

random.reward997.56
random.regret100.4699999999986
greedy.reward1036.92
greedy.regret60.35599999999788
epsilon.reward1081.94
epsilon.regret19.387999999999884
ucb.reward1061.82
ucb.regret37.72000000000026
{'numpy': '2.5.4', 'seeds': 50, 'steps': 2000, 'device': 'CPU'}

First 12 actions: [0, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1]
First 12 rewards: [0.0, 1.0, 0.0, 0.0, 0.0, 1.0, 1.0, 1.0, 1.0, 1.0, 1.0, 0.0]
Experiment output 
{
  "random": {
    "reward": 997.56,
    "regret": 100.4699999999986
  },
  "greedy": {
    "reward": 1036.92,
    "regret": 60.35599999999788
  },
  "epsilon": {
    "reward": 1081.94,
    "regret": 19.387999999999884
  },
  "ucb": {
    "reward": 1061.82,
    "regret": 37.72000000000026
  }
}
Experiment output 
296
Exercise is optional; set RUN_EXERCISE=True after filling answer.
metrics.json
{
  "random": {
    "reward": 997.56,
    "regret": 100.4699999999986
  },
  "greedy": {
    "reward": 1036.92,
    "regret": 60.35599999999788
  },
  "epsilon": {
    "reward": 1081.94,
    "regret": 19.387999999999884
  },
  "ucb": {
    "reward": 1061.82,
    "regret": 37.72000000000026
  }
}