Inspect the reward curve, then replay the policy learned by the model.
View results Foundations & classical RLTurn the ideas in the book into an experiment of your own.
Choose a Notebook and open it in ModelScope or Colab.
Inspect the reward curve, then replay the policy learned by the model.
View results Foundations & classical RLChoose an environment and compare its observations, actions, and training feedback.
View results Foundations & classical RLCompare random, greedy, epsilon-greedy and UCB under fixed and changing reward probabilities.
View results Foundations & classical RLCompare known-model value iteration and interaction-based Q-learning on the same map.
View results Foundations & classical RLTrain DQN and Double DQN with the same budget and separate evaluation seeds.
View results Deep reinforcement learningEnumerate gradient variance, then train policies with and without a learned state baseline.
View results Deep reinforcement learningTrain continuous-torque A2C and save both the policy and normalization statistics.
View results Deep reinforcement learningCompile the update function, then inspect training and policy replays.
View results Deep reinforcement learningTrain in a small shooting scenario and replay the current policy.
View results Deep reinforcement learningUse frame stacking and a CNN to learn actions from game images.
View results Deep reinforcement learningTrain a visual PPO policy inside the Minecraft simulator.
View results Deep reinforcement learningStart with a small maze and observe exploration under sparse rewards.
View results Advanced reinforcement learningTrain a shared policy in cooperative and competitive settings.
View results Advanced reinforcement learningStart with tic-tac-toe and small poker games to observe interacting policies.
View results Advanced reinforcement learningTrain only on fixed data and compare naive Q maximization, conservative penalties and behavior constraints.
View results Advanced reinforcement learningTrain a tiny autoregressive GRU on CPU, then update its parameters using paired preferences.
View results Language model alignmentCheck a strict answer verifier and inspect token-level clipping, KL and padding gradients.
View results Language model alignmentTrain a tiny autoregressive policy in a restricted tool language, then render calls as JSON.
View results Language model alignmentContinue decisions after tool responses and inspect credit from terminal rewards.
View results Agentic RLSelect a trusted patch, execute Python tests and check separate test inputs.
View results Agentic RLUse SQL and a calculator over synthetic company data in a multi-turn workflow.
View results Agentic RLLearn candidate query/evidence selection over a fixed teaching corpus; score answers and citations separately.
View results Agentic RLLearn point-mass dynamics, measure open-loop drift and plan in the actual environment.
View results World models & embodimentTrain a policy in a robot manipulation task and replay its actions.
View results World models & embodimentNavigate an interactive room by choosing actions from visual observations.
World models & embodimentEvery experiment links to its companion chapter. Read the method, then inspect the training curves and policy replays.
Open a Notebook to run it, or view saved curves and policy replays from its result page.