← 实验室
走进 Minecraft 的世界
CPU · Python 3.10.12 · 296.23 s · 2026-10-22 23:31:43 UTC+8
本次运行结果
| score | 0.5410355422273262 |
|---|
| steps | 1024 |
|---|
| epochs | 2 |
|---|
| checkpoints | 2 |
|---|
| preview | learned-policy.gif |
|---|
Dependency cache ready: /mnt/workspace/hands-on-modern-rl-notebooks/hands-on-modern-rl-experiment10-minestudio-b44597457f59.ready
代码仓库： /runs/minecraft-zh-final/workspaces/minecraft
实验运行目录： /runs/minecraft-zh-final/workspaces/minecraft/modelscope-space/hands-on-modern-rl-experiment10-minestudio
可选任务：
mine-dirt 挖掘泥土 · 视觉 PPO · MineStudio/mine-dirt
collect-wood 收集木材 · 视觉 PPO · MineStudio/collect-wood
hunt-sheep 猎取绵羊 · 视觉 PPO · MineStudio/hunt-sheep
combat-zombie 对抗僵尸 · 视觉 PPO · MineStudio/combat-zombie
所选任务： 挖掘泥土 · 视觉 PPO
算法： CNN PPO
轮次安排：2 轮 × 512 步 = 1,024 总步数
每轮都会评估并保存一个可单独选择的模型。
Device: CPU
启动与在线 Studio 相同的训练流程…
Preparing persistent MineStudio engine cache at /mnt/workspace/hands-on-modern-rl/minestudio
Temurin Java 8 ready: /mnt/workspace/hands-on-modern-rl/temurin-jre8/jdk8u504-b01-jre/bin/java
MineStudio engine source: https://huggingface.co
MineStudio engine cache ready: /mnt/workspace/hands-on-modern-rl/minestudio/engine/build/libs/mcprec-6.13.jar
Starting the Minecraft renderer
Launching the MineStudio Java/Forge world. The first world connection normally takes several minutes; this run remains active while the controls stay locked.
INFO: Starting Minecraft process with device: cpu
CommandsCallback(commands=['/give @s minecraft:stone_shovel', '/execute as @p at @s run fill ~1 ~ ~1 ~4 ~2 ~4 minecraft:dirt'])
RewardsCallback()
CommandsCallback(commands=['/give @s minecraft:stone_shovel', '/execute as @p at @s run fill ~1 ~ ~1 ~4 ~2 ~4 minecraft:dirt'])
RewardsCallback()
CommandsCallback(commands=['/give @s minecraft:stone_shovel', '/execute as @p at @s run fill ~1 ~ ~1 ~4 ~2 ~4 minecraft:dirt'])
RewardsCallback()
Minecraft PPO update · step=512
device=cpu fps=—
episode_reward_mean=0.0000 value_loss=0.06932
policy_gradient_loss=-0.00673
SAVE epoch=1/2 model=policy.zip
CommandsCallback(commands=['/give @s minecraft:stone_shovel', '/execute as @p at @s run fill ~1 ~ ~1 ~4 ~2 ~4 minecraft:dirt'])
RewardsCallback()
CommandsCallback(commands=['/give @s minecraft:stone_shovel', '/execute as @p at @s run fill ~1 ~ ~1 ~4 ~2 ~4 minecraft:dirt'])
RewardsCallback()
Minecraft PPO update · step=1,024
device=cpu fps=—
episode_reward_mean=0.0000 value_loss=0.00118
policy_gradient_loss=-0.00411
SAVE epoch=2/2 model=policy.zip
Training is complete. Reusing one fresh Minecraft world to replay every saved policy.
INFO: Starting Minecraft process with device: cpu
CommandsCallback(commands=['/give @s minecraft:stone_shovel', '/execute as @p at @s run fill ~1 ~ ~1 ~4 ~2 ~4 minecraft:dirt'])
RewardsCallback()
REPLAY epoch=1/2 model=policy.zip return=0.238
CommandsCallback(commands=['/give @s minecraft:stone_shovel', '/execute as @p at @s run fill ~1 ~ ~1 ~4 ~2 ~4 minecraft:dirt'])
RewardsCallback()
REPLAY epoch=2/2 model=policy.zip return=0.541
Saved 2 independently selectable Minecraft policies and replays
最终阶段： complete
最终得分： 0.0
已保存 2 个本次运行可选择的轮次模型。
模型索引： /runs/minecraft-zh-final/workspaces/minecraft/modelscope-space/hands-on-modern-rl-experiment10-minestudio/artifacts/notebook-models.json
Gym has been unmaintained since 2022 and does not support NumPy 2.0 amongst other critical functionality.
Please upgrade to Gymnasium, the maintained drop-in replacement of Gym, or contact the authors of your software and request that they upgrade.
Users of this version of Gym should be able to simply replace 'import gym' with 'import gymnasium as gym' in the vast majority of cases.
See the migration guide at https://gymnasium.farama.org/introduction/migration_guide/ for additional information.
ERROR:minestudio.simulator.minerl.env.malmo.instance.1e0633:[15:32:08] [Render thread/WARN]: ERROR : Couldn't load Narrator library : Unable to load library 'fliteWrapper': Can't obtain InputStream for linux-x86-64/libfliteWrapper.so
ERROR:minestudio.simulator.minerl.env.malmo.instance.1e0633:[15:32:11] [Realms Notification Availability checker #1/INFO]: Could not authorize you against Realms server: java.lang.RuntimeException: Failed to parse into SignedJWT: null
ERROR:minestudio.simulator.minerl.env.malmo.instance.1e0633:[15:32:18] [Worker-Main-9/ERROR]: Using missing texture, unable to load minecraft:optifine/ctm/default/empty.png : java.io.FileNotFoundException: minecraft:optifine/ctm/default/empty.png
ERROR:minestudio.simulator.minerl.env.malmo.instance.1e0633:[15:32:18] [Render thread/ERROR]: Error starting SoundSystem. Turning off sounds & music
ERROR:minestudio.simulator.minerl.env.malmo.instance.1e0633:java.lang.IllegalStateException: Failed to open OpenAL device
WARNING:minestudio.simulator.minerl.env.malmo.instance.1e0633:[15:32:18] [Render thread/WARN]: [OptiFine] Missing CTM sprite: minecraft:optifine/ctm/default/empty
WARNING:minestudio.simulator.minerl.env.malmo.instance.1e0633:[15:32:22] [Render thread/WARN]: Ambiguity between arguments [teleport, destination] and [teleport, targets] with inputs: [Player, 0123, @e, dd12be42-52a9-4a91-a8a1-11c01849e498]
WARNING:minestudio.simulator.minerl.env.malmo.instance.1e0633:[15:32:22] [Render thread/WARN]: Ambiguity between arguments [teleport, location] and [teleport, destination] with inputs: [0.1 -0.5 .9, 0 0 0]
WARNING:minestudio.simulator.minerl.env.malmo.instance.1e0633:[15:32:22] [Render thread/WARN]: Ambiguity between arguments [teleport, location] and [teleport, targets] with inputs: [0.1 -0.5 .9, 0 0 0]
WARNING:minestudio.simulator.minerl.env.malmo.instance.1e0633:[15:32:22] [Render thread/WARN]: Ambiguity between arguments [teleport, targets] and [teleport, destination] with inputs: [Player, 0123, dd12be42-52a9-4a91-a8a1-11c01849e498]
WARNING:minestudio.simulator.minerl.env.malmo.instance.1e0633:[15:32:22] [Render thread/WARN]: Ambiguity between arguments [teleport, targets, location] and [teleport, targets, destination] with inputs: [0.1 -0.5 .9, 0 0 0]
WARNING:minestudio.simulator.minerl.env.malmo.instance.1e0633:[15:32:42] [Render thread/WARN]: Failed to load texture: minecraft:optifine/ctm/default/empty.png
ERROR:minestudio.simulator.minerl.env.malmo.instance.1e0633:java.io.FileNotFoundException: minecraft:optifine/ctm/default/empty.png
WARNING:minestudio.simulator.minerl.env.malmo.instance.1e0633:[15:33:04] [Render thread/WARN]: Ambiguity between arguments [teleport, destination] and [teleport, targets] with inputs: [Player, 0123, @e, dd12be42-52a9-4a91-a8a1-11c01849e498]
WARNING:minestudio.simulator.minerl.env.malmo.instance.1e0633:[15:33:04] [Render thread/WARN]: Ambiguity between arguments [teleport, location] and [teleport, destination] with inputs: [0.1 -0.5 .9, 0 0 0]
WARNING:minestudio.simulator.minerl.env.malmo.instance.1e0633:[15:33:04] [Render thread/WARN]: Ambiguity between arguments [teleport, location] and [teleport, targets] with inputs: [0.1 -0.5 .9, 0 0 0]
WARNING:minestudio.simulator.minerl.env.malmo.instance.1e0633:[15:33:04] [Render thread/WARN]: Ambiguity between arguments [teleport, targets] and [teleport, destination] with inputs: [Player, 0123, dd12be42-52a9-4a91-a8a1-11c01849e498]
WARNING:minestudio.simulator.minerl.env.malmo.instance.1e0633:[15:33:04] [Render thread/WARN]: Ambiguity between arguments [teleport, targets, location] and [teleport, targets, destination] with inputs: [0.1 -0.5 .9, 0 0 0]
WARNING:minestudio.simulator.minerl.env.malmo.instance.1e0633:[15:33:18] [Render thread/WARN]: Failed to load texture: minecraft:optifine/ctm/default/empty.png
ERROR:minestudio.simulator.minerl.env.malmo.instance.1e0633:java.io.FileNotFoundException: minecraft:optifine/ctm/default/empty.png
WARNING:minestudio.simulator.minerl.env.malmo.instance.1e0633:[15:33:39] [Render thread/WARN]: Ambiguity between arguments [teleport, destination] and [teleport, targets] with inputs: [Player, 0123, @e, dd12be42-52a9-4a91-a8a1-11c01849e498]
WARNING:minestudio.simulator.minerl.env.malmo.instance.1e0633:[15:33:39] [Render thread/WARN]: Ambiguity between arguments [teleport, location] and [teleport, destination] with inputs: [0.1 -0.5 .9, 0 0 0]
WARNING:minestudio.simulator.minerl.env.malmo.instance.1e0633:[15:33:39] [Render thread/WARN]: Ambiguity between arguments [teleport, location] and [teleport, targets] with inputs: [0.1 -0.5 .9, 0 0 0]
WARNING:minestudio.simulator.minerl.env.malmo.instance.1e0633:[15:33:39] [Render thread/WARN]: Ambiguity between arguments [teleport, targets] and [teleport, destination] with inputs: [Player, 0123, dd12be42-52a9-4a91-a8a1-11c01849e498]
WARNING:minestudio.simulator.minerl.env.malmo.instance.1e0633:[15:33:39] [Render thread/WARN]: Ambiguity between arguments [teleport, targets, location] and [teleport, targets, destination] with inputs: [0.1 -0.5 .9, 0 0 0]
WARNING:minestudio.simulator.minerl.env.malmo.instance.1e0633:[15:33:50] [Render thread/WARN]: Failed to load texture: minecraft:optifine/ctm/default/empty.png
ERROR:minestudio.simulator.minerl.env.malmo.instance.1e0633:java.io.FileNotFoundException: minecraft:optifine/ctm/default/empty.png
WARNING:minestudio.simulator.minerl.env.malmo.instance.1e0633:[15:34:07] [Render thread/WARN]: Ambiguity between arguments [teleport, destination] and [teleport, targets] with inputs: [Player, 0123, @e, dd12be42-52a9-4a91-a8a1-11c01849e498]
WARNING:minestudio.simulator.minerl.env.malmo.instance.1e0633:[15:34:07] [Render thread/WARN]: Ambiguity between arguments [teleport, location] and [teleport, destination] with inputs: [0.1 -0.5 .9, 0 0 0]
WARNING:minestudio.simulator.minerl.env.malmo.instance.1e0633:[15:34:07] [Render thread/WARN]: Ambiguity between arguments [teleport, location] and [teleport, targets] with inputs: [0.1 -0.5 .9, 0 0 0]
WARNING:minestudio.simulator.minerl.env.malmo.instance.1e0633:[15:34:07] [Render thread/WARN]: Ambiguity between arguments [teleport, targets] and [teleport, destination] with inputs: [Player, 0123, dd12be42-52a9-4a91-a8a1-11c01849e498]
WARNING:minestudio.simulator.minerl.env.malmo.instance.1e0633:[15:34:07] [Render thread/WARN]: Ambiguity between arguments [teleport, targets, location] and [teleport, targets, destination] with inputs: [0.1 -0.5 .9, 0 0 0]
WARNING:minestudio.simulator.minerl.env.malmo.instance.1e0633:[15:34:18] [Render thread/WARN]: Failed to load texture: minecraft:optifine/ctm/default/empty.png
ERROR:minestudio.simulator.minerl.env.malmo.instance.1e0633:java.io.FileNotFoundException: minecraft:optifine/ctm/default/empty.png
WARNING:minestudio.simulator.minerl.env.malmo.instance.1e0633:[15:34:35] [Render thread/WARN]: Ambiguity between arguments [teleport, destination] and [teleport, targets] with inputs: [Player, 0123, @e, dd12be42-52a9-4a91-a8a1-11c01849e498]
WARNING:minestudio.simulator.minerl.env.malmo.instance.1e0633:[15:34:35] [Render thread/WARN]: Ambiguity between arguments [teleport, location] and [teleport, destination] with inputs: [0.1 -0.5 .9, 0 0 0]
WARNING:minestudio.simulator.minerl.env.malmo.instance.1e0633:[15:34:35] [Render thread/WARN]: Ambiguity between arguments [teleport, location] and [teleport, targets] with inputs: [0.1 -0.5 .9, 0 0 0]
WARNING:minestudio.simulator.minerl.env.malmo.instance.1e0633:[15:34:35] [Render thread/WARN]: Ambiguity between arguments [teleport, targets] and [teleport, destination] with inputs: [Player, 0123, dd12be42-52a9-4a91-a8a1-11c01849e498]
WARNING:minestudio.simulator.minerl.env.malmo.instance.1e0633:[15:34:35] [Render thread/WARN]: Ambiguity between arguments [teleport, targets, location] and [teleport, targets, destination] with inputs: [0.1 -0.5 .9, 0 0 0]
WARNING:minestudio.simulator.minerl.env.malmo.instance.1e0633:[15:34:46] [Render thread/WARN]: Failed to load texture: minecraft:optifine/ctm/default/empty.png
ERROR:minestudio.simulator.minerl.env.malmo.instance.1e0633:java.io.FileNotFoundException: minecraft:optifine/ctm/default/empty.png
ERROR:minestudio.simulator.minerl.env.malmo.instance.e2a658:[15:35:15] [Render thread/WARN]: ERROR : Couldn't load Narrator library : Unable to load library 'fliteWrapper': Can't obtain InputStream for linux-x86-64/libfliteWrapper.so
ERROR:minestudio.simulator.minerl.env.malmo.instance.e2a658:[15:35:18] [Realms Notification Availability checker #1/INFO]: Could not authorize you against Realms server: java.lang.RuntimeException: Failed to parse into SignedJWT: null
ERROR:minestudio.simulator.minerl.env.malmo.instance.e2a658:[15:35:24] [Worker-Main-8/ERROR]: Using missing texture, unable to load minecraft:optifine/ctm/default/empty.png : java.io.FileNotFoundException: minecraft:optifine/ctm/default/empty.png
ERROR:minestudio.simulator.minerl.env.malmo.instance.e2a658:[15:35:25] [Render thread/ERROR]: Error starting SoundSystem. Turning off sounds & music
ERROR:minestudio.simulator.minerl.env.malmo.instance.e2a658:java.lang.IllegalStateException: Failed to open OpenAL device
WARNING:minestudio.simulator.minerl.env.malmo.instance.e2a658:[15:35:25] [Render thread/WARN]: [OptiFine] Missing CTM sprite: minecraft:optifine/ctm/default/empty
WARNING:minestudio.simulator.minerl.env.malmo.instance.e2a658:[15:35:28] [Render thread/WARN]: Ambiguity between arguments [teleport, destination] and [teleport, targets] with inputs: [Player, 0123, @e, dd12be42-52a9-4a91-a8a1-11c01849e498]
WARNING:minestudio.simulator.minerl.env.malmo.instance.e2a658:[15:35:28] [Render thread/WARN]: Ambiguity between arguments [teleport, location] and [teleport, destination] with inputs: [0.1 -0.5 .9, 0 0 0]
WARNING:minestudio.simulator.minerl.env.malmo.instance.e2a658:[15:35:28] [Render thread/WARN]: Ambiguity between arguments [teleport, location] and [teleport, targets] with inputs: [0.1 -0.5 .9, 0 0 0]
WARNING:minestudio.simulator.minerl.env.malmo.instance.e2a658:[15:35:28] [Render thread/WARN]: Ambiguity between arguments [teleport, targets] and [teleport, destination] with inputs: [Player, 0123, dd12be42-52a9-4a91-a8a1-11c01849e498]
WARNING:minestudio.simulator.minerl.env.malmo.instance.e2a658:[15:35:28] [Render thread/WARN]: Ambiguity between arguments [teleport, targets, location] and [teleport, targets, destination] with inputs: [0.1 -0.5 .9, 0 0 0]
WARNING:minestudio.simulator.minerl.env.malmo.instance.e2a658:[15:35:46] [Render thread/WARN]: Failed to load texture: minecraft:optifine/ctm/default/empty.png
ERROR:minestudio.simulator.minerl.env.malmo.instance.e2a658:java.io.FileNotFoundException: minecraft:optifine/ctm/default/empty.png
WARNING:minestudio.simulator.minerl.env.malmo.instance.e2a658:[15:36:09] [Render thread/WARN]: Ambiguity between arguments [teleport, destination] and [teleport, targets] with inputs: [Player, 0123, @e, dd12be42-52a9-4a91-a8a1-11c01849e498]
WARNING:minestudio.simulator.minerl.env.malmo.instance.e2a658:[15:36:09] [Render thread/WARN]: Ambiguity between arguments [teleport, location] and [teleport, destination] with inputs: [0.1 -0.5 .9, 0 0 0]
WARNING:minestudio.simulator.minerl.env.malmo.instance.e2a658:[15:36:09] [Render thread/WARN]: Ambiguity between arguments [teleport, location] and [teleport, targets] with inputs: [0.1 -0.5 .9, 0 0 0]
WARNING:minestudio.simulator.minerl.env.malmo.instance.e2a658:[15:36:09] [Render thread/WARN]: Ambiguity between arguments [teleport, targets] and [teleport, destination] with inputs: [Player, 0123, dd12be42-52a9-4a91-a8a1-11c01849e498]
WARNING:minestudio.simulator.minerl.env.malmo.instance.e2a658:[15:36:09] [Render thread/WARN]: Ambiguity between arguments [teleport, targets, location] and [teleport, targets, destination] with inputs: [0.1 -0.5 .9, 0 0 0]
WARNING:minestudio.simulator.minerl.env.malmo.instance.e2a658:[15:36:21] [Render thread/WARN]: Failed to load texture: minecraft:optifine/ctm/default/empty.png
ERROR:minestudio.simulator.minerl.env.malmo.instance.e2a658:java.io.FileNotFoundException: minecraft:optifine/ctm/default/empty.png
运行下面的推理单元格，选择轮次模型并查看该策略的回放。
默认选择最新轮次；也可以选择其他已保存模型，然后点击 回放所选策略.
VBox(children=(Dropdown(description='训练轮次模型：', layout=Layout(width='95%'), options=(('轮次 2/2 · 1,024 步 · 得分 0.…
{
"score": 0.5410355422273262,
"steps": 1024,
"epochs": 2,
"checkpoints": 2,
"preview": "learned-policy.gif"
}
metrics.json
{
"score": 0.5410355422273262,
"steps": 1024,
"epochs": 2,
"checkpoints": 2,
"preview": "learned-policy.gif"
}