Learning to Navigate a Living City

An interactive reinforcement-learning playground where a small autonomous agent learns daily chore routines in a dynamic city with traffic, pedestrians, weather, energy constraints, pickup/dropoff objectives, and a clock-driven day/night cycle.

Click a road or sidewalk node to move · Drag to rotate · Wheel to zoom · Shift+drag to pan
Daily Objective: Discover Better Chore Routines Navigate back to a cozy home while avoiding collisions and managing energy. Reward: chore bonuses minus time cost, energy cost, traffic-rule violations, and safety penalties.
Day1
Best routine so far
Daily return0.0
Signal phaseVertical Green
Rest stopAvailable
Traffic violations0
Collisions0

Learning Dashboard

ModeManual
StatusExploring
Current choreGo Home
Distance0.0
Timer0.0s
Day1
Completed today0
Best time
Deliveries0
NeighborhoodResidential