Developers

Build on Waypoint with World Engine — our open inference stack for custom applications.

World Engine is our inference library for running Waypoint models in your own applications. Use it to generate interactive frames, wire up controllers, and integrate world models into games, tools, and research prototypes.

Biome is the end-user client; World Engine is the programmable layer underneath. Together they cover local play and custom integration.

Setup

# Recommended: set up venv
python3 -m venv .env
source .env/bin/activate

# Install
pip install --upgrade --ignore-installed \
  "world_engine @ git+https://github.com/Overworldai/world_engine.git"

Waypoint-1.5 behavior

All interfaces for Waypoint-1 (or 1.1) and Waypoint-1.5 remain the same except the following:

In Waypoint-1.5, the img passed to append_frame(...) and returned by gen_frame(...) is now a sequence of 4 frames. Waypoint-1.5 applies temporal compression and generates 4 frames for every controller input.

Whereas previously, img was a uint8 RGB array of shape [Height, Width, 3], in Waypoint-1.5 it is[4, Height, Width, 3]. Waypoint-1.5 expects 720p inputs and outputs, therefore img is[4, 720, 1280, 3].