opentau.policies.pi05_mem
PI05 Mem Policy Module.
This module implements a variant of the π05 (Pi05) Vision-Language-Action Flow Model with the low-level memory architecture from Torne, Pertsch, Walke et al. “MEM: Multi-Scale Embodied Memory for Vision Language Action Models”. The SigLIP image encoder is extended with space-time separable attention every N-th layer so past frames can inform the current-frame tokens without introducing new learnable parameters, and temporal state sequences are projected into one continuous token per timestep for the Gemma backbone.
Modules
Configuration module for the PI05 Mem Policy. |
|
π05 Mem: A Vision-Language-Action Flow Model with space-time SigLIP video encoding and temporal state sequences. |
|
Space-Time Self-Similarity (STSS) motion module. |
|
RLDX SigLIP video encoder: plain SigLIP + STSS motion module. |