Owl_rllib_llm.LmSourceA toy autoregressive language model.
An MLP reads the last window tokens, one-hot encoded, and outputs logits for the next token (one-hot input followed by a linear layer is a learned embedding per position). In a batch, every generated position is one row.