Playhouse
← All research
R-01GrowthProposed

Reinforcement learning for revenue growth

Growth is a chain of decisions whose payoff arrives late. We want agents that learn from that delayed signal instead of from the first click.

01

The question

Can agents learn which sequence of creative, landing-page and lifecycle decisions produces revenue weeks later?

An ad, the page it leads to and the message someone receives a week later all contribute to whether that person stays. Most optimization treats each step on its own and rewards whatever looks good immediately.

Learning from revenue that shows up weeks later means solving two hard problems at once: rewards are delayed, and credit has to be split across many decisions made by different agents.

02

Proposed method

  1. 1Log every agent decision as a trajectory: the context it saw, the action it took, and what happened afterward.
  2. 2Attribute delayed outcomes back across the trajectory, starting with simple temporal-difference baselines before anything more elaborate.
  3. 3Train on those traces without rewriting the agents themselves, in the spirit of Agent Lightning, and evaluate new policies offline against logged decisions before they spend money.
03

What a good outcome looks like

Agents whose choices measurably improve revenue at 30 and 60 days compared with a fixed playbook, with every live action still passing human review.

04

Current status

ProposedOpen question. Decision logging for agents is the first step.

05

Related work

Cited as methodological references. Playhouse is not affiliated with these authors.

Next · R-02Agents that improve their own playbooks →