Reinforcement learning for revenue growth
Growth is a chain of decisions whose payoff arrives late. We want agents that learn from that delayed signal instead of from the first click.
The question
Can agents learn which sequence of creative, landing-page and lifecycle decisions produces revenue weeks later?
An ad, the page it leads to and the message someone receives a week later all contribute to whether that person stays. Most optimization treats each step on its own and rewards whatever looks good immediately.
Learning from revenue that shows up weeks later means solving two hard problems at once: rewards are delayed, and credit has to be split across many decisions made by different agents.
Proposed method
- 1Log every agent decision as a trajectory: the context it saw, the action it took, and what happened afterward.
- 2Attribute delayed outcomes back across the trajectory, starting with simple temporal-difference baselines before anything more elaborate.
- 3Train on those traces without rewriting the agents themselves, in the spirit of Agent Lightning, and evaluate new policies offline against logged decisions before they spend money.
What a good outcome looks like
Agents whose choices measurably improve revenue at 30 and 60 days compared with a fixed playbook, with every live action still passing human review.
Current status
ProposedOpen question. Decision logging for agents is the first step.
Related work
Cited as methodological references. Playhouse is not affiliated with these authors.