Automata-Based Reward Machines for Signal Temporal Logic

This method introduces an automata-based approach to provide an efficient memory mechanism for reinforcement learning under Signal Temporal Logic (STL) specifications. It avoids the intractable state space expansion typically caused by history-dependent STL robustness scores in long-horizon tasks.