Reputation: 361
I need to create a state space for my RL problem which has about 10 state variables each which contains about 2 or 3 values for the variables. That would make the state space about 600,000 states. How do I implement this in python?
Upvotes: 2
Views: 974
Reputation: 6679
Given the number of states in your problem, maybe you should consider in using some kind of function approximation instead of using a tabular representation.
If finally you decide to use a table with 600k rows and as much columns as actions, maybe a pandas DataFrame could work.
Upvotes: 1