Yomal
Yomal

Reputation: 361

how to define a state in python for reinforcement learning

I need to create a state space for my RL problem which has about 10 state variables each which contains about 2 or 3 values for the variables. That would make the state space about 600,000 states. How do I implement this in python?

Upvotes: 2

Views: 974

Answers (1)

Pablo EM
Pablo EM

Reputation: 6679

Given the number of states in your problem, maybe you should consider in using some kind of function approximation instead of using a tabular representation.

If finally you decide to use a table with 600k rows and as much columns as actions, maybe a pandas DataFrame could work.

Upvotes: 1

Related Questions