hsfear
hsfear

Reputation: 43

Is there a list of valid options for spark DataFrameReaders and DataFrameWriters?

Is there a list of valid options for DataFrameReaders and DataFrameWriters? I'm writing an application that will enable users to set these via yaml configuration and would like to document the options that are available for each of the drivers.

Upvotes: 0

Views: 172

Answers (1)

M_S
M_S

Reputation: 3733

I think that there is such list but it is created per source, here are some examples:

JSON CSV JDBC - There also other sources on the list in left tab

Scroll down to "Data Source Option" and you will find options with descriptions. If its marked as read/write it means that it applies for both reader and writer

Upvotes: 1

Related Questions