CODEWITHSUNDEEP
apache-sparkgraphgremlintinkerpopkryo
Ayush
Ayush

Reputation: 1

How to process large .kryo files for graph data using TinkerPop/Gremlin

I am new to Apache TinkerPop. I have done some basic stuff like installing TinkerPop Gremlin console, creating graph .kryo file, loaded it in gremlin console and executed some basic gremlin queries. All good till now.

But i wanted to check how can we process .kryo files which are very much large in size says more than 1000GB. If i create a single .kryo file, loading it in console(or using some code) is not feasible i think.

Is there any way we can deal with graph data which is pretty huge in size? basically i have some graph based data stored in Amazon Neptune DB, i want to take it out and store it in some files(e.g .kryo) and process later for gremlin queries. Thanks in advance.

Upvotes: 0

Views: 216

Answers (1)

Kelvin Lawrence
Kelvin Lawrence

Reputation: 14391

Rather than use Kyro which is Java specific, I would recommend using something more language agnostic such as CSV files. If you are using Amazon Neptune you can use the Neptune Export tool to export your data as CSV files.

Upvotes: 0

Related Questions