CODEWITHSUNDEEP
neo4j
user1898026
user1898026

Reputation: 11

How to load relational database tables into neo4j database

I have tables which have millions of records. I need to load these records as nodes in neo4j.

Please help me out on how to do it as I'm new to neo4j.

Upvotes: 0

Views: 267

Answers (2)

Michael Hunger
Michael Hunger

Reputation: 41676

It is quite easy, just map your entities that should become nodes into a set of csv files and the connections that should become relationships in another set of files.

Then run them with my batch-importer: https://github.com/jexp/batch-import/tree/20#binary-download

import.sh nodes1.csv,nodes2.csv rels1.csv,rels2.csv

Add types and index information to the headers and the batch.properties config file as needed.

You can use the batch-importer for the initial inserter but also subsequent updates (but the database has to be shut-down for that).

It is pretty easy to connect to your existing database using its driver and then extract the information of the right shape and kind and insert it into your graph model,

Either using Cypher statements with parameters or the embedded, transactional Java API for ongoing updates. See: http://jexp.de/blog/2013/05/on-importing-data-in-neo4j-blog-series/

Upvotes: 2

dcinzona
dcinzona

Reputation: 477

You can export to CSV and import it into node (probably wont work well since you have millions of records) You can write a program to do it (this is what I am currently working on). This also depends on what programming languages you know... but the bottom line is, because no two databases are created equally (unless on purpose), it's very difficult to create a catch-all solution for migrating data from SQL to Neo.

The best way that I've discovered so far is to create a program that queries the tables in the database, finds all related tables (i.e. foreign keys), and imports all those table rows into Neo, labeling the nodes using the Table name, then process the foreign keys as relationships.

It's not easy. I've been working on something for my database here for a week or so now... but I'm close!

Upvotes: 1

Related Questions