CODEWITHSUNDEEP
javahdf5hdfjhdf
bloub
bloub

Reputation: 610

Read HDF5 in streaming in java

I want to read some HDF5 stream of several gigabytes. I also want to stay in native java for portability.

I have tried Java HDF Object Package and Java HDF5 Interface (JHI5) but theses are some JNI solutions (that I might reconsider if i don't find better options).

https://github.com/jamesmudd/jhdf is a native java library but does not support slicing or streaming so is not usable for big files.

Is there some more option in native Java ?

Edit : I found this : https://www.unidata.ucar.edu/software/netcdf-java/current/ It's supports slicing but not streaming.

Upvotes: 6

Views: 1452

Answers (1)

James Mudd
James Mudd

Reputation: 2373

As the author of jhdf thought I would add my answer. I am not aware of any other pure Java libraries attempting to read HDF5. This is the main reason I started writing one. Although jhdf currently doesn't support slicing or streaming I would certainly like to add it in the future, but that's probably still a while off. Having said that several gigabyte files should be OK with enough heap space so might still be worth a try. You would probably need an xmx about double the size of the dataset you want to open. I have opened several gigabyte datasets successfully using jhdf.

Upvotes: 4

Related Questions