CODEWITHSUNDEEP
mavenapache-sparksbthbase
Mahmoud Hanafy
Mahmoud Hanafy

Reputation: 1897

Can't find spark-hbase mvn dependency

I want to read table in HBase using Spark. I added the following dependency:

libraryDependencies += "org.apache.hbase" %% "hbase-spark" % "2.0.0-SNAPSHOT"

as mentioned in hbase website, but the dependency can't be resolved !!

I also tried different versions (1.2.0, 1.1.2) and it didn't work.

Upvotes: 5

Views: 6140

Answers (3)

Prasanta Sahoo
Prasanta Sahoo

Reputation: 1095

I was facing the same issue while using hbase-spark dependency in pom.xml

<!-- https://mvnrepository.com/artifact/org.apache.hbase/hbase-spark -->
<dependency>
   <groupId>org.apache.hbase</groupId>
   <artifactId>hbase-spark</artifactId>
   <version>2.0.0-alpha4</version>
</dependency>

I resolve the above issue by using following step:

  • Download the hbase-spark dependency jar from maven repository by click on the blue marking area as below image.

enter image description here

  • Create a lib folder inside /src/main/resources as per the attached image.

enter image description here

  • Copy the downloaded jar into lib folder and add the system path of jar file in pom.xml

.

    <!-- https://mvnrepository.com/artifact/org.apache.hbase/hbase-spark -->
<dependency>
   <groupId>org.apache.hbase</groupId>
   <artifactId>hbase-spark</artifactId>
   <version>2.0.0-alpha4</version>
   <scope>system</scope>
   <systemPath>${project.basedir}/src/main/resources/lib/hbase-spark-2.0.0-alpha4.jar</systemPath>
</dependency>

Hope It will help you.

Upvotes: 1

Echo
Echo

Reputation: 35

  1. add this repository

    cloudera https://repository.cloudera.com/artifactory/cloudera-repos/

  2. then u can download it by maven:

    org.apache.hbase hbase-spark 1.2.0-cdh5.7.0

Upvotes: 1

tschaible
tschaible

Reputation: 7695

It doesn't look like hbase-spark is in maven central, which is the default repository that dependencies will be retrieved from.

You'll need to configure your build management tool (unclear if you're using Maven or SBT) to use the correct repository.

From the project page you can use

Currently, however, it looks like only snapshots are available.

Additionally, as mentioned in the comment from the author below, the line 

libraryDependencies += "org.apache.hbase" %% "hbase-spark" % "2.0.0-SNAPSHOT"

should actually be

libraryDependencies += "org.apache.hbase" % "hbase-spark" % "2.0.0-SNAPSHOT"

The double % is not needed in this case as you do no want to append the scala version to the artifact name.

Upvotes: 7

Related Questions