jangorecki
jangorecki

Reputation: 16697

Running impala cluster from portable binaries

I'm evaluating multiple big data tools. One of them is of course Impala.
I would like to start Impala cluster by manually starting processes on the cluster nodes. As I'm currently doing for Spark, H2O, Presto and Dask, I would like to grab binaries, copy to nodes, edit configs, and start services on nodes from shell. This works very well, it's straightforward to upgrade and I can easily move to bigger/different clusters when needed. Unfortunately I cannot find resources on proper way for starting required services (Catalog Server, StateStore and daemons) from shell.
I assume it is obvious task but just cannot find a proper example to follow, so my question is how can I start Impala cluster from shell calling Impala binaries?

Upvotes: 8

Views: 367

Answers (1)

Marco99
Marco99

Reputation: 1659

....I would like to start Impala cluster by manually starting processes on the cluster nodes.....how can I start Impala cluster from shell calling Impala binaries?

I guess this is what you are looking for: http://www.cloudera.com/documentation/enterprise/5-5-x/topics/impala_processes.html#starting_via_cmdline

Update 1:

You may want to pick only the required info from this link: http://doc.mapr.com/plugins/servlet/mobile#content/view/28869628

It has steps to build impala from github, to be run on mapr.

Update 2:

To build Impala, Check these links: https://github.com/cloudera/Impala/wiki/Build-prerequisites https://github.com/cloudera/Impala/wiki/How-to-build-Impala https://cwiki.apache.org/confluence/display/IMPALA/Building+Impala

Update 3:

For expert suggestions on portability please get in touch with:

Impala developers: [email protected]

Taken from http://impala.apache.org/community.html

Time being, you may consider to build the binaries for the readily available linux production environment.

Some more useful links for your situation:

https://cwiki.apache.org/confluence/display/IMPALA/Tips+for+Faster+Impala+Builds https://cwiki.apache.org/confluence/display/IMPALA/Building+native-toolchain+from+scratch+and+using+with+Impala

Upvotes: 2

Related Questions