\n
I've tested the cluster ODBC connection after entering all parameters, and it tests "OK". It is able to read the HIVE table even and map all columns to. The problem arrives at run time.
\nIt generally just locks up, with no rows in counter, or it will get to a handful of rows in the buffer and freeze.
\nI've troubleshooted with:
\nSELECT TOP 100 FROM stupidTable
). Also tested with only 4 columns.I can't figure out what else to try. I'm not doing much different than examples on the web like this one, except that I'm using the ODBC as a Destination and not a Source.
\nHas anyone had success with using the HIVE driver or another one within an SSIS Destination task?
\n","author":{"@type":"Person","name":"Jon"},"upvoteCount":1,"answerCount":0,"acceptedAnswer":null}}Reputation: 149
Currently driving an RnD project testing hard against Azure's HDInsight Hadoop service. We use SQL Server Integration Services to manage ETL workflows, and so making HDInsight work with SSIS is a must.
I've had good success with a few of the Azure Feature Pack tasks. But there is no native HDInsight/Hadoop Destination task for use with DFTs.
I create a DFT with a simple SQL Server "OLE DB Source" pointing to the cluster with a "ODBC Destination" using Microsoft HIVE ODBC Driver. (Ignore red error. It has detected the cluster is destroyed).
I've tested the cluster ODBC connection after entering all parameters, and it tests "OK". It is able to read the HIVE table even and map all columns to. The problem arrives at run time.
It generally just locks up, with no rows in counter, or it will get to a handful of rows in the buffer and freeze.
I've troubleshooted with:
SELECT TOP 100 FROM stupidTable
). Also tested with only 4 columns.I can't figure out what else to try. I'm not doing much different than examples on the web like this one, except that I'm using the ODBC as a Destination and not a Source.
Has anyone had success with using the HIVE driver or another one within an SSIS Destination task?
Upvotes: 1
Views: 451