CODEWITHSUNDEEP
google-cloud-data-fusion
Mustaquim
Mustaquim

Reputation: 103

Getting connection timeout error when running simple data fusion pipeline to export data from Bigquery and write to GCS

I am trying to use google Data fusion service, i created a simple pipeline which will extract data from BigQuery and load that data back to GCS in json formate but when i am running the pipeline i am getting the below error.

java.io.IOException: com.jcraft.jsch.JSchException: java.net.ConnectException: Connection timed out (Connection timed out) at io.cdap.cdap.common.ssh.DefaultSSHSession.(DefaultSSHSession.java:82) ~[na:na] at io.cdap.cdap.internal.app.runtime.distributed.remote.RemoteExecutionTwillPreparer.lambda$start$0(RemoteExecutionTwillPreparer.java:429) ~[na:na]

i provided the all the necessary access to data fusion instance service account. below are the access which i provided.

BigQuery Admin
Compute Admin
Cloud Data Fusion Admin
Cloud Data Fusion API Service Agent
Dataproc Administrator
Storage Admin
computer network viewer

Upvotes: 3

Views: 1822

Answers (1)

Ali Anwar
Ali Anwar

Reputation: 431

Cloud Data Fusion requires that port 22 be open to the firewall on the customer project. Is this something that you can modify in your project's firewall rules?

Upvotes: 3

Related Questions