CODEWITHSUNDEEP
springspring-bootspring-cloudruntimeexceptionhystrix
catch32
catch32

Reputation: 18572

Unable to connect to Command Metric Stream for Hystrix Dashboard with Spring Cloud

I have microservices project with Spring Cloud, the snippet from parent:

<parent>
    <groupId>org.springframework.boot</groupId>
    <artifactId>spring-boot-starter-parent</artifactId>
    <version>1.5.7.RELEASE</version>
</parent>

<dependencyManagement>
    <dependencies>
        <dependency>
            <groupId>org.springframework.cloud</groupId>
            <artifactId>spring-cloud-dependencies</artifactId>
            <version>Dalston.SR3</version>
            <type>pom</type>
            <scope>import</scope>
        </dependency>

All services are running under Eureka server:

enter image description here

All services are running fine. I can call make appropriate calls with Postman and everything works fine.

I have separate service which handles Hystrix dashboard, a snippet from pom:

<dependencies>
    <dependency>
        <groupId>org.springframework.boot</groupId>
        <artifactId>spring-boot-starter-web</artifactId>
        <exclusions>
            <exclusion>
                <groupId>org.springframework.boot</groupId>
                <artifactId>spring-boot-starter-tomcat</artifactId>
            </exclusion>
        </exclusions>
    </dependency>

    <dependency>
        <groupId>org.springframework.boot</groupId>
        <artifactId>spring-boot-starter-jetty</artifactId>
    </dependency>

    <dependency>
        <groupId>org.springframework.cloud</groupId>
        <artifactId>spring-cloud-starter-hystrix-dashboard</artifactId>
    </dependency>

Configuration main class:

@SpringBootApplication
@EnableHystrixDashboard
public class DashboardApp {
    public static void main(String[] args) {
        SpringApplication.run(DashboardApp.class, args);
    }
}

and config yaml file:

spring:
  application:
    name: Dashboard

server:
  port: 8000

eureka:
  client:
    fetchRegistry: true
    registerWithEureka: false
    serviceUrl:
      defaultZone: http://localhost:8761/eureka

I have next dashboard looking:

enter image description here

Full stack trace from the console is here. Following is some snippet:

2018-04-12 11:28:25.089 ERROR 15762 --- [qtp295055909-16] ashboardConfiguration$ProxyStreamServlet : Error proxying request: http://localhost:8082/hystrix.stream
java.lang.RuntimeException: org.eclipse.jetty.io.EofException
    at org.springframework.cloud.netflix.hystrix.dashboard.HystrixDashboardConfiguration$ProxyStreamServlet.doGet(HystrixDashboardConfiguration.java:208)
....
Caused by: org.eclipse.jetty.io.EofException: null
...
Caused by: java.io.IOException: Broken pipe
...

Service itself is accessible with spring actuator:

enter image description here

snippet from it's pom:

    <dependency>
        <groupId>org.springframework.cloud</groupId>
        <artifactId>spring-cloud-starter-eureka</artifactId>
    </dependency>

    <dependency>
        <groupId>org.springframework.cloud</groupId>
        <artifactId>spring-cloud-starter-hystrix</artifactId>
    </dependency>

    <dependency>
        <groupId>org.springframework.boot</groupId>
        <artifactId>spring-boot-starter-actuator</artifactId>
    </dependency>

Config class looks:

@EnableHystrix
@EnableEurekaClient
@SpringBootApplication
public class TableApp {
    public static void main(String[] args) {
        SpringApplication.run(TableApp.class, args);
    }
}

How to solve this issue?

Upvotes: 10

Views: 17311

Answers (8)

Jiao
Jiao

Reputation: 121

check details on github: https://github.com/HuiyingWang0108/hystrix-dashboard related microservice: https://github.com/HuiyingWang0108/cloud-gateway https://github.com/HuiyingWang0108/registry-service In my case: app like this: enter image description here Step1: (1) change pom.xml:

<dependency>
            <groupId>org.springframework.cloud</groupId>
            <artifactId>spring-cloud-starter-hystrix-dashboard</artifactId>
            <version>2.2.10.RELEASE</version>
        </dependency>

to

<dependency>
            <groupId>org.springframework.cloud</groupId>
            <artifactId>spring-cloud-starter-netflix-hystrix-dashboard</artifactId>
            <version>2.2.10.RELEASE</version>
        </dependency>

(2) added below in the application.yml

hystrix:
  dashboard:
    proxy-stream-allow-list: "*"

(3) and then start app, open:

http://localhost:9295/hystrix

works:

Step2: (1) added below in the pom.xml

<dependency>
            <groupId>org.springframework.boot</groupId>
            <artifactId>spring-boot-starter-actuator</artifactId>
        </dependency>

(2)added below in the application.yml

management:
  endpoints:
    web:
      exposure:
        include: hystrix.stream, info, health

(3) Open: http://localhost:9191/actuator/hystrix.steam shows: enter image description here

Upvotes: 0

ismail-ERROUK
ismail-ERROUK

Reputation: 21

Make sure you have added this in your application.properties.

hystrix.dashboard.proxy-stream-allow-list=localhost

Upvotes: 2

zylyye
zylyye

Reputation: 361

  1. Correct your hystrix.stream url to http://localhost:8082/actuator/hystrix.stream
  2. Exposure 'hystrix.steam' web endpoints in your hystrix application's config file:
management:
  endpoints:
    web:
      exposure:
        include: 'hystrix.stream'
  1. Make sure you have added your host to hystrix.dashboard.proxyStreamAllowList, in your config file of hystrix-dashboard application, it looks like:
hystrix:
  dashboard:
    proxy-stream-allow-list:
      - 'localhost'

Upvotes: 0

Ajay Kumar
Ajay Kumar

Reputation: 5233

I had the same issues with the latest version of Spring-boot(2.3.3-XXX) and spring-cloud (Hoxton.SR7) but when I did the downgrade the version in pom.xml file then it starts working fine for me.

<parent>
    <groupId>org.springframework.boot</groupId>
    <artifactId>spring-boot-starter-parent</artifactId>
    <version>2.1.16.RELEASE</version>
    <relativePath/> <!-- lookup parent from repository -->
</parent>

and

<properties>
    <java.version>1.8</java.version>
    <spring-cloud.version>Greenwich.SR6</spring-cloud.version>
</properties>

Hope, this would be helpful :)

Upvotes: 0

Jeff Cook
Jeff Cook

Reputation: 8774

I was able to solve this issue for the spring-boot-starter-parent version 2.0.7.RELEASE and spring-cloud-dependencies version Finchley.SR2 by adding below two properties in the application.properties.

management.endpoints.web.exposure.include=*
management.endpoints.web.base-path=/

enter image description here

Upvotes: 5

Shanu Gupta
Shanu Gupta

Reputation: 3797

For those who are using spring boot 2, the hystrix.stream endpoint has been moved to /actuator/hystrix.stream.

For me this url worked:

http://localhost:8082/actuator/hystrix.stream

And yes, have this actuator endpoint enabled via following property:

management.endpoints.web.exposure.include=hystrix.stream

Of course you must have the actutator dependency included in your project.

Upvotes: 18

catch32
catch32

Reputation: 18572

Finally, I found the solution.

Problem was that Controller API has to be market by HystrixCommand annotation.

Snippet from a documentation:

Turbine AMQP by Spring Cloud offers a different model where each
application instance pushes the metrics from Hystrix commands to
Turbine through a central AMQP broker.

I added it without any parameters to all Controller's methods, like following:

@RestController
@AllArgsConstructor
public class GuestController {
    private DinnerService dinnerService;

    @HystrixCommand
    @PostMapping("/dinner")
    public Integer startDinner(@RequestBody List<Integer> menuItems) {
        return dinnerService.startDinner(menuItems);
    }

    @HystrixCommand
    @DeleteMapping("/dinner/{tableId}")
    public void finishDinner(@PathVariable Integer tableId) {
        dinnerService.finishDinner(tableId);
    }
}

And now all works like charming:

enter image description here

Now I understand that I was so close to it.

Upvotes: 1

Ivan Lymar
Ivan Lymar

Reputation: 2293

Hystrix dashboard itself can't be used for monitoring several instances at once. The thing that you need is turbine+dashboard. In a couple of words turbine is an aggregator for several hystrix metrics streams.

Configuration of instance:

management:
  endpoints:
    web:
      exposure:
        include: hystrix.stream, info, health

spring:
  application:
    name: WRITING
eureka:
  client:
    serviceUrl:
      defaultZone: http://localhost:8761/eureka

The important thing here is to expose hystix.stream actuator. This endpoint will be used by the turbine to read metrics. Also, do not forget to add actuators starter.

   <dependency>
            <groupId>org.springframework.boot</groupId>
            <artifactId>spring-boot-starter-actuator</artifactId>
   </dependency>

If you did everything correctly http://localhost:8080/actuator/hystrix.stream endpoint should become available.

Turbine config will look like:

server:
      port: 8888

spring:
  application:
    name: TURBINE

eureka:
  client:
    registerWithEureka: true
    fetchRegistry: true
    serviceUrl:
      defaultZone: http://localhost:8761/eureka/

turbine:
  appConfig: WRITING,READING
  clusterNameExpression: new String('default')

In appConfig, you should specify service names for monitoring.

After starting turbine localhost:8888/turbine.stream will be available.

You can pass this URL to the dashboard and monitor all data aggregated for hystrix commands of discovered instances.

Github project example.

p.s. Dependencies that you have used are deprecated. Please check maven repo

Upvotes: 5

Related Questions