Fail: The package hadoop-hdfs-dfsrouter is not supported by this version of the stack-select tool

Question

The system used during installation CentOS-7

Code branches used during compilation:

1. ambari trunk

2. bigtop branch-3.3

3. ambari-metrics 3.0

Ambari reported an error when installing Bigtop compiled components. Can the new version be used now

Here is the detailed error log information:

enter image description here

stderr: 
2024-12-30 13:20:31,798 - Reporting component version failed
Traceback (most recent call last):
  File "/usr/lib/ambari-agent/lib/resource_management/libraries/script/script.py", line 428, in execute
    self.save_component_version_to_structured_out(self.command_name)
  File "/usr/lib/ambari-agent/lib/resource_management/libraries/script/script.py", line 263, in save_component_version_to_structured_out
    stack_select_package_name = stack_select.get_package_name()
  File "/usr/lib/ambari-agent/lib/resource_management/libraries/functions/stack_select.py", line 126, in get_package_name
    package = get_packages(PACKAGE_SCOPE_STACK_SELECT, service_name, component_name)
  File "/usr/lib/ambari-agent/lib/resource_management/libraries/functions/stack_select.py", line 265, in get_packages
    f"The package {package} is not supported by this version of the stack-select tool."
resource_management.core.exceptions.**Fail: The package hadoop-hdfs-dfsrouter is not supported by this version of the stack-select tool.**
2024-12-30 13:20:36,321 - Reporting component version failed
Traceback (most recent call last):
  File "/usr/lib/ambari-agent/lib/resource_management/libraries/script/script.py", line 428, in execute
    self.save_component_version_to_structured_out(self.command_name)
  File "/usr/lib/ambari-agent/lib/resource_management/libraries/script/script.py", line 263, in save_component_version_to_structured_out
    stack_select_package_name = stack_select.get_package_name()
  File "/usr/lib/ambari-agent/lib/resource_management/libraries/functions/stack_select.py", line 126, in get_package_name
    package = get_packages(PACKAGE_SCOPE_STACK_SELECT, service_name, component_name)
  File "/usr/lib/ambari-agent/lib/resource_management/libraries/functions/stack_select.py", line 265, in get_packages
    f"The package {package} is not supported by this version of the stack-select tool."
resource_management.core.exceptions.**Fail: The package hadoop-hdfs-dfsrouter is not supported by this version of the stack-select tool.
NoneType: None**

The above exception was the cause of the following exception:

2024-12-30 13:20:36,769 - Reporting component version failed
Traceback (most recent call last):
  File "/usr/lib/ambari-agent/lib/resource_management/libraries/script/script.py", line 413, in execute
    method(env)
  File "/var/lib/ambari-agent/cache/stack-hooks/after-INSTALL/scripts/hook.py", line 32, in hook
    setup_stack_symlinks(self.stroutfile)
  File "/var/lib/ambari-agent/cache/stack-hooks/after-INSTALL/scripts/shared_initialization.py", line 62, in setup_stack_symlinks
    stack_packages = stack_select.get_packages(stack_select.PACKAGE_SCOPE_INSTALL)
  File "/usr/lib/ambari-agent/lib/resource_management/libraries/functions/stack_select.py", line 265, in get_packages
    f"The package {package} is not supported by this version of the stack-select tool."
resource_management.core.exceptions.Fail: The package hadoop-hdfs-dfsrouter is not supported by this version of the stack-select tool.

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/lib/ambari-agent/lib/resource_management/libraries/script/script.py", line 428, in execute
    self.save_component_version_to_structured_out(self.command_name)
  File "/usr/lib/ambari-agent/lib/resource_management/libraries/script/script.py", line 263, in save_component_version_to_structured_out
    stack_select_package_name = stack_select.get_package_name()
  File "/usr/lib/ambari-agent/lib/resource_management/libraries/functions/stack_select.py", line 126, in get_package_name
    package = get_packages(PACKAGE_SCOPE_STACK_SELECT, service_name, component_name)
  File "/usr/lib/ambari-agent/lib/resource_management/libraries/functions/stack_select.py", line 265, in get_packages
    f"The package {package} is not supported by this version of the stack-select tool."
resource_management.core.exceptions.Fail: The package hadoop-hdfs-dfsrouter is not supported by this version of the stack-select tool.
Traceback (most recent call last):
  File "/var/lib/ambari-agent/cache/stack-hooks/after-INSTALL/scripts/hook.py", line 39, in 
    AfterInstallHook().execute()
  File "/usr/lib/ambari-agent/lib/resource_management/libraries/script/script.py", line 413, in execute
    method(env)
  File "/var/lib/ambari-agent/cache/stack-hooks/after-INSTALL/scripts/hook.py", line 32, in hook
    setup_stack_symlinks(self.stroutfile)
  File "/var/lib/ambari-agent/cache/stack-hooks/after-INSTALL/scripts/shared_initialization.py", line 62, in setup_stack_symlinks
    stack_packages = stack_select.get_packages(stack_select.PACKAGE_SCOPE_INSTALL)
  File "/usr/lib/ambari-agent/lib/resource_management/libraries/functions/stack_select.py", line 265, in get_packages
    f"The package {package} is not supported by this version of the stack-select tool."
resource_management.core.exceptions.**Fail: The package hadoop-hdfs-dfsrouter is not supported by this version of the stack-select tool.**
 stdout:
2024-12-30 13:20:30,932 - Stack Feature Version Info: Cluster Stack=3.3.0, Command Stack=None, Command Version=None -> 3.3.0
2024-12-30 13:20:30,933 - Using hadoop conf dir: /etc/hadoop/conf

Answer 1

This seems to be issue with the Packaging issue.

During the Nov2024 timelines, I was tested this by cherry picking apache Ambari's below PR's from the community to my repo.

AMBARI-26073
AMBARI-26116
AMBARI-26109
AMBARI-26141
AMBARI-26136

Here is the doc I prepared for my testing and later made public.

https://docs.acceldata.io/odp/documentation/hdfs

Out of the above mentioned, here are the Ambari repo and hadoop repo's, which worked with JDK11&Py3.

Ambari Repo

https://mirror.odp.acceldata.dev/ODP/rhel/Ambari-2.7.9.0-1/

Hadoop/stack component repo -

https://mirror.odp.acceldata.dev/ODP/rhel/3.3.6.0-1/

Installation Steps:

Amabri installation  doc reference - https://docs.acceldata.io/odp/documentation/ambari-server-installation

Stack installation doc reference - https://docs.acceldata.io/odp/documentation/cluster-deployment-and-configuration

DFS Router setup doc - https://docs.acceldata.io/odp/documentation/hdfs