YI-MapReduce

Component Management

2025-07-24 10:07:22

Object Management Introduction

YI-MapReduce (or "YI-MR") clusters include a variety of different basic objects. The descriptions of these distinct objects are as follows:

Object

Description

Example

Cluster Service

Collection   of features capable of executing specific tasks

HDFS   cluster service, YARN cluster service.

Service Roles

Functional   instances that constitute a complete 

service, usually distinguished by roles

HDFS   comprises NameNode, DataNode, HDFSClient, 

ZKFC, JournalNode. Each plays   various roles within the 

component, communicating and coordinating to provide   

distributed file storage capacity.

Instance Groups

Groups   comprising instances with identical 

roles, typically one instance group   corresponds 

to one role, and the name generally aligns with the role name

JournalNode   instance group, DataNode instance group.

Role Instances

Specific   instances of service roles operating on host nodes

KerberosAdmin   operating on Host2, KerberosServer operating on Host3.

Host

Physical   or virtual hosts used for running role instances

Host1   to Host5.

Cluster

Logical   entities composed of multiple hosts 

capable of providing various services

A   cluster named Cluster1 composed of 5 hosts

 (Host1 to Host5) providing  services such as HDFS and YARN.

View Configuration

On YI-MapReduce (or "YI-MR"), users can view the configurations of cluster services.

Procedure

1.      Log in to the YI-MapReduce management console.

2.      Click on My Cluster and choose a running cluster to enter the cluster information page.

3.      Click the YI-MapReduce Manager tab, and then select Go to YI-MapReduce Manager.

4.      Once in the YI-MapReduce Manager, click O&M and Configuration> Configuration Management on the menu.

5.      Choose the specific cluster service in the query conditions to view the associated configurations of that cluster service. As shown in the figure:

        

Manage Services

On YI-MapReduce (or ""YI-MR"), users can perform the following operations:

        Start Cluster Service

        Stop Cluster Service

Procedure

1.      Log in to the YI-MapReduce management console.

2.      Click on My Cluster and choose a running cluster to enter the cluster information page.

3.      Click the YI-MapReduce Manager tab, and then select Go to  YI-MapReduce Manager.

4.      On the  YI-MapReduce Manager interface, click the Cluster Service menu.

5.      Choose the specific cluster service. Click on the cluster service icon to enter the cluster service details page.

6.      Click on the O&M Operations button, then on Start Cluster Service, Stop Cluster Service, or Roll-restart Cluster Service to perform the corresponding operations. There are dependencies between cluster services. When performing start, stop, rolling restart operations on a certain cluster service, services that have dependencies on this cluster service will be affected. The specific impacts are as follows:

a.   When starting a certain cluster service, the lower-level cluster services that it depends on must first be started for the cluster service to function effectively.

b.  When stopping a certain cluster service, the upper-level cluster services that depend on it will not be able to provide functions.

c.   When rolling restart a certain cluster service, the upper-level cluster services that depend on it and are started need to be restarted to take effect.

Configure Service Parameters

On YI-MapReduce (or " YI-MR"), users can view and modify the default configurations of cluster services easily according to actual business scenarios.

Steps to Modify Cluster Service Configurations

1.      Log in to the  YI-MapReduce management console.

2.      Click on My Cluster and choose a running cluster to enter the cluster information page.

3.      Click the  YI-MapReduce Manager tab, and then select Go to  YI-MapReduce Manager.

4.      On the  YI-MapReduce Manager interface, click the Cluster Service menu.

5.      Choose the specific cluster service. Click on the cluster service icon to enter the cluster service details page.

6.      Click the Configuration Management tab, select the configuration file to be modified, make the necessary changes, and then click the Save Changes button at the bottom right corner.

        

7.      Click the Sync button to synchronize the modified configuration file.

8.      Once the configuration sync is complete, re-enter the service details page.

9.      Click on O&M Operations, then click Roll-restart Cluster. The modified configurations take effect after the cluster service restarts.

Sync Service Configurations

Scenario

If some cluster services have configuration files that are pending synchronization, you can use the configuration synchronization feature to carry out this task.

Impact on System

Once the cluster service configuration is synchronized, a rolling restart of this configuration is necessary for the changes to take effect. During the restart, the relevant cluster service is temporarily unavailable.

Procedure

1.      Log in to the  YI-MapReduce management console.

2.      Click on My Cluster and choose a running cluster to enter the cluster information page.

3.      Click the YI-MapReduce Manager tab, and then select Go to YI-MapReduce Manager.

4.      On the YI-MapReduce Manager interface, click the Cluster Service menu.

5.      Choose the specific cluster service. Click on the cluster service icon to enter the cluster service details page.

6.      Click the Configuration Management tab.

7.      Click the Sync button to synchronize the configuration file pending synchronization.

8.      Once the configuration sync is complete, re-enter the service details page.

9.      Click on O&M Operations, then click Roll-restart Cluster. The modified configurations take effect after the cluster service restarts.

Manage Role Instances

On YI-MapReduce (or "MapReduce"), users can perform the following operations on specific role instances:

        Start Instance

        Stop Instance

        Restart Instance

        Set Maintenance

        Cancel Maintenance

Procedure

1.      Log in to the YI-MapReduce management console.

2.      Click on My Cluster and choose a running cluster to enter the cluster information page.

3.      Click the YI-MapReduce Manager tab, and then select Go to YI-MapReduce Manager.

4.      On the YI-MapReduce Manager interface, click the Cluster Service menu.

5.      Choose the specific cluster service. Click on the cluster service icon to enter the cluster service details page.

6.      Click on the Role Instance tab.

7.      Check the box in front of the role instance that requires operation.

8.      Click Operate on Selected, and then click Start Instance, Stop Instance, Restart Instance, Roll-stop Instance, Roll-restart Instance, Set Maintenance, or Cancel Maintenance to execute the corresponding operation.

        

Start and Stop Cluster

A cluster is a set of service components. Users can start or stop all services within the cluster.

Start and Stop Cluster

1.      Log in to the YI-MapReduce management console.

2.      Click on My Cluster and choose a running cluster to enter the cluster information page.

3.      Click the YI-MapReduce Manager tab, and then select Go to YI-MapReduce Manager.

4.      On the YI-MapReduce Manager interface, click the Cluster Service menu.

5.      Click More Operations, then choose either Start All Cluster Services or Stop All Cluster Services to execute the corresponding operation.

Download Cluster Configurations

Scenario

To meet practical business needs, you can download configuration files to quickly update the configurations of cluster services.

Procedure

1.      Log in to the YI-MapReduce management console.

2.      Click on My Cluster and choose a running cluster to enter the cluster information page.

3.      Click the YI-MapReduce Manager tab, and then select Go to YI-MapReduce Manager.

4.      On the YI-MapReduce Manager interface, click the Cluster Service menu.

5.      Choose the specific cluster service. Click on the cluster service icon to enter the cluster service details page.

6.      Click the Configuration Management tab.

7.      Choose and click on the name of the configuration file to download. Click the Download button to proceed.


SbQBDtLCRzzE