FAQ About Using
How can I view the configuration information of the cluster?
• Once a cluster is created, click on the cluster name in the YI-MapReduce console to access the basic information page. Here, you can see the basic configuration details of the cluster, including the cluster name, creation time, payment type, cluster version, component information, VPC and security group, node instance specifications and storage, etc. The specifications and storage of the node instance determine the data analysis and processing capabilities of the cluster. The higher the node instance specifications and the more storage, the faster the cluster runs, the stronger its analysis and processing capabilities, and the higher the associated cost.
• Click to go to YI-MapReduce Manager and proceed to the O&M and Configuration page under Configuration Management. By selecting different cluster services, you can view the full configuration list information for the corresponding cluster service.
Is it necessary to shut down the Master node for an upgrade?
When upgrading the MASTER/CORE node group of the YI-MapReduce service cluster, an automatic shutdown operation will be triggered. Once the upgrade is complete, an automatic boot operation will be triggered, eliminating the need for manual intervention. However, please note that all cluster services must be stopped before the upgrade, and all cluster services should be manually restarted after the upgrade is complete.
Can installed components in the YI-MapReduce cluster be removed?
Components within an existing YI-MapReduce-2.14.1 version cluster cannot be removed. If not in use, you can log in to the cluster service page of the Manager page, locate the corresponding component, and stop it.
How do I find the path of each component configuration file?
After the cluster creation, click on the cluster name in the YI-MapReduce console to view the details. Click on YI-MapReduce Manager to enter the big data O&M management platform. Click on O&M and Configuration. Enter the Configuration Management page. Then, click on the Unfold button in the upper-right corner to view the configuration file paths for the relevant cluster services.
How do I start/stop all cluster services?
• Log in to the YI-MapReduce management console, click on My Cluster, click on the name of the specified cluster, and enter the cluster information page.
• Click on the YI-MapReduce Manager tab, click on the Cluster Service menu, and enter the cluster service list page. Click on More Operations > Start All Cluster Services or Stop All Cluster Services. After confirming the operation, start/stop all cluster services and wait for completion.
How to perform a rolling restart of cluster services?
• Log in to the YI-MapReduce management console, click on My Cluster, click on the name of the specified cluster, and enter the cluster information page.
• Click on the YI-MapReduce Manager tab, click on the Cluster Service menu, and enter the cluster service list page. Select the specific cluster service to roll-restart. Click on the cluster service name to enter the cluster service details page. Click on Operations > Roll-restart Cluster Service to access the page for the rolling restart of the cluster service. Follow the instructions for the next steps and wait for the rolling restart of the cluster service to complete.
How to view the cluster service monitoring dashboard?
• Log in to the YI-MapReduce management console, click on My Cluster, click on the name of the specified cluster, and enter the cluster information page.
• Click the YI-MapReduce Manager tab, select the Cluster Service menu, and select the cluster service you want to view. On the details page of the cluster service, click on the Cluster Dashboard tab to view the monitoring dashboard for that cluster service.
How to view all clusters?
All clusters in YI-MapReduce are displayed on the My Cluster page. This page provides a comprehensive view of all cluster information. When the number of clusters is high, they can be paginated. Clusters of any status are visible. Highlighted cluster names signify clusters operating as expected, whereas non-highlighted names denote clusters operating abnormally. The possible cluster states include:
• Starting: The deployment of the cluster is in progress, with its specific process visible.
• Running: The cluster has successfully completed deployment or renewal, and is operating as expected.
• Abnormally Terminated: The cluster has either failed to start or has been terminated due to unexpected reasons. The reasons for failure can be viewed.
• Releasing: Clusters that are in the process of being unsubscribed display a "Releasing" status.
• Terminated: Clusters that have expired for more than 15 days or where users have completed the unsubscribe process display a "Terminated" status and will be removed.
• Renewing: When a cluster is in the midst of renewal, its status displays as "Renewing".
• Frozen: Clusters that are expired but not over 15 days are kept in a "Frozen" state and will automatically unfreeze after renewal.
How to view host and component logs?
Procedure
1. Log in to the YI-MapReduce management console.
2. Select My Cluster, choose a running cluster and click on its name to enter the cluster information page.
3. Under the Node Management tab, click on the master node and select the master node to access.
4. Click on Remote Connection on the right side of the node.
5. As prompted, enter the username and password for the master node. The username is "root". The password is the one set when creating the cluster.
6. Go to the log directory of the corresponding component to view the related logs.
How to optimize cluster service configuration?
Procedure
Step 1: Modify configuration
1. Log in to the YI-MapReduce management console, click on My Cluster, click on the name of the specified cluster, and enter the cluster information page.
2. Click the YI-MapReduce Manager tab, and then select Go to YI-MapReduce Manager.
3. Upon entering the YI-MapReduce Manager, click Cluster Service on the menu to go to the cluster service list.
4. Choose the specific cluster service. Click on the cluster service name to enter the cluster service details page.
5. Click on the Configuration Management tab, select the configuration group, and choose the configuration name you want to modify. The right side of the page will display the detailed information of this configuration. Make the necessary modifications and click Save Changes when complete.
Step 2: Synchronize configuration
1. Click on the Sync button to enter the page for pending configuration synchronization.
2. Click on the Configuration Sync button to execute the configuration synchronization and access the configuration sync details page, view the synchronization progress, and wait for the sync to complete.
Step 3: Configuration takes effect
1. After the configuration synchronization is complete, return to the cluster service details page.
2. Click on O&M Operations > Roll-restart Cluster. The modified configurations take effect after the cluster service restarts.