CloudConnect Optimizer Debug

book

Article ID: 100039150

calendar_today

Updated On:

Description

Debug Workflow for CCO (CloudConnect Optimizer)

Select Beserver in SGmon. It collects basic information related to the CCO job. The highlighted  text implies important debug messages one should look for while troubleshooting CCO. Once the job is ready to run, beserver firsts check the currently active CCO jobs, backup jobs and devices it targets. Based on this, it decides whether to run CCO, or fail. 
 
BESERVER: [06/19/17 05:04:12] [7292]     -1 CURRENTLY ACTIVE JOBS : 1
 
BESERVER: [06/19/17 05:04:12] [7292]     -1 Run Cloud Connection Advisor job - start
BESERVER: [06/19/17 05:04:12] [6160]     -1 ActiveState::doStatusEvent('CCO job'): JobStatus=16 OperationStatus=56 EngineStatus=0 ActiveResourceContainerID=00000000-0000-0000-0000-000000000000 AbortStatus=0
BESERVER: [06/19/17 05:04:12] [7292]     -1 Initial Write Connections for CCA job = 198
BESERVER: [06/19/17 05:04:12] [7292]     -1 Apply Settings Automatically = 1
BESERVER: [06/19/17 05:04:12] [7292]     -1 Server = S3:amazon:amazon.com, LSU = zarana-bucket


The DLL goes through cloudInstamce.xml and figures out the provider and the min-max connection range for the same BESERVER: [06/19/17 05:04:12] [12620]     -1 CUtilityJobThread::UpdateCloudOptimizerStatus:
 
MSG ID : 0x2001 : OSTSession::GetSuggestedNumberOfConnections(): Entry
BESERVER: [06/19/17 05:04:13] [12620]     -1 CUtilityJobThread::UpdateCloudOptimizerStatus - MSG ID : 0x2001 : testGetAllCloudProvider error messages: STSOBJECT: STS Debug: session (STS-I): 'IndependentCsscClient::GetAll : Enter'
 
    STSOBJECT: STS Debug: session (STS-I): 'IndependentCsscClient::GetAll : Leave'
BESERVER: [06/19/17 05:04:13] [12620]     -1 CUtilityJobThread::UpdateCloudOptimizerStatus - MSG ID : 0x2001 : testGetAllCloudProvider returned: 2060005
BESERVER: [06/19/17 05:04:13] [12620]     -1 CUtilityJobThread::UpdateCloudOptimizerStatus - MSG ID : 0x2001 : size expected: 8
BESERVER: [06/19/17 05:04:13] [12620]     -1 CUtilityJobThread::UpdateCloudOptimizerStatus - MSG ID : 0x2001 : testGetAllCloudProvider returned: 0
BESERVER: [06/19/17 05:04:13] [12620]     -1 CUtilityJobThread::UpdateCloudOptimizerStatus - MSG ID : 0x2001 : Provider: 1
BESERVER: [06/19/17 05:04:13] [12620]     -1 CUtilityJobThread::UpdateCloudOptimizerStatus - MSG ID : 0x2001 : Provider Name: Amazon
BESERVER: [06/19/17 05:04:13] [12620]     -1 CUtilityJobThread::UpdateCloudOptimizerStatus - MSG ID : 0x2001 : Portal URL: https://console.aws.amazon.com/s3/home
BESERVER: [06/19/17 05:04:13] [12620]     -1 CUtilityJobThread::UpdateCloudOptimizerStatus - MSG ID : 0x2001 : Provider Id: 701299968
BESERVER: [06/19/17 05:04:13] [12620]     -1 CUtilityJobThread::UpdateCloudOptimizerStatus - MSG ID : 0x2001 : Min write Connections : 1
BESERVER: [06/19/17 05:04:13] [12620]     -1 CUtilityJobThread::UpdateCloudOptimizerStatus - MSG ID : 0x2001 : Max write Connections : 1024
BESERVER: [06/19/17 05:04:13] [12620]     -1 CUtilityJobThread::UpdateCloudOptimizerStatus - MSG ID : 0x2001 : Chunk Size : 1048576
BESERVER: [06/19/17 05:04:13] [12620]     -1 CUtilityJobThread::UpdateCloudOptimizerStatus - MSG ID : 0x2001 : Found provider match. Setting min and max connection values


The excerpt shows the starting of the test execution. For this, the job provider is Amazon. It starts the test with 1024 because the maximum write connection value for Amazon is 1024. It updates xml. Hence, it is better when the CCO job is running if no backup job is running as it may happen to use these test connections value.
 
BESERVER: [06/19/17 05:04:13] [12620]     -1 CUtilityJobThread::UpdateCloudOptimizerStatus - MSG ID : 0x2001 : Executing test for connection number : 1024
BESERVER: [06/19/17 05:04:13] [12620]     -1 CUtilityJobThread::UpdateCloudOptimizerStatus - MSG ID : 0x2001 : Successfully created lock file.
BESERVER: [06/19/17 05:04:13] [12620]     -1 CUtilityJobThread::UpdateCloudOptimizerStatus - MSG ID : 0x2001 : CloudInstance.xml update successful.



The DLL generates data and starts writing to the OST image.
 
BESERVER: [06/19/17 05:04:28] [12620]     -1 CUtilityJobThread::UpdateCloudOptimizerStatus - MSG ID : 0x2001 : sts_create_image "CloudConnAdv_1497873859", err=0
BESERVER: [06/19/17 05:04:28] [12620]     -1 CUtilityJobThread::UpdateCloudOptimizerStatus - MSG ID : 0x2001 : In Use Buffers : 1
BESERVER: [06/19/17 05:04:28] [12620]     -1 CUtilityJobThread::UpdateCloudOptimizerStatus - MSG ID : 0x2001 : sts_write_image err=0, byteswritten=1048576
BESERVER: [06/19/17 05:04:28] [12620]     -1 CUtilityJobThread::UpdateCloudOptimizerStatus - MSG ID : 0x2001 : In Use Buffers : 2
BESERVER: [06/19/17 05:04:28] [12620]     -1 CUtilityJobThread::UpdateCloudOptimizerStatus - MSG ID : 0x2001 : sts_write_image err=0, byteswritten=1048576
BESERVER: [06/19/17 05:04:28] [12620]     -1 CUtilityJobThread::UpdateCloudOptimizerStatus - MSG ID : 0x2001 : In Use Buffers : 3
BESERVER: [06/19/17 05:04:28] [12620]     -1 CUtilityJobThread::UpdateCloudOptimizerStatus - MSG ID : 0x2001 : sts_write_image err=0, byteswritten=1048576
BESERVER: [06/19/17 05:04:28] [12620]     -1 CUtilityJobThread::UpdateCloudOptimizerStatus - MSG ID : 0x2001 : In Use Buffers : 4
BESERVER: [06/19/17 05:08:35] [12620]     -1 CUtilityJobThread::UpdateCloudOptimizerStatus - MSG ID : 0x2001 : Closing Image



The DLL executes a number of tests and finally comes up with the suggested value. Once done with tests, it deletes the OST image created. It logs all the write connections values and corresponding throughput. The Server sends a VSN to update the default settings.
 
BESERVER: [06/19/17 05:08:56] [12620]     -1 CUtilityJobThread::UpdateCloudOptimizerStatus - MSG ID : 0x2001 : ExecuteTestForOneConn: NumConns : 96
 CUtilityJobThread::UpdateCloudOptimizerStatus - MSG ID : 0x2001 : sts_delete_image "CloudConnAdv_1497874068", err=0 
 BESERVER: [06/19/17 05:09:32] [7292]     -1 DISPLYING DATA IN VECTOR : 
 BESERVER: [06/19/17 05:09:32] [7292]     -1 NUMBER OF CONN : 153 
 BESERVER: [06/19/17 05:09:32] [7292]     -1 DATA RATE : 13.26 MB/sec 
 BESERVER: [06/19/17 05:09:32] [7292]     -1 NUMBER OF CONN : 64 
 BESERVER: [06/19/17 05:09:32] [7292]     -1 DATA RATE : 7.53 MB/sec 
 BESERVER: [06/19/17 05:09:32] [7292]     -1 NUMBER OF CONN : 96 
 BESERVER: [06/19/17 05:09:32] [7292]     -1 DATA RATE : 8.07 MB/sec 
 BESERVER: [06/19/17 05:09:32] [7292]     -1 Cloud Connection Advisor suggested 153 as optimal number of write connections 
 BESERVER: [06/19/17 05:09:32] [7292]     -1 Cloud Connection Advisor updated suggested Write Connections value in xml, sent VSN to management 
 BESERVER: [06/19/17 05:09:32] [7292]     -1 Run Cloud Connection Advisor job - end 
 Cloud Connection Advisor suggested 153 as optimal number of write connections 
 BESERVER: [06/19/17 05:09:32] [7292]     -1 Cloud Connection Advisor updated suggested Write Connections value in xml, sent VSN to management 
 

Issue/Introduction

CloudConnect Optimizer Debug