Log lines that I have been unable to find anything on that indicate error:
2011-12-22T22:27:35.302-05:00 [04848 verbose 'DrTask' opID=FEA28620-00000023] Created VC task 'com.vmware.vcDr.dr.replication.ReplicationManager.createProtectionGroup:task-2311'
2011-12-22T22:27:35.302-05:00 [00284 warning 'DrTask' opID=FEA28620-00000023] Failed to create 'com.vmware.vcDr.dr.replication.ReplicationManager.createProtectionGroup' task in VC: (dr.fault.ConnectionDownFault) {
What I beleive to be all the relevant log data on this job:
2011-12-22T22:27:35.177-05:00 [02304 verbose 'Replication' opID=FEA28620-00000023] Starting internal API method for Replication Manager 'DrReplicationManager': Dr::Replication::VmomiLayer::ReplicationManagerImpl::CreateProtectionGroup
2011-12-22T22:27:35.177-05:00 [02304 verbose 'StorageProvider' opID=FEA28620-00000023] CreateGroupCheckPrivilege: 'BOSNATop1_Rep_DS01',
[#1] --> (dr.storageProvider.GroupSettings) {
[#1] --> dynamicType = <unset>,
[#1] --> array = 'dr.storage.ReplicatedArrayPair:array-pair-4041',
[#1] --> datastore = (vim.Datastore) [
[#1] --> 'vim.Datastore:datastore-37'
[#1] --> ],
[#1] --> }
2011-12-22T22:27:35.177-05:00 [02304 verbose 'LocalVC' opID=FEA28620-00000023] [AuthorizationDomain] Processing '1' privilege queries.
2011-12-22T22:27:35.177-05:00 [02304 verbose 'LocalVC' opID=FEA28620-00000023] [AuthorizationDomain] Fetching managed entities on which to check priveleges
2011-12-22T22:27:35.177-05:00 [02304 info 'DrTask' opID=FEA28620-00000023] Starting task 'dr.replication.ReplicationManager.createProtectionGroup14'
2011-12-22T22:27:35.177-05:00 [05208 verbose 'DrTask' opID=FEA28620-00000023] Starting VC task 'com.vmware.vcDr.dr.replication.ReplicationManager.createProtectionGroup'
2011-12-22T22:27:35.177-05:00 [02304 verbose 'PropertyProvider' opID=FEA28620-00000023] RecordOp ASSIGN: info.progress, dr.replication.ReplicationManager.createProtectionGroup14
2011-12-22T22:27:35.177-05:00 [05208 verbose 'DrTask' opID=FEA28620-00000023] Starting VC task 'com.vmware.vcDr.dr.replication.ReplicationManager.createProtectionGroup'
2011-12-22T22:27:35.224-05:00 [04848 verbose 'LocalVC' opID=FEA28620-00000023] [AuthorizationDomain] Processing effective roles of managed entities to validate privileges.
2011-12-22T22:27:35.224-05:00 [04848 verbose 'PropertyProvider' opID=FEA28620-00000023] RecordOp ASSIGN: info.progress, dr.replication.ReplicationManager.createProtectionGroup14
2011-12-22T22:27:35.224-05:00 [04848 info 'MultiSiteOperationManager' opID=FEA28620-00000023] Starting multi-site operation 'dr.replication.createProtectionGroup', tag ''
2011-12-22T22:27:35.224-05:00 [04848 verbose 'MultiSiteOperationManager' opID=FEA28620-00000023] Multi-site operation coordinator 'coordinator-7022' created
2011-12-22T22:27:35.224-05:00 [04848 verbose 'PropertyProvider' opID=FEA28620-00000023] RecordOp ADD: coordinator["coordinator-7022"], MultiSiteOperationManager
2011-12-22T22:27:35.224-05:00 [04848 verbose 'MultiSiteOperationManager' opID=FEA28620-00000023] Cohort 'cohort-7023' created associated with coordinator 'coordinator-7022' on site 'bd49c809-ae35-4323-b3b1-d65fa5d89669'
2011-12-22T22:27:35.224-05:00 [04848 verbose 'PropertyProvider' opID=FEA28620-00000023] RecordOp ADD: cohort["cohort-7023"], MultiSiteOperationManager
2011-12-22T22:27:35.286-05:00 [04108 verbose 'PropertyProvider'] RecordOp ASSIGN: info.progress, dr.replication.ReplicationManager.createProtectionGroup14
2011-12-22T22:27:35.286-05:00 [04108 verbose 'RemoteDR' ctxID=769b8d07 opID=FEA28620-00000023] [PCM] Using token '6' for pending filter creation
2011-12-22T22:27:35.286-05:00 [04108 verbose 'PropertyProvider' ctxID=769b8d07 opID=FEA28620-00000023] RecordOp ASSIGN: prepare, coordinator-7022
2011-12-22T22:27:35.286-05:00 [04108 verbose 'PropertyProvider' ctxID=769b8d07 opID=FEA28620-00000023] RecordOp ASSIGN: prepareData, coordinator-7022
2011-12-22T22:27:35.286-05:00 [04108 verbose 'PerformanceMonitor' ctxID=7c7599a1 opID=FEA28620-00000023] Performance monitor Token 0 of lock PersistableRWLock-1009 begin.
2011-12-22T22:27:35.286-05:00 [04108 verbose 'PersistableRWLock' ctxID=7c7599a1 opID=FEA28620-00000023] Lock PersistableRWLock-1009' obtained for Read
2011-12-22T22:27:35.286-05:00 [04108 verbose 'Replication' opID=FEA28620-00000023] Adding reservation for group 'BOSNATop1_Rep_DS01' in folder '[dr.Folder:DrReplicationRootFolder]'
2011-12-22T22:27:35.286-05:00 [04108 verbose 'Default' opID=FEA28620-00000023] Reservation made for addition of key BOSNATop1_Rep_DS01
2011-12-22T22:27:35.286-05:00 [04108 info 'Replication' opID=FEA28620-00000023] Preparing the provider for the CreateProtectionGroup operation for group protection-group-7024.
2011-12-22T22:27:35.286-05:00 [04108 verbose 'StorageProvider' opID=FEA28620-00000023] CreateGroupPrepare: 'protection-group-7024', 'BOSNATop1_Rep_DS01'
--> (dr.storageProvider.GroupSettings) {
--> dynamicType = <unset>,
--> array = 'dr.storage.ReplicatedArrayPair:array-pair-4041',
--> datastore = (vim.Datastore) [
--> 'vim.Datastore:datastore-37'
--> ],
--> }
2011-12-22T22:27:35.286-05:00 [04108 verbose 'PerformanceMonitor' opID=FEA28620-00000023] Performance monitor Token 0 of lock PersistableRWLock-7004 begin.
2011-12-22T22:27:35.286-05:00 [04108 verbose 'PersistableRWLock' opID=FEA28620-00000023] Lock PersistableRWLock-7004' obtained for Read
2011-12-22T22:27:35.302-05:00 [04228 verbose 'Storage' opID=FEA28620-00000023] Acquiring read op lock on 'array-pair-4041'
2011-12-22T22:27:35.302-05:00 [04228 verbose 'PerformanceMonitor' opID=FEA28620-00000023] Performance monitor Token 0 of lock PersistableRWLock-4042 begin.
2011-12-22T22:27:35.302-05:00 [04228 verbose 'PersistableRWLock' opID=FEA28620-00000023] Lock PersistableRWLock-4042' obtained for Read
2011-12-22T22:27:35.302-05:00 [04228 verbose 'Storage' opID=FEA28620-00000023] Acquired read op lock on 'array-pair-4041'
2011-12-22T22:27:35.302-05:00 [04228 verbose 'Storage' opID=FEA28620-00000023] Added dependent 'protection-group-7024' to array pair 'array-pair-4041'
2011-12-22T22:27:35.302-05:00 [04228 verbose 'Storage' opID=FEA28620-00000023] Releasing read op lock on 'array-pair-4041'
2011-12-22T22:27:35.302-05:00 [04228 verbose 'PerformanceMonitor' opID=FEA28620-00000023] Performance monitor Token 0 of lock PersistableRWLock-4042. 'Locked' took 0 seconds
2011-12-22T22:27:35.302-05:00 [04228 verbose 'PersistableRWLock' opID=FEA28620-00000023] Releasing Read lock 'PersistableRWLock-4042'
2011-12-22T22:27:35.302-05:00 [04228 verbose 'PerformanceMonitor' opID=FEA28620-00000023] Performance monitor Token 0 of lock PersistableRWLock-7004. 'Locked' took 0.016 seconds
2011-12-22T22:27:35.302-05:00 [04228 verbose 'PersistableRWLock' opID=FEA28620-00000023] Releasing Read lock 'PersistableRWLock-7004'
2011-12-22T22:27:35.302-05:00 [04228 verbose 'PersistableRWLock'] Destroying NON persisted released token 0 of lock PersistableRWLock-4042
2011-12-22T22:27:35.302-05:00 [04228 verbose 'PersistableRWLock'] Destroying NON persisted released token 0 of lock PersistableRWLock-7004
2011-12-22T22:27:35.302-05:00 [04228 verbose 'Replication' opID=FEA28620-00000023] The provider successfully prepared for the CreateProtectionGroupoperation for group protection-group-7024.
2011-12-22T22:27:35.302-05:00 [04228 verbose 'Replication' opID=FEA28620-00000023] Persisting the prepare phase results in provider for creation of group protection-group-7024
2011-12-22T22:27:35.302-05:00 [04228 verbose 'StorageProvider' opID=FEA28620-00000023] CreateGroupPreparePersist: 'protection-group-7024', 'BOSNATop1_Rep_DS01'
--> (dr.storageProvider.GroupSettings) {
--> dynamicType = <unset>,
--> array = 'dr.storage.ReplicatedArrayPair:array-pair-4041',
--> datastore = (vim.Datastore) [
--> 'vim.Datastore:datastore-37'
--> ],
--> }
2011-12-22T22:27:35.302-05:00 [04848 verbose 'DrTask' opID=FEA28620-00000023] Created VC task 'com.vmware.vcDr.dr.replication.ReplicationManager.createProtectionGroup:task-2311'
2011-12-22T22:27:35.302-05:00 [00284 warning 'DrTask' opID=FEA28620-00000023] Failed to create 'com.vmware.vcDr.dr.replication.ReplicationManager.createProtectionGroup' task in VC: (dr.fault.ConnectionDownFault) {
--> dynamicType = <unset>,
--> faultCause = (vmodl.MethodFault) null,
--> msg = "",
--> }
2011-12-22T22:27:35.302-05:00 [00284 warning 'DrTask' opID=FEA28620-00000023] Ignoring SetProgress because task does not exist
2011-12-22T22:27:35.302-05:00 [00284 warning 'DrTask' opID=FEA28620-00000023] Ignoring SetProgress because task does not exist
2011-12-22T22:27:35.302-05:00 [00284 warning 'DrTask'] Ignoring SetProgress because task does not exist
2011-12-22T22:27:35.317-05:00 [04228 verbose 'StorageProvider' opID=FEA28620-00000023] Created AcquiredDatastores DB object '7025' for local site.
2011-12-22T22:27:35.317-05:00 [04228 verbose 'StorageProvider' opID=FEA28620-00000023] Created ProtectionGroupInProgress DB object '7027' for ProtectionGroup 'protection-group-7024' and ReplicatedArrayPair 'array-pair-4041'.
2011-12-22T22:27:35.317-05:00 [04228 verbose 'Replication' opID=FEA28620-00000023] Persisting new group reservation for group protection-group-7024
2011-12-22T22:27:35.349-05:00 [04228 verbose 'Replication' opID=FEA28620-00000023] Persisting folder reservation for group protection-group-7024
2011-12-22T22:27:35.349-05:00 [04228 verbose 'Replication' opID=FEA28620-00000023] Committing the prepare phase database transaction for creation of group protection-group-7024
2011-12-22T22:27:35.380-05:00 [04228 verbose 'Replication' opID=FEA28620-00000023] Completing the prepare phase results in provider for creation of group protection-group-7024
2011-12-22T22:27:35.380-05:00 [04228 verbose 'StorageProvider' opID=FEA28620-00000023] CreateGroupPrepareComplete
2011-12-22T22:27:35.380-05:00 [04228 verbose 'PerformanceMonitor' opID=FEA28620-00000023] Performance monitor Token 0 of lock PersistableRWLock-1009. 'Locked' took 0.094 seconds
2011-12-22T22:27:35.380-05:00 [04228 verbose 'PersistableRWLock' opID=FEA28620-00000023] Releasing Read lock 'PersistableRWLock-1009'
2011-12-22T22:27:35.380-05:00 [04228 verbose 'PersistableRWLock'] Destroying NON persisted released token 0 of lock PersistableRWLock-1009
2011-12-22T22:27:35.380-05:00 [05224 verbose 'PropertyProvider' ctxID=7c7599a1 opID=FEA28620-00000023] RecordOp ASSIGN: vote, cohort-7023
2011-12-22T22:27:35.380-05:00 [05224 verbose 'PropertyProvider' ctxID=7c7599a1 opID=FEA28620-00000023] RecordOp ASSIGN: prepareData, cohort-7023
2011-12-22T22:27:35.380-05:00 [04228 verbose 'PropertyProvider' ctxID=769b8d07 opID=FEA28620-00000023] RecordOp ASSIGN: info.progress, dr.replication.ReplicationManager.createProtectionGroup14
2011-12-22T22:27:35.380-05:00 [05052 warning 'DrTask' opID=FEA28620-00000023] Ignoring SetProgress because task does not exist