vSphere advanced capabilities with datastore support and api improvements by harikrishna-patnala · Pull Request #4248 · apache/cloudstack

harikrishna-patnala · 2020-08-06T07:40:38Z

Description

Added support for different datastore types like vSAN, vVols, VMFS6, Datastore clusters. Along with these native APIs of vCenter have been used.

Types of changes

Breaking change (fix or feature that would cause existing functionality to change)
New feature (non-breaking change which adds functionality)
Bug fix (non-breaking change which fixes an issue)
Enhancement (improves an existing feature and functionality)
Cleanup (Code refactoring and cleanup, that may add test cases)

Screenshots (if appropriate):

How Has This Been Tested?

harikrishna-patnala · 2020-08-06T16:38:35Z

@blueorangutan package

blueorangutan · 2020-08-06T16:40:02Z

@harikrishna-patnala a Jenkins job has been kicked to build packages. I'll keep you posted as I make progress.

blueorangutan · 2020-08-06T17:15:33Z

Packaging result: ✔centos7 ✔debian. JID-1667

harikrishna-patnala · 2020-08-06T18:01:04Z

@blueorangutan test

blueorangutan · 2020-08-06T18:02:02Z

@harikrishna-patnala a Trillian-Jenkins test job (centos7 mgmt + kvm-centos7) has been kicked to run smoke tests

yadvr · 2020-08-07T07:38:56Z

@harikrishna-patnala most of the tests are failing for travis/simulator hinting at general failures - can you have a look at simulator failures and manually test vm lifecycle before pushing trillian to work (which takes hours)?

yadvr · 2020-08-07T07:44:13Z

@blueorangutan package

blueorangutan · 2020-08-07T07:44:57Z

@rhtyd a Jenkins job has been kicked to build packages. I'll keep you posted as I make progress.

harikrishna-patnala · 2020-08-07T08:15:01Z

Sure @rhtyd I'll check simulator failures

blueorangutan · 2020-08-07T08:25:02Z

Packaging result: ✔centos7 ✔debian. JID-1671

yadvr · 2020-08-07T08:28:33Z

@blueorangutan test

blueorangutan · 2020-08-07T08:30:02Z

@rhtyd a Trillian-Jenkins test job (centos7 mgmt + kvm-centos7) has been kicked to run smoke tests

yadvr · 2020-08-07T08:33:50Z

@harikrishna-patnala when deploying zone (with simulator) this fails with:

Exception Occurred: ['Traceback (most recent call last):\n', '  File "tools/marvin/marvin/deployDataCenter.py", line 280, in createPrimaryStorages\n    ret = self.__apiClient.createStoragePool(primarycmd)\n', '  File "/usr/local/lib/python2.7/dist-packages/marvin/cloudstackAPI/cloudstackAPIClient.py", line 3364, in createStoragePool\n    response = self.connection.marvinRequest(command, response_type=response, method=method)\n', '  File "/usr/local/lib/python2.7/dist-packages/marvin/cloudstackConnection.py", line 379, in marvinRequest\n    raise e\n', 'CloudstackAPIException: Execute cmd: createstoragepool failed, due to: errorCode: 530, errorText:Failed to add data store: Failed to access storage pool\n']

2020-08-07 14:01:28,340 WARN  [o.a.c.s.d.l.CloudStackPrimaryDataStoreLifeCycleImpl] (ApiServer-8:ctx-c2e3faa6 ctx-b78205c4) (logid:163a78d3) Unable to establish a connection between Host[-2-Routing] and org.apache.cloudstack.storage.datastore.PrimaryDataStoreImpl@19656adf
java.lang.NullPointerException
	at org.apache.cloudstack.storage.datastore.provider.DefaultHostListener.hostConnect(DefaultHostListener.java:106)
	at com.cloud.storage.StorageManagerImpl.connectHostToSharedPool(StorageManagerImpl.java:1027)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:566)
	at org.springframework.aop.support.AopUtils.invokeJoinpointUs

yadvr · 2020-08-08T19:33:51Z

@blueorangutan test matrix

blueorangutan · 2020-08-08T19:34:56Z

@rhtyd a Trillian-Jenkins matrix job (centos7 mgmt + xs71, centos7 mgmt + vmware67, centos7 mgmt + kvmcentos7) has been kicked to run smoke tests

yadvr · 2020-08-09T15:50:41Z

@blueorangutan package

blueorangutan · 2020-08-09T15:51:57Z

@rhtyd a Jenkins job has been kicked to build packages. I'll keep you posted as I make progress.

blueorangutan · 2020-08-09T16:29:31Z

Packaging result: ✖centos7 ✔debian. JID-1683

yadvr · 2020-08-09T17:21:08Z

re-kicked centos7 pkg manually

harikrishna-patnala · 2020-08-09T17:21:42Z

re-kicked centos7 pkg manually

Thanks @rhtyd

yadvr · 2020-08-09T18:04:43Z

@blueorangutan test matrix

blueorangutan · 2020-08-09T18:06:13Z

@rhtyd a Trillian-Jenkins matrix job (centos7 mgmt + xs71, centos7 mgmt + vmware67, centos7 mgmt + kvmcentos7) has been kicked to run smoke tests

yadvr · 2020-08-10T03:40:59Z

@blueorangutan package

blueorangutan · 2020-08-10T03:41:57Z

@rhtyd a Jenkins job has been kicked to build packages. I'll keep you posted as I make progress.

blueorangutan · 2020-08-10T04:28:30Z

Packaging result: ✔centos7 ✔debian. JID-1686

blueorangutan · 2020-08-28T04:58:54Z

@harikrishna-patnala a Jenkins job has been kicked to build packages. I'll keep you posted as I make progress.

blueorangutan · 2020-08-28T05:30:55Z

Packaging result: ✔centos7 ✔centos8 ✔debian. JID-1832

yadvr · 2020-08-29T09:31:24Z

@blueorangutan test matrix

blueorangutan · 2020-08-29T09:31:54Z

@rhtyd a Trillian-Jenkins matrix job (centos7 mgmt + xs71, centos7 mgmt + vmware67, centos7 mgmt + kvmcentos7) has been kicked to run smoke tests

davidjumani · 2020-09-01T05:52:52Z

@blueorangutan package

blueorangutan · 2020-09-01T05:54:11Z

@davidjumani a Jenkins job has been kicked to build packages. I'll keep you posted as I make progress.

blueorangutan · 2020-09-01T06:26:58Z

Packaging result: ✔centos7 ✔centos8 ✔debian. JID-1858

harikrishna-patnala · 2020-09-01T06:46:59Z

@blueorangutan test centos7 vmware-67u3

blueorangutan · 2020-09-01T06:48:06Z

@harikrishna-patnala a Trillian-Jenkins test job (centos7 mgmt + vmware-67u3) has been kicked to run smoke tests

yadvr · 2020-09-03T20:31:20Z

@blueorangutan test centos7 vmware-67u3

blueorangutan · 2020-09-04T05:00:16Z

@rhtyd a Trillian-Jenkins test job (centos7 mgmt + vmware-67u3) has been kicked to run smoke tests

yadvr · 2020-09-05T14:30:22Z

@blueorangutan package

blueorangutan · 2020-09-05T14:31:15Z

@rhtyd a Jenkins job has been kicked to build packages. I'll keep you posted as I make progress.

blueorangutan · 2020-09-05T15:27:59Z

Packaging result: ✔centos7 ✔centos8 ✔debian. JID-1895

yadvr · 2020-09-05T15:53:50Z

@blueorangutan test matrix

blueorangutan · 2020-09-05T15:54:38Z

@rhtyd a Trillian-Jenkins matrix job (centos7 mgmt + xs71, centos7 mgmt + vmware67, centos7 mgmt + kvmcentos7) has been kicked to run smoke tests

blueorangutan · 2020-09-06T11:39:31Z

Trillian test result (tid-2672)
Environment: xenserver-71 (x2), Advanced Networking with Mgmt server 7
Total time taken: 57275 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr4248-t2672-xenserver-71.zip
Intermittent failure detected: /marvin/tests/smoke/test_iso.py
Intermittent failure detected: /marvin/tests/smoke/test_kubernetes_clusters.py
Intermittent failure detected: /marvin/tests/smoke/test_kubernetes_supported_versions.py
Intermittent failure detected: /marvin/tests/smoke/test_scale_vm.py
Smoke tests completed. 83 look OK, 2 have error(s)
Only failed tests results shown below:

Test	Result	Time (s)	Test File
test_01_add_delete_kubernetes_supported_version	`Error`	1807.09	test_kubernetes_supported_versions.py
test_01_scale_vm	`Failure`	35.63	test_scale_vm.py

blueorangutan · 2020-09-06T18:12:30Z

Trillian test result (tid-2677)
Environment: kvm-centos7 (x2), Advanced Networking with Mgmt server 7
Total time taken: 43686 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr4248-t2677-kvm-centos7.zip
Intermittent failure detected: /marvin/tests/smoke/test_vpc_redundant.py
Intermittent failure detected: /marvin/tests/smoke/test_hostha_kvm.py
Smoke tests completed. 83 look OK, 2 have error(s)
Only failed tests results shown below:

Test	Result	Time (s)	Test File
test_01_create_redundant_VPC_2tiers_4VMs_4IPs_4PF_ACL	`Failure`	424.53	test_vpc_redundant.py
test_03_create_redundant_VPC_1tier_2VMs_2IPs_2PF_ACL_reboot_routers	`Error`	332.95	test_vpc_redundant.py
test_04_rvpc_network_garbage_collector_nics	`Error`	3907.24	test_vpc_redundant.py
test_hostha_kvm_host_fencing	`Error`	166.73	test_hostha_kvm.py

yadvr · 2020-09-07T19:55:10Z

@harikrishna-patnala can you review and close this PR and continue work over #4307 thnx

blueorangutan · 2020-09-07T20:21:03Z

Trillian test result (tid-2679)
Environment: kvm-centos7 (x2), Advanced Networking with Mgmt server 7
Total time taken: 54350 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr4248-t2679-kvm-centos7.zip
Intermittent failure detected: /marvin/tests/smoke/test_diagnostics.py
Intermittent failure detected: /marvin/tests/smoke/test_internal_lb.py
Intermittent failure detected: /marvin/tests/smoke/test_projects.py
Intermittent failure detected: /marvin/tests/smoke/test_volumes.py
Intermittent failure detected: /marvin/tests/smoke/test_vpc_redundant.py
Intermittent failure detected: /marvin/tests/smoke/test_host_maintenance.py
Intermittent failure detected: /marvin/tests/smoke/test_hostha_kvm.py
Smoke tests completed. 81 look OK, 4 have error(s)
Only failed tests results shown below:

Test	Result	Time (s)	Test File
test_03_ping_in_ssvm_success	`Failure`	14.41	test_diagnostics.py
test_05_ping_in_cpvm_success	`Failure`	14.47	test_diagnostics.py
test_04_delete_domain_with_project	`Error`	34.42	test_projects.py
test_01_create_redundant_VPC_2tiers_4VMs_4IPs_4PF_ACL	`Failure`	384.57	test_vpc_redundant.py
test_03_create_redundant_VPC_1tier_2VMs_2IPs_2PF_ACL_reboot_routers	`Error`	317.91	test_vpc_redundant.py
test_04_rvpc_network_garbage_collector_nics	`Error`	3894.39	test_vpc_redundant.py
test_hostha_kvm_host_fencing	`Error`	173.87	test_hostha_kvm.py

blueorangutan · 2020-09-07T21:36:20Z

Trillian test result (tid-2678)
Environment: vmware-67u3 (x2), Advanced Networking with Mgmt server 7
Total time taken: 58981 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr4248-t2678-vmware-67u3.zip
Intermittent failure detected: /marvin/tests/smoke/test_kubernetes_clusters.py
Intermittent failure detected: /marvin/tests/smoke/test_outofbandmanagement.py
Intermittent failure detected: /marvin/tests/smoke/test_snapshots.py
Intermittent failure detected: /marvin/tests/smoke/test_ssvm.py
Intermittent failure detected: /marvin/tests/smoke/test_vpc_redundant.py
Smoke tests completed. 77 look OK, 4 have error(s)
Only failed tests results shown below:

Test	Result	Time (s)	Test File
test_01_deploy_kubernetes_cluster	`Error`	0.21	test_kubernetes_clusters.py
test_02_deploy_kubernetes_ha_cluster	`Error`	0.10	test_kubernetes_clusters.py
test_04_deploy_and_upgrade_kubernetes_cluster	`Error`	0.16	test_kubernetes_clusters.py
test_05_deploy_and_upgrade_kubernetes_ha_cluster	`Error`	0.18	test_kubernetes_clusters.py
test_06_deploy_and_invalid_upgrade_kubernetes_cluster	`Error`	0.24	test_kubernetes_clusters.py
test_07_deploy_and_scale_kubernetes_cluster	`Error`	0.25	test_kubernetes_clusters.py
test_oobm_issue_power_cycle	`Error`	24.50	test_outofbandmanagement.py
test_oobm_issue_power_reset	`Error`	30.78	test_outofbandmanagement.py
test_02_list_snapshots_with_removed_data_store	`Error`	103.24	test_snapshots.py
test_01_create_redundant_VPC_2tiers_4VMs_4IPs_4PF_ACL	`Failure`	702.80	test_vpc_redundant.py
test_04_rvpc_network_garbage_collector_nics	`Error`	3965.36	test_vpc_redundant.py
test_04_rvpc_network_garbage_collector_nics	`Error`	3965.46	test_vpc_redundant.py
test_05_rvpc_multi_tiers	`Error`	0.07	test_vpc_redundant.py
ContextSuite context=TestVPCRedundancy>:teardown	`Error`	0.13	test_vpc_redundant.py

harikrishna-patnala · 2020-09-09T11:31:14Z

Closing this PR as this is merged with another feature on PR #4307

harikrishna-patnala added the component:vmware label Aug 6, 2020

yadvr added the Severity:Critical Critical bug label Aug 7, 2020

yadvr added this to the 4.15.0.0 milestone Aug 7, 2020

apache deleted a comment from blueorangutan Aug 9, 2020

Fix fcd from being deleted when empty

db17774

harikrishna-patnala closed this Sep 2, 2020

harikrishna-patnala reopened this Sep 2, 2020

nvazquez mentioned this pull request Sep 7, 2020

[VMware] vSphere advanced capabilities and Full OVF properties support #4307

Merged

5 tasks

harikrishna-patnala added 2 commits September 9, 2020 10:23

Added backup on fail over scenrio in case of new create disk method

e3ff0b6

vVols datastore support added

d75c9ad

harikrishna-patnala closed this Sep 9, 2020

mib1185 mentioned this pull request Jun 9, 2021

VM operation fail after storage drs in VMware datastore cluster #5091

Closed

Conversation

harikrishna-patnala commented Aug 6, 2020 • edited by yadvr Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Description

Types of changes

Screenshots (if appropriate):

How Has This Been Tested?

Uh oh!

harikrishna-patnala commented Aug 6, 2020

Uh oh!

blueorangutan commented Aug 6, 2020

Uh oh!

blueorangutan commented Aug 6, 2020

Uh oh!

harikrishna-patnala commented Aug 6, 2020

Uh oh!

blueorangutan commented Aug 6, 2020

Uh oh!

yadvr commented Aug 7, 2020

Uh oh!

yadvr commented Aug 7, 2020

Uh oh!

blueorangutan commented Aug 7, 2020

Uh oh!

harikrishna-patnala commented Aug 7, 2020

Uh oh!

blueorangutan commented Aug 7, 2020

Uh oh!

yadvr commented Aug 7, 2020

Uh oh!

blueorangutan commented Aug 7, 2020

Uh oh!

yadvr commented Aug 7, 2020 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

yadvr commented Aug 8, 2020

Uh oh!

blueorangutan commented Aug 8, 2020

Uh oh!

yadvr commented Aug 9, 2020

Uh oh!

blueorangutan commented Aug 9, 2020

Uh oh!

blueorangutan commented Aug 9, 2020

Uh oh!

yadvr commented Aug 9, 2020

Uh oh!

harikrishna-patnala commented Aug 9, 2020

Uh oh!

yadvr commented Aug 9, 2020

Uh oh!

blueorangutan commented Aug 9, 2020

Uh oh!

yadvr commented Aug 10, 2020

Uh oh!

blueorangutan commented Aug 10, 2020

Uh oh!

blueorangutan commented Aug 10, 2020

Uh oh!

blueorangutan commented Aug 28, 2020

Uh oh!

blueorangutan commented Aug 28, 2020

Uh oh!

yadvr commented Aug 29, 2020

Uh oh!

blueorangutan commented Aug 29, 2020

Uh oh!

davidjumani commented Sep 1, 2020

Uh oh!

blueorangutan commented Sep 1, 2020

Uh oh!

blueorangutan commented Sep 1, 2020

Uh oh!

harikrishna-patnala commented Sep 1, 2020

Uh oh!

blueorangutan commented Sep 1, 2020

Uh oh!

yadvr commented Sep 3, 2020

Uh oh!

blueorangutan commented Sep 4, 2020

harikrishna-patnala commented Aug 6, 2020 •

edited by yadvr

Loading

yadvr commented Aug 7, 2020 •

edited

Loading