Load balancing with DNS implicate using A records cause its impossible to have multiple CNAME records with the same name as origin. So just point the name of the OSS service to the gateways ip's. Example of clover (ciberterminal production CEPH):
CNAME