Here is the Law Lord’s decision on the Chagos Islander’s case. In the end, the Lords went with the ‘Because we said so’ argument:

“In a conquered or ceded colony the Crown, by virtue of its prerogative, has full power to establish such executive, legislative, and judicial arrangements as this Crown thinks fit.”