The VMC criteria define legally whether you have the choice to fly VFR (in the UK and Europe).

In the UK, you can only fly either VFR or IFR*.

If you are flying close to a cloud, you must be flying in IMC which logically means you must be flying IFR because the VMC criteria cannot be met.
The fact you have a cloud flying endorsement / IMC rating means you must be flying IFR whenever you are less than the legal VMC.

If I'm wrong, please let me know how, I've been trying to reconcile this in my head for ages.

*Excluding Special VFR, and excluding clear of cloud in sight of surface at or below 3000ft, not relevant here.

The VMC criteria define legally whether you have the choice to fly VFR (in the UK and Europe).

In the UK, you can only fly either VFR or IFR*.

If you are flying close to (or within) a cloud, you must be flying in IMC which logically means you must be flying IFR because the VMC criteria cannot be met.
The fact you have a cloud flying endorsement / IMC rating means you must be flying IFR whenever you are less than the legal VMC.

If I'm wrong, please let me know how, I've been trying to reconcile this in my head for ages.

*Excluding Special VFR, and excluding clear of cloud in sight of surface at or below 3000ft, not relevant here.