Do I need to be in the UAE to set up an ADGM Foundation?

No. The incorporation process is entirely digital. Documents can be signed digitally, and Clara Formations submits your application electronically.