I want to pass a directive to all but one or two locations. How do I do
that?

Like:

<Location /1>
xxx
</Location>

<Location /2>
xxx
</Location>

<Location "Everything Else">
YYY
</Location>