Never mind I found it after reading another old thread. Looks like it is available when “do a search for” and sorting on the search but not on a list of things already loaded.
Just leave this up here for anybody else who might struggle with sorting by distance from a location.