This used to be possible in the Android app version before it was sunset (T228661). It was proposed in the 2022 Community Wishlist wish Add a map to Special:Nearby (ranked #68 with 42 support votes).
Copy/pasting from the wiki page:
As someone who built this feature (and recently rebuilt it again as the soon to be deployed Extension:NearbyPages), I'd love to see this, but I assure you I would have done it already if we had the means to do so.Our maps infrastructure is just not good enough to handle the kind of traffic this would bring. I think there's a lot of work to be done on the operations side to make this even feasible.
From the implementation side, provided we can handle the traffic, and we have soem designs, vue-leaflet would be the most likely solution, so we'd need to security review that Node library.