Protomaps: Self-hosting map tiles has gotten cheap and easy

(bruceroettgers.eu)

209 points | by bcye 8 hours ago

18 comments

  • boramalper 4 hours ago
    OpenFreeMap is a similar project:

    https://openfreemap.org/

    > What is OpenFreeMap?

    > OpenFreeMap lets you display custom maps on your website and apps for free.

    > Using our public instance is completely free: there are no limits on the number of map views or requests. There’s no registration, no user database, no API keys, and no cookies. We aim to cover the running costs of our public instance through donations.

    > What is the tech stack?

    > There is no tile server running; only nginx serving a Btrfs image with 300 million hard-linked files. This was my idea; I haven’t read about anyone else doing this in production, but it works really well.

  • neomantra 5 hours ago
    We're doing something like this behind Cloudflare R2, same concept of owning the map infra (for privacy and access-control) and reducing load on public infrastructure.

    If you are into this stuff, you can view PMTiles from the CLI with "gloss", or try to drag-and-drop on its web interface [1]. It seems large tiles (>128M) and some raster formats are failing; plus it would be nice to load from URL there. Will fix that...

    (AI warning). ntmaps [2] is a Golang library that lets you use different tile providers, deployable in terminal or browser. ntplaygrounds [3] uses that and nt3d and ntactor to make a city simulation. Data is pulled from OpenStreetMap in those.

    [1] https://nimbleterminal.com/gloss/app.html [2] https://nimbleterminal.com/ntmaps [3] https://nimbleterminal.com/ntplaygrounds

    • jamessb 5 hours ago
      > If you are into this stuff, you can view PMTiles from the CLI with "gloss", or try to drag-and-drop on its web interface

      The official PMTiles viewer [1, 2, 3] is also pretty good.

      [1]: https://pmtiles.io/

      [2]: https://github.com/protomaps/PMTiles/tree/main/app

      [3]: https://protomaps.com/blog/new-pmtiles-io/

    • cldellow 5 hours ago
      R2 is amazing for this.

      Cloudflare, generally, is amazing for this, actually. It serves my personal hiking map for about $2/mo, using R2, D1 and Workers.

      Building the map itself is free via GitHub Actions.

      It's bonkers how the map world has changed over the last 20 years.

      • tracerbulletx 3 hours ago
        R2 is kind of too good, it makes me nervous about how long such a good thing can last.
      • fhk 2 hours ago
        Nice ! Yeah I just built bowmaps.com with this approach of cloudflare for tiles and workers for on the fly vector tiling
        • BubbleRings 2 hours ago
          Looks good. What does the Bow in bowmaps.com mean?
          • fhk 1 hour ago
            Company has a product called Arrow so figure it works together.
      • is_true 5 hours ago
        That's mostly for the storage not the bandwidth right?
        • cldellow 4 hours ago
          It's pretty much all storage.
      • kellpossible2 5 hours ago
        how are you using D1 and Workers with this?
        • cldellow 4 hours ago
          Two small uses:

          1. The app is a remix app, workers do server-side rendering, so that a vanilla `curl` shows the actual payload, not just a script tag that loads the app.

          2. I'm a great big nerd, so I recently added the ability to post reviews/photos/GPX traces to your AT protocol PDS. The app has a Worker cron job that subscribes to Bluesky's Jetstream for events in its namespace, and indexes these into D1 in order to answer certain API calls like "get traces in this area" or "get reviews for this hike". So the app itself isn't the primary source of truth, a person's PDS (which they control) is. The app just maintains a cache/index that can be rebuilt.

    • tjwebbnorfolk 4 hours ago
      same, we use pmtiles on R2 for landstats.com parcel map. it's very easy to set up and cheap to serve

      and we have a CF worker than turns them into rasters on the fly if that's how people want to get them

  • motoroco 4 hours ago
    yeah, basemaps are small enough to store and host cost effectively, but high res satellite imagery gets big and expensive fast as you go up in zoom level. I built my own satellite mosaic of North America for my app so I can offer users offline access to the tiles and had to stop at z17 because of projected storage requirements. high res global coverage can get you into the hundreds of TB range which is no longer in the "stick it on r2 and serve it with a worker" or "download and upload the entire dataset sequentially over your residential internet" territory

    the fun/hard parts of the project weren't really scale dependent, although downloading source imagery and building the tile pyramids did take literally weeks to run. actually, the hardest part was getting demosaicing right, e.g. making the quilt seamless. filtering out cloudy and smokey/hazy tiles while picking alternatives from the same time of year so groundcover & crops are in a consistent growth stage so you don't end up with checkerboard patterns or cloud silhouettes randomly across your map. and there were other problems that came up more or less just because of how & when the satellite took the images that require exposure correction and more filtering

    I also have a pelias index with 170M records for search and self-host valhalla for routing. the open source mapping ecosystem has really impressed me the more I learn with each project

    • maelito 4 hours ago
      Have you check Mapterhorn's next project ? Funded by Nlnet.
      • motoroco 4 hours ago
        yeah, I heard about them for the first time a few weeks ago. they have a fantastic data set just judging with my bare eyes. I built my topo map from terrain tiles on aws + gebco et al for the bathymetry data which is just personal preference (I love me an old globe with the tactile mountains and seafloor)
  • maelito 4 hours ago
    For Cartes.app we used to pay Maptiler. While great, recommanded to start, without client revenue it was impossible to scale, we've hit 150 €/month bills way too fast.

    Hence Protomaps. Hosting costs almost nothing.

    The main problem though is that once you host your tiles, why not put what you want inside ?

    Tune Tilemaker's processing.lua to your envy. Spend hours designing maps and building a Typescrpt dynamic Maplibre style.

  • thatslast 1 hour ago
    I'm making a Wikipedia walking game where each card comes in a sealed pack printed with the real streets around where you found it, rendered live.

    With Mapbox or Google Maps I wouldn't even have considered building this game. Protomaps made it a no-brainer

    Thanks to Brandon and the OSM contributors. This is what made the idea affordable for a side project.

  • cjlm 2 hours ago
    I’m using (and donating to) OpenFreeMap and using Cloudflare to host custom tiles for my travel time map for Canada, à portée [0] - it’s been so effortless and the tiles are quick to load. No clunky tile server required!

    [0] aportee.ca

  • joshstrange 4 hours ago
    I use Protomaps and absolutely love it. After getting hit with a Google Maps bill that was larger than I ever would have expected, I swapped it out for Protomaps instead and I’ve loved it ever since.

    Dirt cheap to run, theme-able, easy to use.

  • X-Cubed 2 hours ago
    Cloudflare recently improved their support for Range requests: https://blog.cloudflare.com/origin-range-requests/
  • blueblazin 2 hours ago
    I self-host protomaps on CloudFlare for my side project: https://github.com/BlueBlazin/lowpolyearth

    It costs me something like $2/month iirc, and it made tile querying faster over protomaps' free hosted endpoint.

  • perks_12 4 hours ago
    Deploying this as I am typing this. The problem I have with Mapbox is that there is no way to limit spending. When the public key gets abused, it's a potentially enormous bill.
  • nchmy 4 hours ago
    I was very grateful to find protomaps recently for a project where I want to allow people to download custom regional subsections of the global map for offline usage.

    After evaluating maplibre vs the somewhat-abandonned protomaps-leaflet library, I decided to go with the latter as I don't really need the fancy 3d gpu and custom layers functionality of maplibre. Plus leaflet is releasing a long-awaited v2 right now.

  • eruci 4 hours ago
    I deployed self-hosted protomaps on geocode.xyz and it works like a charm. I wish it had more customization options though ( https://geocode.xyz/415%20C'WEALTH%20AVE%20WEST%20Singapore )
  • SafemapTecnolgs 2 hours ago
    My product safemap.io is hosted on Protomaps. Highly recommend.
  • maelito 4 hours ago
    Checkout the new PRs submitted to Tilemaker. It appears building the planet could soon take less than 5 minutes.
  • edumucelli 5 hours ago
    Really cool, did not know about it!
  • h4kunamata 2 hours ago
    CoMaps said hi and uses OpenStreet maps.

    It works amazingly on GrapheneOS, Android Auto, and Desktop app via Flatpak.

  • doodlebugging 6 hours ago
    I visited the link and Malwarebytes warned of a potentially malicious site:

    p - proxy - tp8ez dot bunny dot run

    so I closed that window.

    What else you got?

    • bcye 6 hours ago
      It's my API endpoint for Plausible (private website analytics), not sure why it would get flagged
      • doodlebugging 5 hours ago
        Yeah, me neither. I opened the link along with several other article links from the front page so it sat idle in a separate private tab waiting for me to get to it and just as I clicked on it MWB popped the warning. I'm using LibreOffice with container tabs and MWB Pro under Win10 Pro. Probably nothing.

        Thanks for the explanation.

        Protomaps sounds interesting.

  • pluto_modadic 6 hours ago
    okay, but what clients work with this approach?
    • perrygeo 6 hours ago
      You can use the pmtiles:// protocol in Maplibre GL, requires protomaps.js and a few lines of setup [1]

      My experience with it is ... ok. It works. But going directly to cloud storage (s3 in my case) is unpredictable latency and neither the browser nor most servers really cache HTTP range requests granularly, so every tile is another high-latency round trip. Not worth it - I ended up putting Martin tile server in front of it.

      I assume someone could write a protomaps adapter in WASM with some smart caching? Until then, Standard GET requests are just easier to cache and perform much better in practice. The downside being you have to run a server or statically generate files.

      [1]- https://docs.protomaps.com/pmtiles/maplibre

      • wkrp 5 hours ago
        I've had success with using a cache in front of my buckets for great performance. In my case I have raster tiles so they get turned into z/x/y tile filenames and a cloudflare worker pulls that from the full file and caches the result in the region.
      • bcye 6 hours ago
        For what it's worth I think latency/reliability varies a lot with provider. Bunny Storage has quite good latency in my experience (100-300ms) and their CDN supports Range caching (from my understanding Cloudflare does too they just limit the size of the file regardless of the Range)
      • notatoad 2 hours ago
        we use pmtiles on s3 behind cloudfront, and it seems to work pretty well. maybe not a 100% solution compared to what you'd get from google maps, but good enough that i've got no reason to be looking for another solution.
    • cr125rider 6 hours ago
      Protomaps, pmtiles, are actually pretty ubiquitous. Even has a GDAL driver https://gdal.org/en/stable/drivers/vector/pmtiles.html
    • bcye 6 hours ago
      There is an npm library that integrates the format into MapLibre (fork of Mapbox) and Leaflet.
    • pstuart 6 hours ago
      A quick search showed that this should work with HTTP range requests: https://maplibre.org/