Convert OSM to PARQUET

Turn OSM files into PARQUET. A GeoParquet file with one row for each feature: its shape as WKB in a geom column that GeoParquet metadata describes with its geometry types, bounding box and coordinate system, then every attribute as a column, with lists and nested values kept as Parquet lists and structs.

Converted in an isolated sandbox on our serversDeleted after 24 hours

Drop OSM files on the dialor turn it to pick what to do

OpenStreetMap data as a GeoParquet table.One row for each feature, with its shape and its tags as columns.

  1. What you get

    A single GeoParquet file with one row for each feature. The shape sits in a geom column as WKB. GeoParquet metadata describes it with the geometry types, the bounding box and the coordinate system.

    Every attribute becomes a column. Lists and nested values stay as Parquet lists and structs. The coordinate system of the source is kept.

  2. How features are mapped

    Tagged nodes become points. Ways become lines or, when they are closed and tagged as areas, polygons. Route and multipolygon relations become multilines and multipolygons.

    Common tags such as name, highway and building become columns of their own. The other tags are kept as JSON in other_tags, so nothing tagged is lost from the row.

  3. What it leaves behind

    Untagged nodes are dropped. So are relations other than route and multipolygon relations, and the versions and authors of each object.

    If the source has several layers, they are joined into one table. A layer column names the layer each feature came from.

OSM and PARQUET.What each format is.

The formats

From · OSM

OpenStreetMap Data

OpenStreetMap nodes, ways and relations with their tags, as .osm XML or the smaller .osm.pbf.

Extensions
.osm .osm.pbf
MIME type
application/vnd.openstreetmap.data+xml
Kind
Text and data
To · PARQUET

Parquet

The columnar data format of analytics. Compressed, typed and fast to scan.

Extensions
.parquet .pq
MIME type
application/vnd.apache.parquet
Kind
Text and data

In your code.The same OSM to PARQUET conversion through the API, for your app or your agent.

terminal
$ cv convert report.osm report.parquet
$ cv convert report.osm report.parquet

Questions.What people ask about OSM to PARQUET.

01OF 04

Common tags such as name, highway and building have their own columns. All the other tags are in other_tags as JSON.

Yes. The coordinate system of the source is kept and is described in the GeoParquet metadata.

No. Versions and authors are dropped, along with untagged nodes and relations other than route and multipolygon relations.

They are joined into one file. The layer column tells you which layer each feature came from.

More conversions.Other ways in and out of OSM and PARQUET.