Files
geopandas/doc/source/getting_started/introduction.ipynb
T
Martin Fleischmann ed68a95033 DOC: debug readthedocs and nbsphinx (#1838)
* don't execute

* list examples

* try with executed notebooks

* build intro, add pygeos

* auto build

* build the same as currently

* remove kernel name

* add few more

* revert choro

* add rest

* remove kernelspec

* clear choropleths

* build choropleths, clear choro_legends

* clear introduction

* remove kernelspec

* clean meta

* execute choro_legends

* always execute + exceptions

* fix cartopy plot
2021-02-19 23:44:26 +00:00

17 KiB

Introduction to GeoPandas

This quick tutorial provides an introduction to the key concepts of GeoPandas. In a few minutes, we'll describe the basics which allow you to start your projects.

Concepts

GeoPandas, as the name suggests, extends popular data science library pandas by adding support for geospatial data. If you are not familiar with pandas, we recommend taking a quick look at its Getting started documentation before proceeding.

The core data structure in GeoPandas is geopandas.GeoDataFrame, a subclass of pandas.DataFrame able to store geometry columns and perform spatial operations. Geometries are handled by geopandas.GeoSeries, a subclass of pandas.Series. Therefore, your GeoDataFrame is a combination of Series with your data (numerical, boolean, text etc.) and GeoSeries with geometries (points, polygons etc.). You can have as many columns with geometries as you wish, there's no limit typical for desktop GIS software.

geodataframe schema

Each GeoSeries can contain any geometry type (we can even mix them within a single array) and has a GeoSeries.crs attribute, which stores information on the projection (CRS stands for Coordinate Reference System). Therefore, each GeoSeries in a GeoDataFrame can be in a different projection, allowing you to have, for example, multiple versions of the same geometry, just in a different CRS.

One GeoSeries within a GeoDataFrame is seen as the active geometry, which means that all geometric operations applied to a GeoDataFrame use the specified column.

User Guide

See more on data structures in the User Guide.

Let's see how this works in practice.

Reading and writing files

First, we need to read some data.

Read files

Assuming we have a file containing both data and geometry (e.g. GeoPackage, GeoJSON, Shapefile), we can easily read it using geopandas.read_file function, which automatically detects filetype and creates a GeoDataFrame. In this example, we'll use the "nybb" dataset, a map of New York boroughs which is part of GeoPandas installation. Therefore we need to get the path to the actual file. With your file, you specify a path as a string ("my_data/my_file.geojson").

In [ ]:
import geopandas

path_to_data = geopandas.datasets.get_path("nybb")
gdf = geopandas.read_file(path_to_data)

gdf

Write files

Writing a GeoDataFrame back to file is similarly simple, using GeoDataFrame.to_file. The default file format is Shapefile, but you can specify your own using driver keyword.

In [ ]:
gdf.to_file("my_file.geojson", driver="GeoJSON")

Simple methods

Now we have our GeoDataFrame and can start working with its geometry.

Since we have only one geometry column read from the file, it is automatically seen as the active geometry and methods used on GeoDataFrame will be applied to the "geometry" column.

Measuring area

To measure the area of each polygon (or MultiPolygon in this specific case), we can use GeoDataFrame.area attribute, which returns a pandas.Series. Note that GeoDataFrame.area is just GeoSeries.area applied to an active geometry column.

But first, we set the names of boroughs as an index, to make the results easier to read.

In [ ]:
gdf = gdf.set_index("BoroName")
In [ ]:
gdf["area"] = gdf.area
gdf["area"]

Getting polygon boundary and centroid

To get just the boundary of each polygon (LineString), we can call GeoDataFrame.boundary.

In [ ]:
gdf['boundary'] = gdf.boundary
gdf['boundary']

Since we have saved boundary as a new column, we now have two geometry columns in the same GeoDataFrame.

We can also create new geometries, which could be, for example, a buffered version of the original one (i.e., GeoDataFrame.buffer(10)) or its centroid:

In [ ]:
gdf['centroid'] = gdf.centroid
gdf['centroid']

Measuring distance

We can also measure how far is each centroid from the first one.

In [ ]:
first_point = gdf['centroid'].iloc[0]
gdf['distance'] = gdf['centroid'].distance(first_point)
gdf['distance']

It's still a DataFrame, so we have all the pandas functionality available to use on the geospatial dataset, and to do data manipulations with the attributes and geometry information together.

For example, we can calculate average of the distance measured above (by accessing the 'distance' column, and calling the mean() method on it):

In [ ]:
gdf['distance'].mean()

Making maps

GeoPandas can also plot maps, so we can check how our geometries look like in space. The key method here is GeoDataFrame.plot(). In the example below, we plot the "area" we measured earlier using the active geometry column. We also want to show a legend (legend=True).

In [ ]:
gdf.plot("area", legend=True)

Switching the active geometry (GeoDataFrame.set_geometry) to centroids, we can plot the same data using point geometry.

In [ ]:
gdf = gdf.set_geometry("centroid")
gdf.plot("area", legend=True)

And we can also layer both GeoSeries on top of each other. We just need to use one plot as an axis for the other.

In [ ]:
ax = gdf["geometry"].plot()
gdf["centroid"].plot(ax=ax, color="black")

Now we set the active geometry back to the original GeoSeries.

In [ ]:
gdf = gdf.set_geometry("geometry")
User Guide

See more on mapping in the User Guide.

Geometry creation

We can further work with the geometry and create new shapes based on those we already have.

Convex hull

If we are interested in the convex hull of our polygons, we can call GeoDataFrame.convex_hull.

In [ ]:
gdf["convex_hull"] = gdf.convex_hull
In [ ]:
ax = gdf["convex_hull"].plot(alpha=.5)  # saving the first plot as an axis and setting alpha (transparency) to 0.5
gdf["boundary"].plot(ax=ax, color="white", linewidth=.5)  # passing the first plot and setting linewitdth to 0.5

Buffer

In other cases, we may need to buffer the geometry using GeoDataFrame.buffer(). Geometry methods are automatically applied to the active geometry, but we can apply them directly to any GeoSeries as well. Let's buffer the boroughs and their centroids and plot both on top of each other.

In [ ]:
# buffering the active geometry by 10 000 feet (geometry is already in feet)
gdf["buffered"] = gdf.buffer(10000)

# buffering the centroid geometry by 10 000 feet (geometry is already in feet)
gdf["buffered_centroid"] = gdf["centroid"].buffer(10000)
In [ ]:
ax = gdf["buffered"].plot(alpha=.5)  # saving the first plot as an axis and setting alpha (transparency) to 0.5
gdf["buffered_centroid"].plot(ax=ax, color="red", alpha=.5)  # passing the first plot as an axis to the second
gdf["boundary"].plot(ax=ax, color="white", linewidth=.5)  # passing the first plot and setting linewitdth to 0.5

Geometry relations

We can also ask about the spatial relations of different geometries. Using the geometries above, we can check which of the buffered boroughs intersect the original geometry of Brooklyn, i.e., is within 10 000 feet from Brooklyn.

First, we get a polygon of Brooklyn.

In [ ]:
brooklyn = gdf.loc["Brooklyn", "geometry"]
brooklyn

The polygon is a shapely geometry object, as any other geometry used in GeoPandas.

In [ ]:
type(brooklyn)

Then we can check which of the geometries in gdf["buffered"] intersects it.

In [ ]:
gdf["buffered"].intersects(brooklyn)

Only Bronx (on the north) is more than 10 000 feet away from Brooklyn. All the others are closer and intersect our polygon.

Alternatively, we can check which buffered centroids are entirely within the original boroughs polygons. In this case, both GeoSeries are aligned, and the check is performed for each row.

In [ ]:
gdf["within"] = gdf["buffered_centroid"].within(gdf)
gdf["within"]

We can plot the results on the map to confirm the finding.

In [ ]:
gdf = gdf.set_geometry("buffered_centroid")
ax = gdf.plot("within", legend=True, categorical=True, legend_kwds={'loc': "upper left"})  # using categorical plot and setting the position of the legend
gdf["boundary"].plot(ax=ax, color="black", linewidth=.5)  # passing the first plot and setting linewitdth to 0.5

Projections

Each GeoSeries has the Coordinate Reference System (CRS) accessible as GeoSeries.crs. CRS tells GeoPandas where the coordinates of geometries are located on the Earth. In some cases, CRS is geographic, which means that coordinates are in latitude and longitude. In those cases, its CRS is WGS84, with the authority code EPSG:4326. Let's see the projection of our NY boroughs GeoDataFrame.

In [ ]:
gdf.crs

Geometries are in EPSG:2263 with coordinates in feet. We can easily re-project a GeoSeries to another CRS, like EPSG:4326 using GeoSeries.to_crs().

In [ ]:
gdf = gdf.set_geometry("geometry")
boroughs_4326 = gdf.to_crs("EPSG:4326")
boroughs_4326.plot()
In [ ]:
boroughs_4326.crs

Notice the difference in coordinates along the axes of the plot. Where we had 120 000 - 280 000 (feet) before, we have 40.5 - 40.9 (degrees) now. In this case, boroughs_4326 has a "geometry" column in WGS84 but all the other (with centroids etc.) remains in the original CRS.

Warning

For operations that rely on distance or area, you always need to use projected CRS (in meters, feet, kilometers etc.) not a geographic one. GeoPandas operations are planar, and degrees reflect the position on a sphere. Therefore the results may not be correct. For example, the result of gdf.area.sum() (projected CRS) is 8 429 911 572 ft2 but the result of boroughs_4326.area.sum() (geographic CRS) is 0.083.

User Guide

See more on projections in the User Guide.

What next?

With GeoPandas we can do much more that this, from aggregations, to spatial joins, geocoding and much more.

Head to the User Guide for to learn more about different functionality of GeoPandas, to the Examples to see how it can be used or the the API reference for the details.

In [ ]: