questions related to offline geotiff image and export option

[jaigsingla]

Hi,
It looks very nice development. I have few queries:

1.Can we run this module on Geotiff image already available in my machine if yes, how? how to convert it to slippy map format ? do one requires full scene or multiple pieces of one scene?
2. Pls give guidelines for offline (without internet ) processing.

3. If I have segmented version (classified building image in png format) of the images available and just want to use your post processing tool for saving in to geojson or shape file, how to do that ?

thanks

[daniel-j-h]

1. Robosat only works with slippy map tiles; you can tile e.g. into 256x256 or 512x512 pixel tiles via

• https://gdal.org/programs/gdal2tiles.html
• https://github.com/cogeotiff/rio-tiler

Here's a quick and unoptimized tiler script; if your use case gets more involved you should definitely look into better ways of doing this:

https://gist.github.com/daniel-j-h/69a967d63d833f74a123e2540bd146b9

2. I don't understand what you mean by offline processing. All tools except for downloading satellite tiles from a remote server work "offline".

3. Only use the post-processing tools then.

[ocourtin]

@jaigsingla, to complete @daniel-j-h answer, on imagery tiling:
You could also give a look on rsp tile, from https://github.com/datapink/robosat.pink
Usually faster than the others, able to deal with coverage imagery, and to skip nodata tiles...

HTH,

[jaigsingla]

1. Robosat only works with slippy map tiles; you can tile e.g. into 256x256 or 512x512 pixel tiles via

• https://gdal.org/programs/gdal2tiles.html
• https://github.com/cogeotiff/rio-tiler

Here's a quick and unoptimized tiler script; if your use case gets more involved you should definitely look into better ways of doing this:

https://gist.github.com/daniel-j-h/69a967d63d833f74a123e2540bd146b9

1. I don't understand what you mean by offline processing. All tools except for downloading satellite tiles from a remote server work "offline".
2. Only use the post-processing tools then.

Hello daniel,
All tools are offline , I agree. But how to install and use this library on offline machine is a difficult task.

Request you provide all dependencies as a zip or virtual environment image >>

thanks

[daniel-j-h]

Look into

docker image save
docker image load

to create a self-contained docker image tarball, get it onto your machine, and load it again.

[jaigsingla]

Hi daniel,
I could build everything offline without docker. Now i want to use it along with bavaria dataset :
Following is available in datasets:
Model as check point
geojson file of the heat map area
two comparison images

After going through your post, we need followings:
1.Any geo-referenced image
2. From building shape file, OSM extract in geoson format of that area.
3. these two files should be converted to slippy format using ./rs cover
4. rs rasterize on osm slippy format files
5. rs train like that

I want to simulate entire scenario using bavaria data-sets first but i am unable to fetch the same.
pls guide.

[daniel-j-h]

Please read the documentation for our tools and read through the diary posts here

https://github.com/mapbox/robosat#overview

they explain in detail how to run the pipeline, where to get the training data from, and so on.

[jaigsingla]

ok thanks.
I am directly starting with my own data. i executed ./rs cover --zoom 20 .geojson building.tiles
but it gives error of xy() takes from 2 to 3 positional arguments but 5 were given.

[daniel-j-h]

Do you have a stack trace? Which version are you running, latest? How does your geojson file look like?

[jaigsingla]

Stack trace. I used latest version only. geojson file is clipped over Ahmedabad, India .

0%| | 0/482 [00:00<?, ?feature/s]
Traceback (most recent call last):
File "/home/deep/anaconda3/envs/fastai/lib/python3.6/runpy.py", line 193, in _run_module_as_main
"main", mod_spec)
File "/home/deep/anaconda3/envs/fastai/lib/python3.6/runpy.py", line 85, in _run_code
exec(code, run_globals)
File "/home/deep/building_extraction/robosat-master/robosat/tools/main.py", line 58, in
args.func(args)
File "/home/deep/building_extraction/robosat-master/robosat/tools/cover.py", line 30, in main
tiles.extend(map(tuple, burntiles.burn([feature], args.zoom).tolist()))
File "/home/deep/anaconda3/envs/fastai/lib/python3.6/site-packages/supermercado/burntiles.py", line 62, in burn
all_touched=True)
File "/home/deep/anaconda3/envs/fastai/lib/python3.6/site-packages/rasterio/env.py", line 397, in wrapper
return f(*args, **kwds)
File "/home/deep/anaconda3/envs/fastai/lib/python3.6/site-packages/rasterio/features.py", line 280, in rasterize
for index, item in enumerate(shapes):
File "/home/deep/anaconda3/envs/fastai/lib/python3.6/site-packages/supermercado/burntiles.py", line 59, in
((project_geom(geom['geometry']), 255) for geom in polys),
File "/home/deep/anaconda3/envs/fastai/lib/python3.6/site-packages/supermercado/burntiles.py", line 12, in project_geom
for part in geom['coordinates']
File "/home/deep/anaconda3/envs/fastai/lib/python3.6/site-packages/supermercado/burntiles.py", line 12, in
for part in geom['coordinates']
File "/home/deep/anaconda3/envs/fastai/lib/python3.6/site-packages/supermercado/burntiles.py", line 11, in
[mercantile.xy(*coords) for coords in part]
TypeError: xy() takes from 2 to 3 positional arguments but 5 were given

[daniel-j-h]

How did you generate the GeoJSON? What type of features do you have in there? From what I can recall we were supporting "Polygon" features only due to the supermercado dependency limitations.

For our extract tool see

https://github.com/mapbox/robosat/blob/3ae9c7e1d58fc446b7c8df3835c628c40ca85ba2/robosat/osm/building.py

And supermercado upstream tickets

• Add better support for all geometry types in burn supermercado#13
• 1.0.0 release supermercado#30

[jaigsingla]

There is osm building shape file available over ahmedabad. Cropped subset over Ahmedabad was taken as an input and using QGIS I just saved this in geojson format and use for further processing.
recent_shapefile.zip

[daniel-j-h]

Yeap you have features in there which are not Polygon. The upstream supermercado library does not support that, see tickets linked above. I recommend you generate a GeoJSON file with Polygon features only.

[ocourtin]

@jaigsingla You could also give a try to rsp rasterize resilient with all GeoJSON geometries types.

Cf:

• MultiBands, and tools improvements (mostly) #138
• https://github.com/datapink/robosat.pink/blob/v0.5.5/docs/tools.md#rsp-rasterize

[jaigsingla]

@ocourtin can you share practical example of this ? and i guess we need to perform tilling on this also??

[jaigsingla]

Yeap you have features in there which are not Polygon. The upstream supermercado library does not support that, see tickets linked above. I recommend you generate a GeoJSON file with Polygon features only.

@daniel-j-h but these are polygons only ??