Karttur’s GeoImagine Framework offers a semi-automated processing environment for spatial data, mainly intended for Big Data processing of satellite images and other spatial datasets. To work with the Framework your machine must first be set up with a Spatial Data Integrated Development Environment (SPIDE) as described in my blog on Install and setup spatial data IDE.
At the core of the Framework are object oriented processes. These processes are assembled in groups (called roots), where each group is associated with either a particular data source (e.g. MODIS, Sentinel, Landsat, ancillary etc), or a particular kind of process (e.g. time series processing, scalar, overlay, export etc). Many root processes are also associated with a specific, purpose-built, Python package.
To search for a particular package or process, use these links to browse the content of Karttur’s GeoImagine Framework:
Preparations
If you intend to setup a clone, or your own version, of Karttur’s GeoImagine Framework you first need to create a Python environment. It is strongly recommended that you do that as a [Conda virtual environment]https://karttur.github.io/geoimagine03-docs-main/prep/prep-conda-environ/).
The second step is to Get Karttur’s GeoImagine Framework into Eclipse, where Eclipse (for PyDev) is also part of the SPIDE installation.
Then you also have to prepare the database connections for the PostgreSQL database installed as part of the SPIDE. Before actually running any of the processes it will help if you get acquainted with the conceptual backbone. After that you can follow the step-by-step posts in the setup section.
The Turorial contains various examples processing different kinds of data in the Framework. Under Develop you find instructions for how to setup your own version of the Framework.
Python environment and database connection
Python virtual environment Create Conda Python environment for Karttur’s GeoImagaine project
Database connections Prepare database connections for Karttur’s GeoImagine Framework
Run GRASS from Python How to start and run GRASS from within an external Python script.
Get Framework
Git clone with Eclipse and no project Clone Karttur’s GeoImagine Framework from GitHub using Eclipse and create the PyDev project by linking
Git clone with GitHub Desktop or terminal Clone Karttur’s GeoImagine Framework from GitHub using GitHub Desktop or git terminal commands
Import Project to Eclipse Import Karttur’s entire GeoImagine Framework as a PyDev project to Eclipse
Copy and paste Karttur's GeoImagine Framework Copy and paste selected packages and modules of Karttur’s GeoImagine Framework in Eclipse
Concept
Framework key concepts Key concepts: processes and compositions, and how they are represented in json.
Json elements, variables and objects Json command file structure.
Setup
Karttur's GeoImagine Framework:
Basic components installation A complete installation scheme for the basic components of Karttur’s GeoImagine Framework
Karttur's GeoImagine Framework:
Set up the database (setup_db) Run the setup_db package to setup the postgres database for Karttur’s GeoImagine Framework
Karttur's GeoImagine Framework:
Setup processes (setup_processes)
Part 1 Setup processes Setup the processes for Karttur’s GeoImagine Framework
Karttur's GeoImagine Framework:
Setup processes (setup_processes)
Part 2 Projection and tiling systems Setup custom projection system and tiling
Karttur's GeoImagine Framework:
Setup processes (setup_processes)
Part 3 Database backup and restore Backup and restore (setup) alternatives for the Postgres database
Karttur's GeoImagine Framework:
Setup processes (setup_processes)
Part 4 Default regions Setup the default country and continent regions for Karttur’s GeoImagine Framework
Karttur's GeoImagine Framework:
Setup processes (setup_processes)
Part 5 MODIS tile regions and data access Setup MODIS regions and access to MODIS LPDAAC products for Karttur’s GeoImagine Framework
Karttur's GeoImagine Framework:
Setup processes (setup_processes)
Part 6 EASE-grid tile & projection system Setup EASE-grid 2 tiling and projection systems and define default regions
Karttur's GeoImagine Framework:
Setup processes (setup_processes)
Part 7 Landsat scene positions Link Landsat scene positions to default regions.
Karttur's GeoImagine Framework:
Setup processes (setup_processes)
Part 8 Sentinel satellite data & MGRS tiling Setup the Military Grid Reference System (MGRS) for tiling of sentinel satellite data
Karttur's GeoImagine Framework:
System setup & tiling The regional tilling system of Karttur’s GeoImagine Framework
Karttur's GeoImagine Framework:
Link regions & system tiles Linking default regions to regional tiling systems of Karttur’s GeoImagine Framework
Karttur's GeoImagine Framework:
Vectorise regions Reproject regions to the system projection and generate a vector file of the region and the associated tiles
Karttur's GeoImagine Framework:
Setup processes (setup_processes)
Simplify vector lines and polygons Simplify vectors during import by changing the tolerance for vertices positional accuracy
Blog
DEM processing 10: Extracting kernel indexes with GDAL Process chain for Copernicus DEM: xtracting kernel indexes with GDAL
DEM image layout Elevation symbolisation; color ramping, hill shading and legends for image maps
Process chain for Copernicus DEM Complete process chain for Copernicus DEM using Kartturs GeoImagine Framework
Hydrografi Extracting hydrografi from DEMs
Create regional DEM Identify and defined a regional DEM
Develop
GitHub Submodules with git Create submodules and a superproject using git
GitHub Submodules Organize GitHub repositories with python packages as submodules
git superproject and submodels Create the git superproject with Kartturs GeoImagine Framework packages as submodules
Add, commit and push submodules If your Framework PyDev project is not linked to a git origin, this post describes how to add, commit and push changes via the local repo that is linked to a git origin.
Update submodules Update submodules belonging to git suer-project repo.
Sphinx python documentation Use Sphinx for documenting python packages and modules
Depreciated
Python virtual environment Create Conda Python environment for Karttur’s GeoImagaine project Database connections Prepare database connections for Karttur’s GeoImagine Framework Run GRASS from Python How to start and run GRASS from within an external Python script.
Get Framework
Git clone with Eclipse and no project Clone Karttur’s GeoImagine Framework from GitHub using Eclipse and create the PyDev project by linking
Git clone with GitHub Desktop or terminal Clone Karttur’s GeoImagine Framework from GitHub using GitHub Desktop or git terminal commands
Import Project to Eclipse Import Karttur’s entire GeoImagine Framework as a PyDev project to Eclipse
Copy and paste Karttur's GeoImagine Framework Copy and paste selected packages and modules of Karttur’s GeoImagine Framework in Eclipse
Concept
Framework key concepts Key concepts: processes and compositions, and how they are represented in json.
Json elements, variables and objects Json command file structure.
Setup
Karttur's GeoImagine Framework:
Basic components installation A complete installation scheme for the basic components of Karttur’s GeoImagine Framework
Karttur's GeoImagine Framework:
Set up the database (setup_db) Run the setup_db package to setup the postgres database for Karttur’s GeoImagine Framework
Karttur's GeoImagine Framework:
Setup processes (setup_processes)
Part 1 Setup processes Setup the processes for Karttur’s GeoImagine Framework
Karttur's GeoImagine Framework:
Setup processes (setup_processes)
Part 2 Projection and tiling systems Setup custom projection system and tiling
Karttur's GeoImagine Framework:
Setup processes (setup_processes)
Part 3 Database backup and restore Backup and restore (setup) alternatives for the Postgres database
Karttur's GeoImagine Framework:
Setup processes (setup_processes)
Part 4 Default regions Setup the default country and continent regions for Karttur’s GeoImagine Framework
Karttur's GeoImagine Framework:
Setup processes (setup_processes)
Part 5 MODIS tile regions and data access Setup MODIS regions and access to MODIS LPDAAC products for Karttur’s GeoImagine Framework
Karttur's GeoImagine Framework:
Setup processes (setup_processes)
Part 6 EASE-grid tile & projection system Setup EASE-grid 2 tiling and projection systems and define default regions
Karttur's GeoImagine Framework:
Setup processes (setup_processes)
Part 7 Landsat scene positions Link Landsat scene positions to default regions.
Karttur's GeoImagine Framework:
Setup processes (setup_processes)
Part 8 Sentinel satellite data & MGRS tiling Setup the Military Grid Reference System (MGRS) for tiling of sentinel satellite data
Karttur's GeoImagine Framework:
System setup & tiling The regional tilling system of Karttur’s GeoImagine Framework
Karttur's GeoImagine Framework:
Link regions & system tiles Linking default regions to regional tiling systems of Karttur’s GeoImagine Framework
Karttur's GeoImagine Framework:
Vectorise regions Reproject regions to the system projection and generate a vector file of the region and the associated tiles
Karttur's GeoImagine Framework:
Setup processes (setup_processes)
Simplify vector lines and polygons Simplify vectors during import by changing the tolerance for vertices positional accuracy
Blog
DEM processing 10: Extracting kernel indexes with GDAL Process chain for Copernicus DEM: xtracting kernel indexes with GDAL
DEM image layout Elevation symbolisation; color ramping, hill shading and legends for image maps
Process chain for Copernicus DEM Complete process chain for Copernicus DEM using Kartturs GeoImagine Framework
Hydrografi Extracting hydrografi from DEMs
Create regional DEM Identify and defined a regional DEM
Develop
GitHub Submodules with git Create submodules and a superproject using git
GitHub Submodules Organize GitHub repositories with python packages as submodules
git superproject and submodels Create the git superproject with Kartturs GeoImagine Framework packages as submodules
Add, commit and push submodules If your Framework PyDev project is not linked to a git origin, this post describes how to add, commit and push changes via the local repo that is linked to a git origin.
Update submodules Update submodules belonging to git suer-project repo.
Sphinx python documentation Use Sphinx for documenting python packages and modules
Depreciated
Git clone with Eclipse and no project Clone Karttur’s GeoImagine Framework from GitHub using Eclipse and create the PyDev project by linking Git clone with GitHub Desktop or terminal Clone Karttur’s GeoImagine Framework from GitHub using GitHub Desktop or git terminal commands Import Project to Eclipse Import Karttur’s entire GeoImagine Framework as a PyDev project to Eclipse Copy and paste Karttur's GeoImagine Framework Copy and paste selected packages and modules of Karttur’s GeoImagine Framework in Eclipse
Concept
Framework key concepts Key concepts: processes and compositions, and how they are represented in json.
Json elements, variables and objects Json command file structure.
Setup
Karttur's GeoImagine Framework:
Basic components installation A complete installation scheme for the basic components of Karttur’s GeoImagine Framework
Karttur's GeoImagine Framework:
Set up the database (setup_db) Run the setup_db package to setup the postgres database for Karttur’s GeoImagine Framework
Karttur's GeoImagine Framework:
Setup processes (setup_processes)
Part 1 Setup processes Setup the processes for Karttur’s GeoImagine Framework
Karttur's GeoImagine Framework:
Setup processes (setup_processes)
Part 2 Projection and tiling systems Setup custom projection system and tiling
Karttur's GeoImagine Framework:
Setup processes (setup_processes)
Part 3 Database backup and restore Backup and restore (setup) alternatives for the Postgres database
Karttur's GeoImagine Framework:
Setup processes (setup_processes)
Part 4 Default regions Setup the default country and continent regions for Karttur’s GeoImagine Framework
Karttur's GeoImagine Framework:
Setup processes (setup_processes)
Part 5 MODIS tile regions and data access Setup MODIS regions and access to MODIS LPDAAC products for Karttur’s GeoImagine Framework
Karttur's GeoImagine Framework:
Setup processes (setup_processes)
Part 6 EASE-grid tile & projection system Setup EASE-grid 2 tiling and projection systems and define default regions
Karttur's GeoImagine Framework:
Setup processes (setup_processes)
Part 7 Landsat scene positions Link Landsat scene positions to default regions.
Karttur's GeoImagine Framework:
Setup processes (setup_processes)
Part 8 Sentinel satellite data & MGRS tiling Setup the Military Grid Reference System (MGRS) for tiling of sentinel satellite data
Karttur's GeoImagine Framework:
System setup & tiling The regional tilling system of Karttur’s GeoImagine Framework
Karttur's GeoImagine Framework:
Link regions & system tiles Linking default regions to regional tiling systems of Karttur’s GeoImagine Framework
Karttur's GeoImagine Framework:
Vectorise regions Reproject regions to the system projection and generate a vector file of the region and the associated tiles
Karttur's GeoImagine Framework:
Setup processes (setup_processes)
Simplify vector lines and polygons Simplify vectors during import by changing the tolerance for vertices positional accuracy
Blog
DEM processing 10: Extracting kernel indexes with GDAL Process chain for Copernicus DEM: xtracting kernel indexes with GDAL
DEM image layout Elevation symbolisation; color ramping, hill shading and legends for image maps
Process chain for Copernicus DEM Complete process chain for Copernicus DEM using Kartturs GeoImagine Framework
Hydrografi Extracting hydrografi from DEMs
Create regional DEM Identify and defined a regional DEM
Develop
GitHub Submodules with git Create submodules and a superproject using git
GitHub Submodules Organize GitHub repositories with python packages as submodules
git superproject and submodels Create the git superproject with Kartturs GeoImagine Framework packages as submodules
Add, commit and push submodules If your Framework PyDev project is not linked to a git origin, this post describes how to add, commit and push changes via the local repo that is linked to a git origin.
Update submodules Update submodules belonging to git suer-project repo.
Sphinx python documentation Use Sphinx for documenting python packages and modules
Depreciated
Framework key concepts Key concepts: processes and compositions, and how they are represented in json. Json elements, variables and objects Json command file structure.
Setup
Karttur's GeoImagine Framework:
Basic components installation A complete installation scheme for the basic components of Karttur’s GeoImagine Framework
Karttur's GeoImagine Framework:
Set up the database (setup_db) Run the setup_db package to setup the postgres database for Karttur’s GeoImagine Framework
Karttur's GeoImagine Framework:
Setup processes (setup_processes)
Part 1 Setup processes Setup the processes for Karttur’s GeoImagine Framework
Karttur's GeoImagine Framework:
Setup processes (setup_processes)
Part 2 Projection and tiling systems Setup custom projection system and tiling
Karttur's GeoImagine Framework:
Setup processes (setup_processes)
Part 3 Database backup and restore Backup and restore (setup) alternatives for the Postgres database
Karttur's GeoImagine Framework:
Setup processes (setup_processes)
Part 4 Default regions Setup the default country and continent regions for Karttur’s GeoImagine Framework
Karttur's GeoImagine Framework:
Setup processes (setup_processes)
Part 5 MODIS tile regions and data access Setup MODIS regions and access to MODIS LPDAAC products for Karttur’s GeoImagine Framework
Karttur's GeoImagine Framework:
Setup processes (setup_processes)
Part 6 EASE-grid tile & projection system Setup EASE-grid 2 tiling and projection systems and define default regions
Karttur's GeoImagine Framework:
Setup processes (setup_processes)
Part 7 Landsat scene positions Link Landsat scene positions to default regions.
Karttur's GeoImagine Framework:
Setup processes (setup_processes)
Part 8 Sentinel satellite data & MGRS tiling Setup the Military Grid Reference System (MGRS) for tiling of sentinel satellite data
Karttur's GeoImagine Framework:
System setup & tiling The regional tilling system of Karttur’s GeoImagine Framework
Karttur's GeoImagine Framework:
Link regions & system tiles Linking default regions to regional tiling systems of Karttur’s GeoImagine Framework
Karttur's GeoImagine Framework:
Vectorise regions Reproject regions to the system projection and generate a vector file of the region and the associated tiles
Karttur's GeoImagine Framework:
Setup processes (setup_processes)
Simplify vector lines and polygons Simplify vectors during import by changing the tolerance for vertices positional accuracy
Blog
DEM processing 10: Extracting kernel indexes with GDAL Process chain for Copernicus DEM: xtracting kernel indexes with GDAL
DEM image layout Elevation symbolisation; color ramping, hill shading and legends for image maps
Process chain for Copernicus DEM Complete process chain for Copernicus DEM using Kartturs GeoImagine Framework
Hydrografi Extracting hydrografi from DEMs
Create regional DEM Identify and defined a regional DEM
Develop
GitHub Submodules with git Create submodules and a superproject using git
GitHub Submodules Organize GitHub repositories with python packages as submodules
git superproject and submodels Create the git superproject with Kartturs GeoImagine Framework packages as submodules
Add, commit and push submodules If your Framework PyDev project is not linked to a git origin, this post describes how to add, commit and push changes via the local repo that is linked to a git origin.
Update submodules Update submodules belonging to git suer-project repo.
Sphinx python documentation Use Sphinx for documenting python packages and modules
Depreciated
Karttur's GeoImagine Framework:
Basic components installation A complete installation scheme for the basic components of Karttur’s GeoImagine FrameworkKarttur's GeoImagine Framework:
Set up the database (setup_db) Run the setup_db package to setup the postgres database for Karttur’s GeoImagine FrameworkKarttur's GeoImagine Framework:
Setup processes (setup_processes)
Part 1 Setup processes Setup the processes for Karttur’s GeoImagine FrameworkKarttur's GeoImagine Framework:
Setup processes (setup_processes)
Part 2 Projection and tiling systems Setup custom projection system and tilingKarttur's GeoImagine Framework:
Setup processes (setup_processes)
Part 3 Database backup and restore Backup and restore (setup) alternatives for the Postgres databaseKarttur's GeoImagine Framework:
Setup processes (setup_processes)
Part 4 Default regions Setup the default country and continent regions for Karttur’s GeoImagine FrameworkKarttur's GeoImagine Framework:
Setup processes (setup_processes)
Part 5 MODIS tile regions and data access Setup MODIS regions and access to MODIS LPDAAC products for Karttur’s GeoImagine FrameworkKarttur's GeoImagine Framework:
Setup processes (setup_processes)
Part 6 EASE-grid tile & projection system Setup EASE-grid 2 tiling and projection systems and define default regionsKarttur's GeoImagine Framework:
Setup processes (setup_processes)
Part 7 Landsat scene positions Link Landsat scene positions to default regions.Karttur's GeoImagine Framework:
Setup processes (setup_processes)
Part 8 Sentinel satellite data & MGRS tiling Setup the Military Grid Reference System (MGRS) for tiling of sentinel satellite dataKarttur's GeoImagine Framework:
System setup & tiling The regional tilling system of Karttur’s GeoImagine FrameworkKarttur's GeoImagine Framework:
Link regions & system tiles Linking default regions to regional tiling systems of Karttur’s GeoImagine FrameworkKarttur's GeoImagine Framework:
Vectorise regions Reproject regions to the system projection and generate a vector file of the region and the associated tilesKarttur's GeoImagine Framework:
Setup processes (setup_processes)
Simplify vector lines and polygons Simplify vectors during import by changing the tolerance for vertices positional accuracy
Blog
DEM processing 10: Extracting kernel indexes with GDAL Process chain for Copernicus DEM: xtracting kernel indexes with GDAL
DEM image layout Elevation symbolisation; color ramping, hill shading and legends for image maps
Process chain for Copernicus DEM Complete process chain for Copernicus DEM using Kartturs GeoImagine Framework
Hydrografi Extracting hydrografi from DEMs
Create regional DEM Identify and defined a regional DEM
Develop
GitHub Submodules with git Create submodules and a superproject using git
GitHub Submodules Organize GitHub repositories with python packages as submodules
git superproject and submodels Create the git superproject with Kartturs GeoImagine Framework packages as submodules
Add, commit and push submodules If your Framework PyDev project is not linked to a git origin, this post describes how to add, commit and push changes via the local repo that is linked to a git origin.
Update submodules Update submodules belonging to git suer-project repo.
Sphinx python documentation Use Sphinx for documenting python packages and modules
Depreciated
DEM processing 10: Extracting kernel indexes with GDAL Process chain for Copernicus DEM: xtracting kernel indexes with GDAL DEM image layout Elevation symbolisation; color ramping, hill shading and legends for image maps Process chain for Copernicus DEM Complete process chain for Copernicus DEM using Kartturs GeoImagine Framework Hydrografi Extracting hydrografi from DEMs Create regional DEM Identify and defined a regional DEM
Develop
GitHub Submodules with git Create submodules and a superproject using git
GitHub Submodules Organize GitHub repositories with python packages as submodules
git superproject and submodels Create the git superproject with Kartturs GeoImagine Framework packages as submodules
Add, commit and push submodules If your Framework PyDev project is not linked to a git origin, this post describes how to add, commit and push changes via the local repo that is linked to a git origin.
Update submodules Update submodules belonging to git suer-project repo.
Sphinx python documentation Use Sphinx for documenting python packages and modules
Depreciated
GitHub Submodules with git Create submodules and a superproject using git GitHub Submodules Organize GitHub repositories with python packages as submodules git superproject and submodels Create the git superproject with Kartturs GeoImagine Framework packages as submodules Add, commit and push submodules If your Framework PyDev project is not linked to a git origin, this post describes how to add, commit and push changes via the local repo that is linked to a git origin. Update submodules Update submodules belonging to git suer-project repo. Sphinx python documentation Use Sphinx for documenting python packages and modules