backend-reference icon indicating copy to clipboard operation
backend-reference copied to clipboard

feat: Add geospatial-python-urban-analysis-with-postgis project

Open BrenQ opened this issue 8 months ago • 2 comments

🚀 What's this PR do?

This PR creates a new project: geospatial-python-urban-analysis-with-postgis, designed for advanced geospatial data analysis using Python, PostGIS, and Docker.

🔹 Key Features

  • Implements a modular ETL pipeline for processing spatial data.
  • Supports Shapefiles, GeoJSON, and Parquet as input formats.
  • Standardizes Coordinate Reference Systems (CRS) for consistency.
  • Integrates PostGIS for efficient spatial storage and querying.
  • Optimizes spatial indexing to improve performance.

✅ Summary of Changes

📌 Project Initialization

  • Created the new repository: geospatial-python-urban-analysis-with-postgis.
  • Added the core project structure including:
    • src/etl/: Extract, Transform, Load pipeline.
    • src/database/: PostGIS connection and queries.
    • src/pipelines/: Modular geospatial data workflows.
    • notebooks/: Jupyter Notebooks for visualization and analysis.
    • docker-compose.yml: PostgreSQL + PostGIS environment.

🔬 How to Test?

Run the following command to execute the ETL pipeline:

PYTHON=. python -m src.pipelines.bus_stop_analysis

Summary by CodeRabbit

  • New Features

    • Introduced a Docker setup for a streamlined geospatial analysis environment with integrated database services.
    • Launched new interactive pipelines and notebooks for urban data exploration, bus stop distribution analysis, and spatial visualization.
    • Added functions for fetching and analyzing bus stop data, including optimal stop identification and visualization.
    • Enhanced geospatial data handling with new functions for loading population density and managing shapefiles.
    • Added a comprehensive README detailing project purpose, requirements, setup, and features.
  • Documentation

    • Updated the project guide with clear sections including overview, key features, system requirements, and setup instructions.
    • Added comprehensive metadata for datasets to ensure proper understanding and usage.
  • Chores

    • Enhanced dependency configurations and metadata to ensure improved compatibility and performance.

BrenQ avatar Feb 14 '25 19:02 BrenQ