eolab:openhype:start
Differences
This shows you the differences between two versions of the page.
Both sides previous revisionPrevious revisionNext revision | Previous revision | ||
eolab:openhype:start [2023/05/21 11:03] – [2.4 Observation Data in the Database] sina001 | eolab:openhype:start [2024/03/15 17:21] (current) – [2.1 Data Flow] rolf.becker | ||
---|---|---|---|
Line 111: | Line 111: | ||
- | | {{ : | + | | {{ : |
| // Image 1- Data flow// | | // Image 1- Data flow// | ||
Line 145: | Line 145: | ||
===== 2.3 Data Engineering ===== | ===== 2.3 Data Engineering ===== | ||
- | ===== 2.3.1 Downloading the data ===== | + | ===== 2.3.1 Downloading the Data ===== |
In the first step, The data must be downloaded from [[ https:// | In the first step, The data must be downloaded from [[ https:// | ||
Line 405: | Line 405: | ||
As we can see in Image 11, the minimum date is ** 1951-04-30** | As we can see in Image 11, the minimum date is ** 1951-04-30** | ||
- | ** Create geometry column in messstelle table:** In this section, we want to create a geometry column from **e32** and **n32** columns from the messstelle table. | + | ** Create geometry column in messstelle table:** In this section, we want to create a geometry column from **e32** and **n32** columns from the messstelle table. |
< | < | ||
Line 416: | Line 416: | ||
- | Now the messstelle table has one more column | + | The "messstelle" |
**Merge two tables:** | **Merge two tables:** | ||
- | In this section, we want to merge the two tables (messwert and messstelle) based on the same column | + | In this section, we aim to merge the "messwert" |
< | < | ||
Line 431: | Line 431: | ||
| // Image 13- Merge tables// | | // Image 13- Merge tables// | ||
- | Now we need to create a view and save this SQL command as a new view. the name of this new view is " | + | In order to have the above SQL command |
< | < | ||
Line 439: | Line 440: | ||
</ | </ | ||
- | We need this new view for the next section in QGIS. | + | |
===== 2.5 QGIS===== | ===== 2.5 QGIS===== | ||
- | QGIS is an open-source and free application that can support viewing, editing | + | QGIS is a free and open-source |
You can download QGIS for free from the below link. | You can download QGIS for free from the below link. | ||
Line 449: | Line 450: | ||
[[https:// | [[https:// | ||
- | The below video shows how to download and install QGIS for windows | + | The below video shows how to download and install QGIS for Windows |
| {{ youtube> | | {{ youtube> | ||
| // Video 7- How to download and install QGIS // | | | // Video 7- How to download and install QGIS // | | ||
- | Now is the time to get to know about QGIS and the below video can help so much. | + | To gain a better understanding of QGIS, I recommend watching |
| {{youtube> | | {{youtube> | ||
Line 460: | Line 461: | ||
- | **Create a time series video:** In this section, | + | **Create a time series video:** In this section, |
- | We will download three shapefiles, | + | Three below shapefiles |
- | * Whole state shapefile (dvg1bld_nw.shp) | + | * entire |
* kreis shapefile (dvg1krs_nw.shp) | * kreis shapefile (dvg1krs_nw.shp) | ||
* Gemeinde shapefile (dvg1gem_nw.shp) | * Gemeinde shapefile (dvg1gem_nw.shp) | ||
- | All the three shapefiles can be downloaded from [[https:// | + | All three shapefiles can be downloaded from [[https:// |
+ | After downloading | ||
| {{youtube> | | {{youtube> | ||
Line 475: | Line 477: | ||
Now we can see the map of NRW, kreis and Gemeinde. There are two options to create a video for time series. | Now we can see the map of NRW, kreis and Gemeinde. There are two options to create a video for time series. | ||
- | **Locally with shapefile: | + | **Locally with shapefile: |
The below video shows how we can load shapefiles to QGIS. | The below video shows how we can load shapefiles to QGIS. | ||
Line 484: | Line 486: | ||
**Connect to Database: | **Connect to Database: | ||
- | The below video shows how we can connect our QGIS to Database and load the file. | + | The below video shows how we can connect our QGIS to Database and load the file from Database. |
| {{youtube> | | {{youtube> | ||
| // Video 11- How to connect database to QGIS and load the files// | | // Video 11- How to connect database to QGIS and load the files// | ||
Line 493: | Line 495: | ||
- | This section | + | In this section, the process of creating |
- | Two approaches to creating a dashboard | + | This section discusses two approaches to creating a dashboard. The objective |
- | In our case, we want to create a simple | + | One notable example of this type of dashboard |
- | ** 3.1 Plotly Dash: ** | + | In our specific case, the objective is to develop a straightforward dashboard that showcases the map of North Rhine-Westphalia (NRW) alongside the concentration rates of Nitrate and Sulfate at different time intervals. This dashboard will provide a visual representation of the spatial distribution of these pollutants and enable users to observe any temporal variations in their concentrations within NRW. |
+ | |||
+ | ** Plotly Dash: ** | ||
** Plotly: ** Plotly is a computing company located in Montreal, Canada. They develop online data analytics and visualization tools. | ** Plotly: ** Plotly is a computing company located in Montreal, Canada. They develop online data analytics and visualization tools. | ||
Plotly offers online graphing, analytics, and statistics tools for their users, as well as scientific graphing libraries for Python, R, MATLAB, Perl, Julia, Arduino, and REST. Plotly offers several open-source and enterprise products such as Dash which have been used for creating simple and interactive dashboards in this project. | Plotly offers online graphing, analytics, and statistics tools for their users, as well as scientific graphing libraries for Python, R, MATLAB, Perl, Julia, Arduino, and REST. Plotly offers several open-source and enterprise products such as Dash which have been used for creating simple and interactive dashboards in this project. | ||
- | ** Dash: ** Dash is a framework to build data apps rapidly not only in Python but also in R, Julia, and F#. According to Plotly official website, Dash is downloaded 800,000 times per month which shows that nowadays Dash getting more popular. Dash is a great framework for anyone who uses data with a customised user interface. Through a couple of simple patterns, Dash eliminated all of the technologies as well as protocols that are needed to make a full-stack web app with interactive data considerations. Another good feature is that Dash is running on web browsers so it means that no other application needs to run it. | + | ** Dash: ** Dash is a framework to build data apps rapidly not only in Python but also in R, Julia, and F#. According to Plotly' |
- | If you would like to know more about Dashboard | + | To learn more about creating a dashboard |
Line 515: | Line 519: | ||
All the source codes of the dash gallery are available in [[ https:// | All the source codes of the dash gallery are available in [[ https:// | ||
+ | |||
+ | ** Dashboard Design: ** | ||
+ | I have developed a web application dashboard that effectively visualizes time series data for Nitrate and Sulfate. The image below shows the main page of our dashboard. | ||
+ | |||
+ | | {{: | ||
+ | | // Image 14- Main page of the dashboard // | | ||
+ | |||
+ | In order to run the above dashboard on your local system, you need to do the following: | ||
+ | |||
+ | [[ https:// | ||
+ | |||
+ | direct to the " | ||
+ | |||
+ | There is a yml file inside the folder which name is " | ||
+ | |||
+ | The next step is to add the credentials (Username, DB name, password and ...) of the database to the " | ||
+ | |||
+ | And the last step is to run the " | ||
+ | |||
+ | |||
+ | |||
- | ** 3.2 Panel: ** | ||
===== 4. Result===== | ===== 4. Result===== | ||
Line 523: | Line 547: | ||
==== Nitrate concentration 2000-2010 ==== | ==== Nitrate concentration 2000-2010 ==== | ||
- | The below video has shown the concentration of nitrate in NRW from 2000 to 2010. | + | The video below shows the concentration of nitrate in North Rhine-Westphalia (NRW) from 2000 to 2010. This visualization was created |
- | The video is created | + | |
{{ youtube> | {{ youtube> | ||
Line 532: | Line 555: | ||
==== Nitrate concentration 2010-2020 ==== | ==== Nitrate concentration 2010-2020 ==== | ||
- | The below video has shown the concentration of nitrate in NRW from 2010 to 2020. | + | The video below shows the concentration of nitrate in NRW from 2010 to 2020. |
- | The video is created with QGIS 3.16 | + | The video was created with QGIS 3.16 |
Line 544: | Line 567: | ||
==== Sulfat concentration 2000-2010 ==== | ==== Sulfat concentration 2000-2010 ==== | ||
- | The below video has shown the concentration of sulfate in NRW from 2000 to 2010. The video is created with QGIS 3.16 | + | The video below shows the concentration of sulfate in NRW from 2000 to 2010. The video was created with QGIS 3.16 |
{{ youtube> | {{ youtube> | ||
Line 551: | Line 574: | ||
==== Sulfat concentration 2010-2020 ==== | ==== Sulfat concentration 2010-2020 ==== | ||
- | The below video has shown the concentration of sulfate in NRW from 2010 to 2020. The video is created with QGIS 3.16 | + | The video below shows the concentration of sulfate in NRW from 2010 to 2020. The video is created with QGIS 3.16 |
{{ youtube> | {{ youtube> |
eolab/openhype/start.txt · Last modified: 2024/03/15 17:21 by rolf.becker