Showing posts with label rants and opinions. Show all posts
Showing posts with label rants and opinions. Show all posts

Monday, May 18, 2020

Geopaparazzi vs. ESRI Collector - a user story

Andrew Mitchell appeared a couple of years ago in the geopaparazzi community and soon marked a differenece. It is one of those users that put effort in making the tool they use better. He soon started to open issues about usability... many issues. And those many issues made me crazy, since he was right and most of the time I had to react with improvements and fixes, but also contributed to a better geopaparazzi.

A couple of days ago he shared his experience on the field with Geopaparazzi and with ESRI Collector. Needless to say that I loved the read.

Pasting the whole content here as it was sent to the geopaparazzi mailinglist:






ESRI Collector vs Geopaparazzi
Background Information
Most environmental consulting firms use Collector. It is the defacto industry standard for GIS data collection. However, I have on most occasions had serious issues with it and now use Geopaparazzi. The following table provides a comparison between the two systems based on slightly more that a years of practice with both systems. In most cases, I would start with Collector and then switch over to Geoparazzi when Collector experienced an issue that was hard to work around. That said, others found Collector to be fine and stable. It could be that the iPhone version is better than the Android version. Even so, many limitations would remain. This review concentrated on issues that have caused grief in the field, rather than what works well.
Geopaparazzi has fewer issues, but some occasionally arise, particularly teething issues with the new version 6. However, any serious issues have rapidly been resolved. At the time of writing Geopaparazzi 6.0.3 was being compared with an up-to-date, professionally managed ESRI ecosystem. 

Collector
Geopaparazzi
Primarily an online data collection system with an off-line capability
Began as an off-line system but has ability to utilise some cloud services for importing base data and form designs. Does not appear to have the ability to upload new or updated data to a live GIS system.
Projects are created in ArcGIS Pro then delivered to an Android device by cellular network
- downloads can be painfully slow
- it is also confusing when you open a downloaded project and are outside the project area as the imagery for your current location will be shown, not the imagery for the defined project area.

Project usually created on the fly on the device by starting a new project.
- loading base maps or spatialite data via USB is very simple and quick.
- it is simple to centre the view on a base map.
Background Images
Background images are limited to those hosted by ESRI online.
Imagery that can be displayed in ArcGIS Pro is not able to be (we can’t figure out how) be displayed as a background image on the mobile device. This prevents recent, high quality imagery such as nearmap from being available in the field.
Spatial misalignments of background imagery from ESRI cannot be corrected.
Potentially imagery is not preserved when Collector is used in online mode when the device screen is turned off. More work is
Background images can be downloaded via cellular network on the fly or you can manually pre-load the area of interest by dragging the screen over the area of interest. This method is very good for linear areas such as under an aircraft flight path. Background imagery persists between sessions.
Background images can also be created in a GIS as an mbtiles file. If the original image is a from a web server such as Open Street Map, then each image level will have a different amount of detail. This is very good for navigation to site. Zoom dependent visibility can also be used in a GIS to show
needed to test this but it seems that the same tiles are downloaded each time they are needed.
If the internet is congested, background imagery will display slowly or a network error will be reported.
It is possible to create tile package files (ptk files) which contain background imagery for Collector, however an add-in is required for ArcMap. These images can then be copied into the device over a USB connection. This capability has not been tried by us.
or hide project layers and this information will be burned into the mbtiles when they are created.
Any imagery that can be displayed in a GIS can be converted to mbtiles. I often use a hillshade blended with an aerial photo.
If the webserver imagery is not located correctly, it is possible to create mbtiles with the imagery shifted to its correct location.
Navigation
North up display
Heads up display or north up display – user selects
Data collection
Both are similar. Both open the keyboard for pick list entries. This is a pain as the keyboard takes up space that could be used to show more picklist entries.
Drawing lines and polygon features in collector is very easy and very refined
Tracks
No tracks by default, although there is a workaround.
Records tracks when track logging is activated. Basis of track point recording can be adjusted in settings
Data management
In online mode, no data management is necessary.
In off-line mode, data has to be synced. Sometimes there are issues with syncing.
Uploaded data is available to most users via Arc Maps Online and to the GIS team via ArcGIS Pro.
Retrieving the data for third party applications requires extra steps such as exporting the data to a folder that is reachable by the applications. The data cannot just be copied out of ArcMaps online. The ability to select rows is disabled. Copying the feature database from the server to a local machine also did
There is some cloud support, but I have not used it. It requires setting up a Postgres Server and some configuration.
I just copy the gpap file from the device and paste it into a folder on my windows PC. A micro USB cable is required for the physical connection.
Prior to copying the gpap file, I may choose to export the photos and gps tracks, which are stored within the gpap database.
Managing this data requires some procedures and an organised filing system but the data can be opened and processed by any suitable application.
not make the data available. The database claims to be empty on local machine but has data on the source machine.
Viewing form data
Form data can be viewed by clicking on points on the map in the field or by clicking on points displayed in ArcOnline. A mini- web page is opened showing the collected information.
Data is collected in JSON format, with the JSON form specification also saved in each record. It is a bit like pdf forms, where the data is saved inside the pdf document and has to be extracted later.
This would be a pain if you do not run a system that can do this (gv-SIG) and are not able to write your own.
The great advantage of this approach is that form design can be evolved in the field. Data already collected is totally unaffected.
Extracted data can be converted to a GIS data file such as a shapefile, just added to a database table or rendered as html or kml.
Usability
In Collector, it is easy to press the back button too many times and to quit the project and even the application by accident.
Issues can occur if a data point is right on the edge of the defined project area. It is not-possible/very difficult as Collector resists the edge of the project area being dragged into the centre of the screen. This is an issue if you have to approach the target via areas that are outside the project area.
Symbol size in our projects is very small, usually round dots. If the colours used are similar, it is hard to tell what the colour is. Also if the coloured dot is used on a strongly coloured background, our eyes will colour balance and the perceived colour will shift.
Screens are prone to clutter. If contour lines are used, then seeing the data can be like looking through spiders web.
In Geopaparazzi, accidentally quiting the current project or the application is very unlikely. Quiting has to be deliberate.
Screen position is not limited to the project area.
Symbol size, colour and shape is under user control.
Screen clutter is manageable. Layers that are only used for navigation can be burned into the background layer.
Multi-user/multi-session experience
This is Collectors’ strongest point. When a
Geopaparazzi is not well suited to live
project is synced, data collected or updated by other people becomes visible. For the field operator, responsibility for managing the data ends as soon as the data is synced. If the data fails to sync, and this can happen, then the data is lost (iPads and Collector!).
ArcPro is required to make Collector projects so GIS support is required.
updates in the field as far as I know.
It is possible to create a new project everyday and to import data from that project into a GIS. I have written an application that can append data from incoming gpap files into a master database, however as far as I know, the Geopaparazzi ecosystem otherwise lacks this capability.
Being able to start a new project anywhere at anytime provide great flexibility.


Monday, June 1, 2015

Epl-Gpl discussion from 2011

In 2011, driven by the need to better understand how to make GPL and uDig work together, I wrote an open letter to the Eclipse Foundation and the Free Software Foundation. I collected thoughts and results in the wiki of JGrass. Recently I had to migrate it and found this again. I want to keep it here for reference... and maybe it is also usefull to others.

Mind that this is pretty much a copy/paste of the original wiki page.


 
Here we go:




This wiki page contains informations, email exchanges and useful links regarding the possibility to mix and distribute code licensed under the GPL and the EPL.

Open letter for request of clarification to the Free Software Foundation Europe regarding the coexistence of GPL and EPL licensed code

To gain better understanding of the GPL-EPL compatibility problem, we wrote the following open letter to the Eclipse Foundationd and the FSF.

Introduction

My name is Andrea Antonello and I am an active member of the free and open source software (from now on FOSS) community for years now. I am member of the Open Source Geospatial Foundation (www.osgeo.org) and active developer and steering comittee member in a couple of FOSS GIS projects based on the eclipse rcp (from now on RCP).

For better understanding of the usecases I will ask you clarification of, let me give some introductory explanation.

Eclipse RCP doesn't need much presentation. It is the Rich Client Platform, released under the Eclipse Public License (from now on EPL) and the source of many doubts in licensing issues. uDig is a FOSS GIS and a GIS development kit released under lesser general public license (from now on LGPL). uDig is heavily based on the RCP. JGrass is a set of plugins for uDig and RCP released under LGPL. JGrass is heavily based on the RCP.

It is clear that this situation has no issues, since EPL and LGPL are compatible licenses.

I should mention that in the following cases GPL refers to the GPL version 3.

Motivations

JGrass is a highly scientific project, and as such it has difficulties in exploiting the real power of FOSS, since many scientific project that JGrass could use or connect to are released under general public license (from now on GPL).

This is the reason for which the JGrass team would like to release its plugins under the GPL license.
Given the incompatibility of EPL and GPL, many discussions were raised which lead to lot of confusion and potential border cases that may harm both the project's community and the involved commercial partners.

This letter is meant to request some clarification once and for all by proposing a couple of use cases of development and deployment of the above mentioned applications. I apologize in advance for  having inserted some obviously incompatible cases. The reason for this is that I would like to create a document for the above communities (and not only) to give more clearness and to assure many community members that have had problems with freeing their code to the above RCP based projects.

Use cases

Of the following 5 use cases, the first 4 all assume the following:
I write a simple rcp plugin (from now on called MYPLUGIN) to be used for uDig (for example like explained here). Developed in such a way the plugin contains imports of libraries from both the RCP:
  •  org.eclipse.ui
  •  org.eclipse.core.runtime
and uDig:
  •  net.refrations.udig.project.ui

It is important to note that the MYPLUGIN contains only plugin specific code, which relies on implementations that reside in the referenced packages
  •  org.eclipse.ui
  •  org.eclipse.core.runtime
  •  net.refrations.udig.project.ui
and are present in the target environment (uDig or RCP).

To be clear, in this case import is meant really as the java statement to declare which packages of external libraries shall be used by MYPLUGIN.

Use case one: writing a RCP based plugin and releasing it under GPL

I license MYPLUGIN under GPL, create a small jar archive of MYPLUGIN, put it on a website with installation instructions for putting it into uDig.

Can this be done?

Use case two: writing a RCP based plugin, releasing it under GPL and deploy it as an application

I license MYPLUGIN under GPL, package it with the uDig application, which I brand and bundle in one ready-to-use installer. I then put it on a website where users can download and use it.

Can this be done?

Use case three: writing a RCP based plugin, releasing it under GPL and install it as an application for a customer

I license MYPLUGIN under GPL and put it on a website as in use case one.

Assuming I wrote MYPLUGIN for a customer,  which of the following options are legal?
  •  subcase 1: make a cd with both the uDig application and MYPLUGIN (but separate), and put on the cd installation instructions.
  •  subcase 2: make a cd with uDig incorporating MYPLUGIN within a single installation file.
  •  subcase 3: go to the customer site and install uDig and MYPLUGIN, creating an application ready for the customer's use.

Use case four: writing a RCP based plugin, releasing it under GPL and making it available via the eclipse rcp update site engine

I license MYPLUGIN under GPL.

I want to use the RCP's own installation manager to make MYPLUGIN available to both community and customers.

Can this be done?

Use case five: writing plugins using the Osgi framework


The following use case is a bit different from the above ones.

I want to develop a library based on the framework. Since through the uDig and RCP development I am very bound to the eclipse RCP, I decide to use the  Equinox framework to create the plugins that compose my library (instead of for example Apache Felix, which would have compatible license).

The library I produce will therefore contain imports of the equinox framework.

Which of the below can I do?
  •  subcase 1: I deliver my library and the user will have to download the osgi framework on his own.
  •  subcase 2: I deliver my library packaged together with the osgi framework libraries.

Conclusions


I feel that there is much confusion on the user's part when it comes to certain licenses. The EPL and GPL mixture is a real headache and still I'm not able to find someone that would assure me regarding this topic.

This letter is born of the opinion that a FOSS project comittee has to be able to give clear information about what can and cannot be done to potential developers and investors of the project.


Thanks in advance for the clarifications that the Free Software Foundation can give us.

Warmest regards
Andrea Antonello

on behalf of at least:
  •  the uDig community
  •  the JGrass community
  •  the BeeGIS community
  •  the Java User Group Trentino-Altoadige
  •  and several commercial FOSS based companies

EPL-GPL: the verdict - UPDATE 2010/04

Through the below letter we got several email exchanges directly with the Executive Director of the Eclipse Foundation, Mike Milinkovich, who was very helpful in getting a good picture of what the problems are.

At the time of sending my email, Eclipse Foundation and FSF were discussing the GPL/EPL issue, so I didn't get a direct answer to the questions in the open letter, but now there is a public answer about the issues available:

 

Comments and conclusions

After long discussions we think that the following applies:
  •  it is not possible to create a pure GPL eclipse plugin. That makes one wonder why so many exist in the eclipse marketplace...
  •  since an eclipse plugin is compatible only in the case in which an exception is added to the license (remember the classpath exception?)
  •  and to create such an exception every author involved in the linked code has to agree on the exception
  •  also because derived works inherit the license together with the exception, which basically is what the FSF states in the last part of its blog post: "...can address this issue by providing an additional permission with their license that grants users permission to combine their work with Eclipse in this way..."



Monday, November 19, 2012

Il Repertorio Nazionale dei Dati Territoriali





JGrassTechTips inserisce oggi nella sua homepage il link del Repertorio Nazionale dei Dati Territoriali (RNDT). Attualmente questo strumento sta muovendo i primi passi, ma noi desideriamo che entri a fare parte della “cassetta degli attrezzi” di ogni geomatico e, in prospettiva, di ogni cittadino italiano. Non siamo da soli, ma insieme a:









Thursday, April 29, 2010

Tuesday, February 2, 2010

L'unità di tutte le scienze è trovata nella geografia.

L'unità di tutte le scienze è trovata nella geografia. Il significato della geografia è che essa presenta la terra come la sede duratura delle occupazioni dell'uomo. (John Dewey).


Alle elementari avevo un maestro che insegnava geografia e che tirava giù una carta geografica del mondo davanti alla lavagna. Avevo un compagno di classe al sesto anno che un giorno ha alzato la mano e ha indicato la costa orientale del Sudamerica; poi ha indicato la costa occidentale dell'Africa e ha chiesto: «Sono state mai unite?». E il maestro ha risposto: «Certo che no, è una cosa ridicola!». Lo studente cominciò a fare uso di droghe e sparì. L'insegnante è diventato consigliere scientifico dell'attuale amministrazione (ndr Bush). (dal film documentario statunitense del 2006 "Una scomoda verità", diretto da Davis Guggenheim).


Nella mia geografia ancora sta scritto che tra Catanzaro e il mare si trovano i Giardini delle Esperidi. (George Robert Gissing, da Sulle rive dello Jonio).


L'arma del giornalista è la penna o la macchina da scrivere. L'arma del giornalista sotto vetro smerigliato è la bacchetta o la carta geografica. (Sergio Saviane).


Lungo la costa dell'Africa del Sud-Ovest, delimitato da montagne di origine vulcanica da una parte e dall'Atlantico dall'altra, si stende uno dei più antichi e selvaggi deserti della terra. I geografi chiamano questa zona la Costa degli Scheletri, perché le sue spiagge sono disseminate dei relitti delle navi che vi hanno fatto naufragi. (Ronald Schiller da "Nel mondo dei diamanti").



La geografia non e' solo una mappa di google o un navigatore GPS. Non e' solo il fascino degli aspetti che rappresentano la terra. Non e' solo!

La geografia unisce tutto in modo coerente, riesce a spiegare fenomeni che regolano continenti e popolazioni intere, e' lo studio antropico delle culture, vicine e lontane. Tutto cio' che internet per certi versi in maniera fuorviante ci ha portato sullo schermo di casa, convincendoci di poter sapere, di potere conoscere tutto nell'attimo di un click.

Eppure non e' cosi'.

Sapere Aude!

Lo studio della geografia e' uno strumento necessario.

Una volta mi hanno raccontato di un ragazzo americano che era convinto, evidentemente educato dalla pubblicita', che le mucche fossero viola. Mi ricordo di avere trovato particolarmente ridicola la storia. Ora mi chiedo cosa potrebbe succedere a noi nel caso in cui andasse persa un disciplina importante come la geografia.

Vogliamo veramente spingere la gia' decadente situazione dell'istruzione fino ad arrivare a privare i giovani di tutti gli strumenti necessari a capire la complessita' che si cela dietro alla nostra terra? Vogliamo veramente privarli degli strumenti necessari a prendere decisioni competitive e allo stesso tempo sostenibili assieme a coloro con i quali condividono lo stesso globo?





Firma la petizione presso il sito
dell'Associazione Italiana Insegnanti Geografia



Insieme a:

Tuesday, June 30, 2009

JGrass and its sick community...

Today I closed 2 of the 3 active mailinglists of JGrass.
What a horrible feeling... it is now about 10 years I develop for FOSS software and never had to act like this.

Killing the mailinglists kills an open source project, needless to say.

But not killing them would kill us... so let's see if users will make the effort to keep at least the jgrass-users list alive. I really hope that converging efforts into on single list might do better.
The developers have been redirected to the udig developers list, since many of the questions were anyway related to udig core.

JGrass has always been a small kid with a lot of problems and an incredible difficulty to gather friends. This is due to it's nature and some dynamics I don't understand even now.

JGrass is a scientific based tool, that also wants to be a full powered desktop GIS. So what?

Let me think out loud and write down some comments:

With JGrass you can do complete hydrological risk studies, from the begin to the end of the study JGrass has all the tools. These tools are mainly useful to Engineers and Geologists. The problem is that most of those do a hydrological study once a year. Which means that at that time they come into the list, ask newbie questions and get help to do the job. Then for the rest of the year they disappear, since they have something else to do. When a "JGrass-job" comes again, here they come again, with almost the same questions, since JGrass evolved and no one was paying attention. Quite frustrating being always in need of founding to develop JGrass and having to help people doing their jobs for free.

Differently from other hydro-morphological toolkits, JGrass contains some heavy models and it is not possible to think it as a library. Instead we need a friendly yet powerful environment to get things rolling at the last state of art of technology.
Luckily we found that framework in uDig and we are glad of the migration we did every day since then. In fact, JGrass right now is at one of its best moments and quickly evolving (which makes me even more sad right now).

HydroloGIS is not able to be the only developer, the only release maintainer, the only docs writer, the only mailinglist answerer, and so on... Therefore the decision to cut away something. And what would that something be? Sad to say, but the only thing that we as HydroloGIS do not need and that we initially set up only for the community... a community that even now doesn't get what they are losing.

I am not telling it is not my fault. It probably is in some way. I am instead telling that I want to make things better. If I have time I want to spend it on developing, making better releases and write some documentation... not on newbie questions that other users would be able to answer.

Monday, March 2, 2009

Finally I solved the problem with the BSoD on my dell


It makes one feel good, you should try... it makes one feel as if he would have control over the machine. Which with windows doesn't happen quite often...

Thursday, February 12, 2009

Is JGrass really so hard to use?

Hmmmmm... some say yes, but hey, finally one of our advanced JGrass users reported that "JGrass is stuff for kids" and sent me the following to prove his theory:


I am amazed!!!
Glad to welcome you to our community Kate!!




Wednesday, January 7, 2009

BSOD, the blue screen of death





Hell, I'm no more used to it.
I'm really no more used to it.
A month ago in HydroloGIS we decided to make me use windows on my freetime pc, in order to be able to give better support to JGrass users. Up to that point I had always used linux at work and Mac at home... 
One week ago the sparkling new Dell XPS m1330 arrived.




Today, after one week, I got my first BSOD. Reboot, again BSOD. Visible irritated by the windows application that wants to help me guessing what could be the problem, I start over again and again, until I note that it happens due to a wirless network card problem. 
It got solved... but hell, I'm no more used to it.



The only good point in all this story is that there are a huge amount of good FOSS applications for windows now. Very good. And whatever is not there is more or less in cygwin. 



Friday, September 26, 2008

Hydrology done by JGrass

Today I had to luck to assist in a hydrology lesson of professor Riccardo Rigon (this one done by Silvia) at the University of Trento. 60 young, wellbehaving, interested students sitting at the pcs I once upon a time was sitting (at that time using mapinfo)...

What an enormous feeling seeing them all use JGrass. Folks, here we are contributing to the formation of some of the future engineers... they are growing free!

Now I can really start relaxed to Cape Town.
This year we have 3 presentations, 1 workshop at the FOSS4G and a workshop for geography professors at a highschool in Cape Town.

After many years of struggles, these are all things that keep one's faith alive!
Cape Town, we are coming! :)



PS: if you are a hydrology/geomorphology teacher and want information about JGrass for education, feel free to contact us.

Friday, April 25, 2008

Free Software Evangelists and the ultimate truth

I am following this thread in the osgeo list: Can I do the same GIS tasks with OS (as with ESRI)?

Paul Ramsey states and I would not find better words:
"I think it's contingent on us as evangelizers to not over-sell. I would not recommend QGIS or any other open source desktop to someone whose prior experience was Arc* until I had a clear understanding of the use case."

The truth is that too often we tend to oversell (I guess because we have too much passion for what we do), giving people the right reason to complain about open source software.

Sunday, April 20, 2008

Back from EGU, history repeats, the new bel paese

Back from EGU, back from Vienna... Berlusconi is back... but we knew it all before, as stated already back in the 1995 in the The Globalization Trap: The 20-80 Society, by H.P. Martin and H. Schuhmann:


The pragmatists in the Fairmont Hotel reduce the future to a pair of numbers and a term: "20 to 80" and "tittytainment".

20 percent of the working age population will be enough in the coming century to keep the world economy going. "More workers will not be needed", said magnate Washington SyCip. A fifth of all jobseekers will be enough to produce all the goods and perform all the top-flight services that the world society can afford. This 20 percent will actively participate in living, earning and consuming. One or two percent may be added, the discussants admit, perhaps wealthy heirs.


What about the others? Will 80 percent of those willing to work be without a job? "Certainly", says the US author Jeremy Rifkin, author of the book "The End of Work". "80 percent will have enormous problems." Sun manager Gage puts some more coal on the fire and appeals to his boss Scott McNealy: The question in the future will be "to have lunch or be lunch", to eat or be devoured.

[...]
The term "tittytainment" makes the rounds. This term was coined by the old war-horse Zbigniew Brzezinski. The native Pole, National Security advisor of US president Jimmy Carter, has been occupied with geo-strategic questions. "Tittytainment", Brzezinski explains, is a combination of "entertainment" and "tits", the American slang for bosoms. Brzezinski thinks more of the milk streaming from the breast of a nursing mother than of sex. The frustrated population of the world could be kept happy with as mixture of numbing entertainment and adequate food.

- excerpt from a translation found here http://portland.indymedia.org/en/2004/02/280805.shtml

For the following, strictly Italy-related, I could not find a proper translation:

[...]
Persino nel bel paese, dove la fantasia latina sembra riuscire ad escogitare sempre nuove vie per evitare un tacollo che appare non di rado imminente, e' arrivata l'onda xenofoba e insieme ad essa si diffondono, nelle province settentrionali, l'ira contro il governo centrale, nonche' la voglia di staccarsi dal meridione che "mangia pane a tradimento". Agli occhi dei nordisti di Bossi il sud, la "Terronia", si presenta come una sorta di appendice settentrionale dell'Africa e fa parte del terzo e quarto mondo, mentre la loro "Padania" sarebbe efficiente, produttiva, moderna, onesta. Dove l'economia non funziona, gli Italiani sono invitati ad affidare il loro futuro a ogni sorta di "gratta e vinci", sfornati di continuo dal governo italiano (anche quello democratico dell'Ulivo) per dare un qualche scopo alla vita di milioni di persone. Per il resto l'Italia bada a realizzare il suo tittytainment, i suoi "panem et circenses". Basti pensare alla tv di Berlusconi (e non solo), alle canzonette nazionalpopolari di Sanremo, alle imprese di Tomba e alla nazionale di calcio.

[...]
In Italia a Silvio Berlusconi e' riuscito persino un colpo che in qualsiasi altro paese sarebbe ancor oggi inimmaginabile. Dalle sue tv tutto spot e consumismo e dalle sue squadre sportive con il Milan in testa - vero oppio del popolo italiano - e' riuscito a portare i sogni dalle sue televisioni sin dentro i palazzi del potere politico, arrivare a fondare un partito e a farsi eleggere presidente del consiglio dei ministri.


So were the hell did we learn from our history?!?

And you, are you 20 or 80? And more over, what will your kids get? And their kids? Ah, right, you do not care...

Tuesday, April 8, 2008

Friday, January 25, 2008

How to keep a decent government in Italy

There is no solution for this!
In Italy politics is just a game driven and destroyed by brainless people...