Tuesday, February 10, 2015

HydroloGIS, 10 years of proud Italian Scientific Geographic Open Source and Environmental Engineering

I still remember it as if it was yesterday. We were sitting in the lab of Unitn (the Faculty of Evironmental Engineering of the University of Trento, where we were doing research for professor Rigon) and we were thinking about what to do. Money was running out in universities and the figure of external research staff was being obsoleted. Italy was going to face one big economical crisis.

I remember Silvia saying that she wanted to do a couple of years of research and then head off to do missionary work in Africa.

I remember not knowing exactly what I wanted to do. I had just found what I loved to do: developing open source GIS. It was not just developing anything. It had to be science and it had to be open. I remember dreaming about being able to develop any kind of tool for anyone and for free... right where big big companies were charging in an unfair way. I remember thinking that research should be for everyone out there. And I remember professor Rigon being of the exact same idea. 

At that time the slogan was: All in a aGIS!
We had figured that when it comes to environmental sciences, the glue to keep them all together could only be the GIS. With Riccardo we always joked about taking over ESRI at some point. Well, that one didn't work out that well. :-)

The first logo of HydroloGIS.

The second logo of HydroloGIS.

The current logo of HydroloGIS.


I told Silvia I thought she would be wasted for “normal” missionary work and that she should push her talents hard to do what many others would not be able to: create useful tools and then bring them developing countries together with training for it. And somehow I convinced her on something she didn't need to :-). 

I remember her telling me that most probably in about 5 years from that moment she would leave HydroloGIS anyways to follow her path in development countries.
I remember thinking: "It's ok even like that!". Being able to share a sparkling new experience with a pal that didn’t care a fig about making money exactly as I did, with the only wish to make science tools to release open source for the people… well, that was something that would not be easy to find again. We had to give it a try.

At that time she was following a master about project planning in Padova. One evening I was in the lab and she called me from Padova: “Are you serious about trying to create a company? There is this startup competition here... we could participate… everything needs to be delivered by midnight of today”. We chatted around for a short while, she gave me the link to the competition and then her cellphone battery died with her being spending the evening out (and not being easy to charge phones back then). I had no idea where to contact her again. I didn’t even know her home address at the time. I had to look up her parent’s phone in the paper phonebook (remember?) and call them to get Silvia's data for the contest. The lord meant it good to us, since during the following hours of struggle to write down the business plan idea and completing the competition bureaucracy also a name for the new company had to be chosen. Man, am I happy that HydroloGIS came that natural!

HydroloGIS at "Startcup"

Funny thing is that we wanted to try a startup competition to have confirmation about how good our idea was: Bring innovative open source technologies from the university to the professional world in order to make the world a better place. Sounds just about right, doesn't it?!?!?
Well, we didn’t even pass the first round!!! I remember project N.1 being a portable DNA analyzer device (I wonder where that company is today). We were so angry! How could they not understand!!!! So we decided to prove them wrong. And that is how HydroloGIS got born.


The really empty office of HydroloGIS at day 0. Those who now it now, would not recognize it.

We found shelter at the TIS Innovation Park Southtirol. At that time it was called BIC, the Business Innovation Center, which was an incubator and highly supportive for ideas both based on Environment and Open Source.

HydroloGIS, John Preston from the Jamaican reserach center ICENS and the University of Trento developed together JGrass, the open source GIS that wanted to be a userfriendly graphical interface for GRASS and specialize on hydro-geomorphological processing based on professor Rigon's past decade of research. 


The first JGrass logo, based on GRASS' logo

At that time the only development sponsorship to JGrass came from the MIGG course that we held with Rigon's team each year at the University of Trento.


And this was the first team preparing the course right after the MIGG2005 edition:

Andrea Cozzini, Erica Ghesla, Silvano Pisoni and HydroloGIS

Here the first JGrass versions have been developed.


One thing we have always been bad at was looking for work. At the very beginning we tried some commercial campaigns to sell HydroloGIS products around the region. Eventually we figured that it didn’t work. We have never been able to explain what we do properly and we simply didn’t have the skills to sell.

Luckily for us at the start there were some rather badly paid, but extremely interesting, projects with the university. Then later some jobs for government agencies came in. Interesting enough, we never looked for a job since then. The jobs just came to hunt us. And I mean it when I say "hunt". People started to come to us when they didn’t know where to head to solve their problems, usually after having tried for a while, hence burning both avaliable time and budget. And we took all those jobs, once again, bad paid and sometimes so demanding, that we had to work for free a long time to finish the job. Those were (hard but) great times, in which we grew incredibly from a professional point of view. But those were also hard times. And I exactly remember getting at the end of the year not having enough money to pay taxes. After a year spent working on average 15 hours a day!

But still we stuck to the plan: do everything the open source. It had to work!

Eventually one year passed and we were still in business:


and not in the worst shape (even if I was gaining quite som weight, eventually passing 100Kg :-) ):


In the years that followed (initially mainly on behalf of the University) we taught at several different courses and master courses, gave lessons at the university and to professionals, participated at many Conferences, EGUs and FOSS4G's, went to code sprints, developed GIS, made Engineering work, entered the OpenMI Steering Committee, the uDig Steering Committee, developed and coordinated JGrass, BeeGIS, the Nettools, the JGrasstools, Geopaparazzi and eventually won different innovation competitions.

Silvia winning the first price for innovative women entrepreneur.
GRASS code sprint in Prague.


JGrass went through many different periods. Being rejected from the GRASS community we had tried to develop it on our own, but it had overwhelmed us. we were not a pure software company.

A short history of JGrass until 2010, as presented at FOSS4G Sydney.

So in 2007 one big move had been done, the migration in what I was convinced was the best java open source desktop GIS (I still am convinced it has that potential): uDig


The first splashscreen of JGrass as uDig extension.


HydroloGIS, beyond others, teaching to high school teachers in Cape Town after the FOSS4G.


Talking about JGrass at Foss4G Sydney.


and having great fun at the same conference, always wearing the colors :-)


always ready to attend to important meetings to shout out our thoughts.

With the begin of my PhD at the University of Urbino a new open source door opened up. The mobile field mapping.

The BeeGIS extensions for uDig were developed in that context, which gained quite some interest. Being uDig based it worked only on full size pcs, or better tablets. Back then the big deal where Ultralight tablets, that had some complete-yet-downscaled operating system and were able to give enough juice to make uDig run on them. 



The splashscreen of the BeeGIS release for which ARPA Piemonte sponsored a nice part of development both for BeeGIS and uDig.


Digital field mapping as PhD student in Urbino.

Today I still have to laugh about that and I know some of you don't even remember. But tablets were heavy back then:

but everything is possible if you only want it:


In 2007 the first Geopaparazzi was born. And nothing has been as it was before :-)

We were finally able to have a tool that we would always have with us and with that we would be able to map in extreme situations:

Android made the BeeGIS project die out, because we simple stopped using it to develop the Geopaparazzi project, which, funny enough, turned out to be our most supported in the GFOSS world. There is even a facebook group for it now :-)


The years passed and many interesting things happened, as well as quite difficult things that hit hard on us. We tried to work tightly with other companies, which sometimes didn't work out well. We also tried to have employees, which did really work badly and we figured that would be something for when we are old :-). 

As I am writing this up now, overwhelmed by happiness and proud of what we achieved, all the bad things just vanish and I could go on telling you stories about our life, but I think it is really enough now. :-) It is really more material for a pub than a technical blog. But you got the point: I love the way HydroloGIS turned out, with its ups and downs.

The sole fact that few years ago I have been able to go back again to do music actively with my Alpentraum Orchestra, is a great indicator of having achieved what I wanted to: a job I love to work on every minute of the day and (some degree of) complete freedom in the organisation of time, which makes family and music possible.

Over time HydroloGIS made sense, even if they told us that it would not make sense to sell things for free and that we were crazy to do that in our niche of work... well, we were never able to properly explain it around here, we simply knew it was the right way. Eventually we figured that it was the somehow old Italian method that was wrong, not us. 
Our open source products and community involvement started to bring great jobs outside Italy and even overseas. While we still were not able to get work within a 100Km radius around our office (not one single job), we started to work in Germany, Finland, England, the United Arab Emirates, New York.

And obviously there were the projects in development countries, so important to Silvia :-). We were able to bring training sessions and our tools to Rwanda, Ethiopia and Kongo and work on water management systems. The sparkling new agreement with the GISMAP will help us to spread Geopaparazzi in the eastern side of the globe.

Silvia teaching Geopaparazzi in Arba Minch.

Teaching uDig and GIS at the University of Arba Minch.

Alright, I think I have kept you here for enough time now and my story is getting very confused. I know I missed many important things and people. Don't feel bad about it, this is a simple writedown, in a couple of hours, while browsing through old pictures and sensations.

One last thing I want to do is to thank those that believed in us even when there was no money and no future (well, that would be for about the first 6 years :-) ). Thanks to our families and partners, that supported us by any possible means. Thanks for being there, thanks for supporting without asking questions. Just thank you!


(In this picture, taken on HydroloGIS' 8th birthday, my mother and my sister Michela are missing. My mother was taking the picture and Michela lives too far away to be able to attend to every party we throw :-). I want them to know that they are part of it.)

Thanks also to Silvia, with who I had the luck to share these last 10 years. It has been sometimes difficult, she is soooooo hard-headed, but then I know I am too. :-) Thanks for letting me try all those things, even if no evident money would come out of it and we were starving :-) Thanks for being the other half of HydroloGIS.


HydroloGIS is Tony and Silli.

Last but not least, thanks to all of you that have sympathized with our concept of leading such a small company the meritocratic and open source way. We know you are out there and we have always been honoured when you told us how much you respect and like us.

Happy 10th birthday HydroloGIS, while my eyes are getting slightly wet...




Wednesday, January 14, 2015

Geopaparazzi (almost only) bugfix release 4.1.1

A user from the Italian GFOSS mailinglist made me aware of a nasty bug in the new polygon editing system. Basically when merging two polygons creating a new polygon, the result would not be written on a multipolygon layer, which is simply wrong.

This has been fixed and since there was also a small leftover checkbox on the new project creation dialog (which looked really really ugly) I decided to do a bugfix release.

I also threw in language updates.

Why were they necessary?
Well because obviously in the meanwhile a new feature entered Geopaparazzi.

It is now possible to continue a previously closed log. When you start a new log you will now have a checkbox available that by default is set to off. If for any reason you want to continue from the previously closed log, check that one. No new log will be created, data will be attached to the last inserted.


Pay attention to what you do though. The system will not care about the fact, that the previous log was closed a week before. You might have strange results in the speed chart :-)

Enjoy!!

Friday, January 9, 2015

Geopaparazzi 4.1.0 is out: beam it to me!

Well, as sad as I am that Geopaparazzi 4.1.0 doesn't support Android versions before 4.1, it was definitely time to move on from version 2.3. For those with older devices version 3 of geopaparazzi will hopefully work.

This gave me finally the possibility to do something I dream of since watching Star Trek as a kid: BEAMING!!!

So this will be presented as feature number one for this new version. :-D

1) Beaming of gps logs between devices

Assume you are on a survey and your battery is dying. Assume you have a second device you can use with full battery. You need to send the data over in order to continue your project there.

Well, one version is to somehow share your project database through wifi (if available) or connecting to a pc.

Well, now you have a much quicker way, even if for now only for gps tracks (and only if your phone supports NFC).

Make sure NFC is activated and follow this short howto:



Isn't that incredibly cool? :-)

2) Share your current position

Well, lately one thing made me very upset. My mother, which uses geopaparazzi when she goes hiking, used to share her position through the SMS function (the one available from the panic view). She recently upgraded her mobile plan with internet connection and started to share her position through telegram instead:

Do you see the problems? First, at least family has to stick together and she has to use geopaparazzi to share her position :-) and second I can't have her using Google Maps instead of Openstreetmaps to show me were she is. It simply doesn't work.

So I removed the send data via sms function, which was quite experimental and not used and added the Share Position function, which is now available in the maps view menu:






This will take you to the usual android sharing screen and if you select for example telegram, the OSM link to the position + marker will be sent:


And the link will bring you to:


3) Spanish localization

I am very happy to welcome on board a new translator for Spanish. That translation has been unmaintained in the last years, so I am very happy this important language is supported properly!


4) Bugfixes

Apart of the two above features, some last minute bugfixes went in:
  • zoom to track start/end not working
  • crash with enquiry on Spatialite layer with null attribute
  • GPX exports only node

As usual you will have to wait until google play throws out the version.

Enjoy and beam!!!


Thursday, January 8, 2015

GISMAP and HydroloGIS together on international projects for cooperation in developing countries

GISMAP and Hydrologis have signed an agreement to strengthen their collaboration in the framework of international projects for cooperation in developing countries. The main goal of this partnership is to jointly implement advanced tools for field data collection and analysis with related training activities.

GISMAP e HydroloGIS hanno firmato un accordo per rafforzare la loro cooperazione nel quadro di progetti di cooperazione internazionale nei paesi in via di sviluppo. L'obiettivo principale è la realizzazione di strumenti tecnologicamente avanzati per la raccolta e l'analisi dei dati di campo insieme alle attività di formazione collegate

GISMAP et HydroloGIS ont signé un accord pour renforcer leur collaboration dans le cadre de projets internationaux de coopération dans les pays en développement. L'objectif principal de ce partenariat est de mettre en œuvre conjointement des outils technologiquement avancés pour la collecte et l'analyse de données de terrain ainsi que la réalisation des activités de formation y référant.

GISMAP und Hydrologis haben ein Abkommen zur Konsolidierung ihrer Zusammenarbeit auf internationalen Projekten in Entwicklungsländern unterschrieben. Hauptziel dieser Partnershaft ist es zusammen sowohl fortgeschrittene Werkzeuge zur Felddatenerfassung und Analyse zu entwickeln also auch dafür Schulungen zu bieten.

GISMAP y Hydrologis han firmado un acuerdo para reforzar su colaboración en el marco de proyectos internacionales de cooperación en países en desarrollo. El objetivo principal es implementar conjuntamente herramientas avanzadas para la recolección y análisis de datos de campo junto con la realización de las actividades de formación relacionadas


وقعتGISMAPوHydroloGISاتفاقيةلتعزيزالتعاونبينهمافيإطارالمشاريعالدوليةللتعاونفيالبلدانالنامية.
الهدفالرئيسيمنهذهالشراكةهوتنفيذبالاشتراكأدواتمتطورة من الناحية التيكنولوجية لجمعالبياناتالميدانيةوتحليلهاو تقديمأنشطةالتدريبالمتعلقة بها.





I am particularly excited by this announcement. HydroloGIS and GISMAP will be working together tightly to supply open source tools and training in developing countries. It is an amazing synergy for us, that will among other things push Geopaparazzi on cheap devices to do good for the people. Bringing open source tools to the people has been HydroloGIS' dream and aim since its beginning.
Thanks to GISMAP for reaching out for us in this quest.
 

Tuesday, January 6, 2015

How to properly create spatialite data for geopaparazzi

This has been asked quite some times and too often people complain about the fact that spatialite databases created in QGIS are not visible in Geopaparazzi.

I know, I also wish it was always simple and straight forward.

What I can do right now, is to show you the procedure I follow to create vector data to work with in geopaparazzi. It uses Spatialite-GUI though, not QGIS.

1) Download the Spatialite-gui

You can find it on the spatialite homepage, at the time of writing a good version for windows is version 1.7.1 available in this download area.

Open it and find yourself with:






2) Create a new empty database in which to load the shapefile data





You will be asked to save the database somewhere on disk. Once done, you should find yourself with something like this, but with different path:



3) Load the shapefile

To do so locate the Load Shapefile icon:





In this example I will import a set of shapefiles from the Natural Earth dataset, in particular the following onces:




that can be found here.

The import dialog is the important one to fill the right way:





The really important things to take care of, are underlined in red:


  1. the SRID, i.e. the EPSG code of the data projection. If that one is not right, then you will not be able to see the data in geopaparazzi. Don't even hope in miracles!
  2. the Charset Encoding. Make sure to choose the right one. For example Japanese people might want to choose SHIFT_JIS if they want to see the labels rendered properly
  3. force the creation of the spatial index
If you then the push the ok button, you should find yourself with an ok message like this after the import:





You are almost there, one last step to go.

Right-click on the database name and select the Update Layer Statistics command.





Depending on the amount of data it should keep your harddisk working for a bit. Don't think it finished unless you see a result like the following:





Once this result appears to you, you are good to go.

Move the spatialite database to your device, fire up geopaparazzi and go directly to the spatialite data view (from the mapview).

You should see something like:


Enable the countries and places layer, maybe also activate the labels for the places layer. And voila'!



This has always worked for me. I hope it will solve any issue people might have.









Thursday, November 20, 2014

Geopaparazzi 4.0.1 is out: Welcome to Slovakia!

Geopaparazzi 4.0.1 has been released to google play.

This is mostly a language update release and includes Slovak as new supported language.

This is the current status of the localization effort:



Some languages need more love than others. Do you have that love to share?
Just jump on the geopaparazzi translation site.





We also hit the 10000 installs badge in google play. That is not so bad for an engineering app, right? :-)






Release note have changed place as well as the download area for those without access to google play. This is thanks to the fact that the amazing Github gives a clean and simple space to add releases with binary downloads.



And that's also quite all. Enjoy!

Monday, October 6, 2014

Geopaparazzi at FOSS4G 2014 Osaka/Tokyo

This year I have the great honor to be invided to attend and present a the FOSS4G in Osaka and Tokyo and do some research with the team of professor Venkatesh Raghavan.

There will be to mainstreams we will contribute to:

Geopaparazzi

http://www.geopaparazzi.eu

This is quite natural, since the Japanese is one of the most supportive communities to the project.

Well, we do not know all the details about the program yet, but we know for sure that apart of the talks there will be a:

Hands-on workshop:  27 Oct 2014: FOSS4G-Osaka

Code Sprint: 25 Oct 2014: FOSS4G-Osaka

I have to admit that for me as author of Geopaparazzi it is amazing to attend the first geopaparazzi code sprint in Osaka. I do love code sprints!

I know for many of you it is far, but maybe some nearby community members can come? It would be great to meet you in person and maybe discuss some future geopaparazzi features.


uDig, the Spatial Toolbox and LESTO

http://udig.refractions.net


We will give some presentation about uDig and its Spatial Toolbox, both from a technical point of view as well as a user pooint of view.



We will also introduce the LESTO toolbox, which enables LiDAR data processing in the Spatial Toolbox.To get an idea about LESTO, have a look here.



That is all for now. But we'll keep you posted as soon as we have news.