An interactive map that uses machine learning algorithms to detect fields and crops

OneSoil Map allows to explore and compare fields and crops in Europe and the United States (44 countries in total). The overview map helps to understand patterns of fields sizes and crops in different regions. Zooming in enables to know a specific field in detail: the hectarage, the crop, and the field score. Besides, the key feature of the map is that it allows users to see how these fields have changed over the past three years (2016 – 2018). The map reveals insights about local and global trends in crop production for farmers, advisers, and dealers. It helps to predict market performance at all levels and fosters smart decision-making.

Data collection and technology

The map was created by the startup OneSoil and is a continuation of the OneSoil digital farming platform, which automatically detects fields, identifies crops through satellite imagery analysis. The core technologies are based on AI, deep learning models, computer vision, IoT and original machine learning algorithms, which enable the company to process data in real time:

“First, we learned how to clean the satellite photos from artifacts to ensure correct processing of information. Second, we trained an algorithm to allocate field boundaries automatically. For the map, we simplified the boundaries so that the visualization is really fast. The accuracy of crop classification, or F1 score, is 0.91. Third, we trained another algorithm to automatically determine a crop that grows on a field. Fourth, we created what you can now see: the map.

 

 

Digital technologies for museums

The School of Applied Mathematics (EMAp) and the School of Social Sciences (CPDOC) from  Getúlio Vargas Foundation (FGV) will organize and host the First Panorama in Digital Technologies for Museums (I Panorama em Tecnologias Digitais para Museus) on November 27, 2018.

The objective of this Panorama is to present the demands of the museological sector, as well as reflections on previous experiences. Given the scenario of the recent disaster of the National Museum of UFRJ, it is necessary a reaction of all the actors involved in the theme: managers, researchers, educators and other sectors of society.

The event will discuss the strengthening of a knowledge network around the use of digital technologies in the museum context. Likewise, it is necessary to consider impacts related to the diffusion of the collections of these museums, understanding that the society’s engagement with the issue, as well as the development of a close relationship between population and museums, is one of the ways of preserving, collecting and maintaining investments in these institutions.

Representatives of diverse institutions will participate as speakers in this event. Among them, my Ph.D. co-advisor and coordinator of the Visgraf Laboratory, Luiz Velho.

Collection and Digital Libraries Guide

The “Collection and Digital Libraries Guide” (Guia de Bibliotecas Digitais e Acervos Online, Portuguese only), published by the State Government of São Paulo, Brazil, lists 76 collections and digital libraries with free contents, including images, for consulting and download on different topics. The indicated collections are maintained by important national and international institutions, constituting a wide repository of cultural collections that can contribute to the development of research and motivate the sharing of knowledge in various areas through the internet.

 

A map that reveals patterns of arrangement of buildings

A dataset containing 125,192,184 computer generated building footprints in all 50 US states is the source for a New York Times’s map of every building in America.

Published on 12th October, this map represents every building in the US by a black speck, reflecting the built legacy of the United States.

The dataset was publicly released by Microsoft early this year. The company’s computer engineers trained a neural network to analyze satellite imagery and then to trace the shapes of buildings across the country.

DNN architecture: The network foundation is ResNet34. The model is fully-convolutional, meaning that the model can be applied to an image of any size (constrained by GPU memory, 4096×4096 in the case).

The map reveals patterns in the arrangements of buildings. Traditional road maps highlight streets and highways; here they show up as a linear absence. As a result, “… you can read history in the transition from curving, paved-over cow paths in old downtowns to suburban sprawl; you can detect signals of wealth and poverty, sometimes almost next door to each other.”.

In the south of New Orleans, it’s possible to notice the layout of buildings along a narrow spit of land on either side of a Louisiana bayou, which may reflect the imprint of the region’s history under France: “… “long lot” development, which stretched skinny holdings laterally away from important waterways. Geography shapes settlement, but culture does, as well.”
Buildings along Louisiana bayou

Crotos: a project on visual artworks powered by Wikidata and Wikimedia Commons

Crotos is a search and display engine for visual artworks based on Wikidata and using Wikimedia Commons files.

The Wikidata extraction contains more than 133 866 artworks (September 2018) including 66 271 with HD image. This extraction is regularly automatically updated from Wikidata on the basis of the nature of the items and corresponds to visual artworks such as paintings, photographs, prints, illuminated manuscripts and much more.

The interface

Searches can be made by free or indexed search through a user interface. Results are displayed by chronological order with thumbnails. Links on thumbnails open a viewer with the image hosted on Wikimedia Commons.

It is possible to filter the results by type (painting, sculpture, print…) or to specify a period as a criterion.

By default, without criteria, a random selection is displayed. Besides with the Cosmos interface, it is possible to discover the artworks by indexation (par type d’œuvre, creator, movement, genre, collection…).

Descriptors

For each resulting image, the interface displays the title, the creator(s)  and the collection or the location where the artwork is maintained. These information are on Wikidata, a free, collaborative, multilingual, secondary database, collecting structured data to provide support for Wikipedia, Wikimedia Commons, the other wikis of the Wikimedia movement, and to anyone in the world.

Additional descriptors are date or period, nature of work, material used, inventory number, movement, genre, depicts, main subject, and so on. A full list of descriptors is mentioned here.

Contribution mode

The project has a contribution mode, useful for identifying missing information with facets. Finally, source is on github and the database of Crotos can be downloaded. Both are under Free Licence.

Sound heritage

Conserve the sound is an online museum for vanishing and endangered sounds. The sound of a dial telephone, a walkman, an analog typewriter, a pay phone, a 56k modem, a nuclear power plant or even a cell phone keypad are partially already gone or are about to disappear from our daily life.

Conserve the sound is a project form CHUNDERKSEN and is funded
by the Film & Medienstiftung NRW, Germany.

“Existência Numérica” – dataviz exhibition

The exhibition “Existência Numérica” (“Numerical Existence”), that will open on September 17 at Oi Futuro (Rio de Janeiro, Brazil), presents visualization works approached poetically. Migration flow, urban mobility in rental bicycle systems in New York, London and Rio, investments in science and technology made in Brazil in recent years, are some of the themes addressed by Brazilian and foreign artists who are at the forefront of data visualization, an area where art meets computer science.

The exhibition, conceived by Barbara Castro and Luiz Ludwig and curated by Doris Kosminsky (from Labvis Laboratory), will occupy the galleries of Oi Futuro, with dataviz projects by Pedro Miguel Cruz, Till Nagel & Christopher Pietsch (from the Urban Complexity Lab), Alice Bodanzky, Barbara Castro, Doris Kosminsky & Claudio Esperança and Luiz Ludwig.

A roundtable with the presence of artists and researchers will take place on September 19 from 3:00 p.m. to 6:00 p.m.

A tragedy foretold: Brazil’s national museum hit by huge fire

On the evening of September 2, 2018, a massive fire broke out at the National Museum of Brazil at Quinta da Boa Vista, Rio de Janeiro, destroying almost all of the historical collection spanning over two hundred years, which included over twenty million items in its catalog. In addition to this rich collection, the building itself was the former residence of the Emperor of Brazil. It was extremely damaged, experiencing cracks, the collapse of its roof, and failures of the internal slabs.

Wikimedia Commons initiative is helping to recover part of the historical collection

One of the most immediate challenges is to recover and preserve images of the museum building and its collection, as our visual memory of these items is now our main asset. Anyone who has visited the museum and taken photographs of the buildings and its objects or someone who knows another person who has taken photographs can help: create an account at the Wikimedia Commons and upload the relevant photos.

Visit the Wikipedia page of the National Museum of Brazil project for more information.

Wikipedia page of the National Museum of Brazil project

 

From tulip-mania speculation to the cryptocurrency market

Drawing historical parallels from “tulip-mania” that swept across Netherlands/Europe in the 1630s to the speculation currently ongoing around crypto-currencies, Mosaic Virus, created by the artist and researcher Anna Ridler, is a video work generated by a GAN (Generative Adversarial Network), an artificial intelligence (AI) technique that makes computers creative.

The video shows a tulip blooming, an updated version of a Dutch still life for the 21st century. The appearance of the tulip would be controlled by bitcoin price. “Mosaic” is the name of the virus that causes the stripes in a petal which increased their desirability and helped cause the speculative prices during the time. In this piece, the stripes will depend on the value of bitcoin, changing over time to show how the market fluctuates.

Text adapted from Anna Ridler’s website.

IMS Photography Research Grant

In order to stimulate the research of the history of Brazilian photography and the works of its collection, Instituto Moreira Salles, holder of one of the most relevant photographic collections in Brazil, is promoting the first edition of the IMS Photography Research Grant. An unprecedented project will be selected based on the production of Marc Ferrez (1843-1923), one of the most important Brazilian photographers of the 19th century, whose work has been under the custody of IMS since 1998.

Entries are from July 16 to August 31, 2018, and the final result will be announced in October.

Grant announcement, application form and additional information here (Portuguese only)