Nearmap switches to Snowflake cloud services

By on 28 July, 2020

Nearmap has switched from Amazon Redshift to Sydney-based Snowflake to manage ‘exponential’ increase in data.

The announcement comes after the launch of Nearmap AI last month, which has led to a surge in data volume, according to the company.

“By virtue of what we do, Nearmap is a very data rich environment,” said Nearmap’s data engineer, Jonathan Mak.

“We need to effectively manage data and ensure it’s adding as much value to the business as possible. With Redshift, storage and compute resources are coupled. If you want more storage, you pay for more compute. These costs would become unsustainable, so we knew it was time to find an alternative.”

Mr. Mak said that the decision was made easier by tight integration with AWS, which Nearmap was already using, and deployment was streamlined due to the modular architecture of Nearmap’s data stack.

Following the deployment, query resolution times have dropped by a factor of five, and all data is now stored in Snowflake’s data warehouse component.

“All business data is now stored in a single data warehouse, reducing complexity and costs while we’re benefitting from near-zero maintenance which is reducing management overhead.  At the same time, the platform’s ability to scale and its impressive levels of performance will ensure it continues to be a critical part of Nearmap’s IT infrastructure,” Mak said.

Stay up to date by getting stories like this delivered to your mailbox.
Sign up to receive our free weekly Spatial Source newsletter.

You may also like to read:


, , , , , , , ,


Newsletter

Sign up now to stay up to date about all the news from Spatial Source. You will get a newsletter every week with the latest news.

  • This field is for validation purposes and should be left unchanged.
Indigenous satellite ground station is online
Two new full motion antennas to provide access to Earth obse...
Rocket Lab launch fails to reach orbit
Second-stage burn failure resulted in loss of spacecraft and...
Australia’s space sector needs more than science and engineering
A call to arms to the professional sector to engage with Aus...
Euclideon launches free streaming 3D service
New 'freemium' service generates 3D models from massive poin...
Klau Geomatics launches mapping payload for DJI M300
A new survey grade payload for DJI's flagship....