Nearmap switches to Snowflake cloud services

By on 28 July, 2020

Nearmap has switched from Amazon Redshift to Sydney-based Snowflake to manage ‘exponential’ increase in data.

The announcement comes after the launch of Nearmap AI last month, which has led to a surge in data volume, according to the company.

“By virtue of what we do, Nearmap is a very data rich environment,” said Nearmap’s data engineer, Jonathan Mak.

“We need to effectively manage data and ensure it’s adding as much value to the business as possible. With Redshift, storage and compute resources are coupled. If you want more storage, you pay for more compute. These costs would become unsustainable, so we knew it was time to find an alternative.”

Mr. Mak said that the decision was made easier by tight integration with AWS, which Nearmap was already using, and deployment was streamlined due to the modular architecture of Nearmap’s data stack.

Following the deployment, query resolution times have dropped by a factor of five, and all data is now stored in Snowflake’s data warehouse component.

“All business data is now stored in a single data warehouse, reducing complexity and costs while we’re benefitting from near-zero maintenance which is reducing management overhead.  At the same time, the platform’s ability to scale and its impressive levels of performance will ensure it continues to be a critical part of Nearmap’s IT infrastructure,” Mak said.

Stay up to date by getting stories like this delivered to your mailbox.
Sign up to receive our free weekly Spatial Source newsletter.

You may also like to read:


, , , , , , , ,


Newsletter

Sign up now to stay up to date about all the news from Spatial Source. You will get a newsletter every week with the latest news.

Interview: Tori Murrant, GIS analyst
Having stumbled across the geospatial sector at university, ...
Testing SouthPAN and commercial GNSS services
UNSW surveying students were challenged to put a range of So...
Here’s what’s in our latest issue!
Learn about the metaverse, mapmaking, 3D scanning, RINEX, hy...
Modern Methods of Construction Roadshow
The events will show how the latest software, tools and tech...
Real-time LiDAR mapping system
The Brumby LiDAR rapidly produces point clouds by removing t...