Nearmap has switched from Amazon Redshift to Sydney-based Snowflake to manage ‘exponential’ increase in data.
The announcement comes after the launch of Nearmap AI last month, which has led to a surge in data volume, according to the company.
“By virtue of what we do, Nearmap is a very data rich environment,” said Nearmap’s data engineer, Jonathan Mak.
“We need to effectively manage data and ensure it’s adding as much value to the business as possible. With Redshift, storage and compute resources are coupled. If you want more storage, you pay for more compute. These costs would become unsustainable, so we knew it was time to find an alternative.”
Mr. Mak said that the decision was made easier by tight integration with AWS, which Nearmap was already using, and deployment was streamlined due to the modular architecture of Nearmap’s data stack.
Following the deployment, query resolution times have dropped by a factor of five, and all data is now stored in Snowflake’s data warehouse component.
“All business data is now stored in a single data warehouse, reducing complexity and costs while we’re benefitting from near-zero maintenance which is reducing management overhead. At the same time, the platform’s ability to scale and its impressive levels of performance will ensure it continues to be a critical part of Nearmap’s IT infrastructure,” Mak said.
Stay up to date by getting stories like this delivered to your mailbox.
Sign up to receive our free weekly Spatial Source newsletter.
