Story image

High demand for Google’s machine learning processor in NZ

22 Mar 2018

Strong local demand for Google’s new generation of Cloud TPUs (Tensor Processing Units) means Kiwi businesses and consumers will benefit from better services and greater productivity.  

Google’s Tensor Processing Units, released into public beta last month, are hardware accelerators optimised to speed up and scale up Machine Learning (ML) workloads.

Google Cloud New Zealand’s Brendan Bain says interest from New Zealand businesses shows there is real appetite locally to start leveraging the technology.

“The benefit to business is much faster training of Machine Learning models, in some cases reducing from several weeks to several hours. That’s like moving from basic dial-up to broadband overnight, and the productivity boost will be significant.

“Kiwi consumers can expect smarter, faster services across the board, from online shopping to old-fashioned big box retailing,” Bain says.  

A large number of Kiwi businesses are already using Machine Learning on a daily basis. 

Trade Me, which uses it to improve its search function and make recommendations to users, is one business planning to use Google’s TPUs. 

Lead data scientist Lester Litchfield says they offer a lot of opportunities to improve the site.

“TPU's will help us iterate and explore ideas quicker, and present fresher models to our users. We'll be able to deliver better experiences faster than we can with traditional CPU and GPU powered Machine Learning,” Litchfield says.

Why TPUs for machine learning?

Traditionally, writing programs for custom ASICs and supercomputers has required deeply specialised expertise.

By contrast, Cloud TPUs can be programmed with high-level TensorFlow APIs, and Google has open-sourced a set of reference high-performance Cloud TPU model implementations to help users get started:

  • ResNet-50 and other popular models for image classification
  • Transformer for machine translation and language modeling
  • RetinaNet for object detection

Google continuously test these model implementations both for performance and for convergence to the expected accuracy on standard datasets.

Over time, Google is planning to open-source additional model implementations.

Adventurous ML experts may be able to optimise other TensorFlow models for Cloud TPUs on their own using the documentation and tools provided.

How big data can revolutionise NZ’s hospitals
Miya Precision is being used across 17 wards and the emergency department at Palmerston North Hospital.
Time's up, tax dodgers: Multinational tech firms may soon pay their dues
Multinational tech and digital services firms may no longer have a free tax pass to operate in New Zealand. 
Spark’s new IoT network reaches 98% of New Zealand
Spark is the first company to confirm the nationwide completion of a Cat-M1 network in New Zealand.
WhatsApp users warned to change voicemail PINs
Attackers are allegedly gaining access to users’ WhatsApp accounts by using the default voicemail PIN to access voice authentication codes.
Robots to the fore – Key insights for New Zealand Business into RPA in 2019
From making artificial intelligence a business reality to closer ties to human colleagues, robotic process automation is gearing up for a strong 2019.
50 million tonnes of e-waste: IT faces sustainability challenges
“Through This is IT, we want to help people better understand the problem of today’s linear “take, make, dispose” thinking around IT products and its effects like e-waste, pollution and climate change."
Vocus & Vodafone unbundle NZ's fibre network
“Unbundling fibre will provide retail service providers with a flexible future-proofed platform regardless of what tomorrow brings."
IDC: A/NZ second highest APAC IoT spenders per capita
New IDC forecast expects the Internet of Things spending in Asia/Pacific excluding Japan to reach US$381.8 Billion by 2022.