A new era for VPN testing? ATMSO publishes the first-ever testing standards in an "important milestone"

A VPN running on a mobile device
(Image credit: Getty Images)

Leading cybersecurity company AMTSO has just unveiled its "first-ever" standards for VPN testing.

AMTSO, short for Anti-Malware Testing Standards Organization, is an NGO established in 2008 to improve the quality of anti-malware testing methods. On February 19, 2025, the experts published the VPN Performance Testing Guidelines to help enhance fair privacy and security for VPN assessments.

Regular security and privacy audits carried out by independent experts have become a common practice among the best VPN providers. Third-party audits are users' guarantee their VPN service does what it claims to be.

New VPN testing guidelines

The recent publication, developed by AMTSO's VPN working group, which includes VPN vendors and testers, is only the first in a series of VPN standard guidelines.

"This first release is an important milestone in our mission to provide testing guidance in the world of privacy and security," said John Hawes, COO of AMTSO. "By setting clear benchmarks, we enable fair comparisons and help users make informed choices when selecting a VPN provider."

AMTSO's VPN testing guidelines include key aspects that testers must check when assessing the software's performance.

These include launch on-boot and auto-connection testing to ensure VPNs activate automatically for maximum protection, kill switch tests to verify that no data leaks occur when the VPN connection drops, check whether VPNs effectively block DNS, IP, and WebRTC leaks, and split tunneling testing.

Did you know?

A hand holds a smartphone displaying the NordVPN logo

TechRadar's top pick NordVPN has recently proved its no-logs claims with a successful independent audit. It's then official – NordVPN never stored users' data. This was the fifth third-party audit of its privacy policy since 2018.

According to AMTSO's guidelines, testers should also evaluate how VPN services perform under different network conditions while measuring how well VPNs maintain access to websites.

Virtual private network (VPN) apps have become crucial tools for many people worldwide who want to regain control over their online privacy. A VPN encrypts all users' connections to avoid third-party access and spoofs their IP address to keep their online activities anonymous.

IP spoofing is also why increasingly more people are using streaming VPN services to keep up with their favorite shows while traveling.

Even more notably, VPN usage is soaring for the same reason among citizens living under a restricted internet environment as a censorship-resistant tool. As per ProtonVPN's latest data, 119 countries saw VPN usage spiking throughout 2024.

All this interest in VPN solutions makes it even more crucial to follow a standardized process when assessing these services.

AMTSO is now inviting independent testers and VPN vendors to adopt these guidelines. "Moving forward, the AMTSO VPN Working Group will expand its focus to include malware testing within VPN environments and additional security feature evaluations."

Chiara Castro
News Editor (Tech Software)

Chiara is a multimedia journalist committed to covering stories to help promote the rights and denounce the abuses of the digital side of life – wherever cybersecurity, markets, and politics tangle up. She writes news, interviews, and analysis on data privacy, online censorship, digital rights, cybercrime, and security software, with a special focus on VPNs, for TechRadar and TechRadar Pro. Got a story, tip-off, or something tech-interesting to say? Reach out to chiara.castro@futurenet.com

You must confirm your public display name before commenting

Please logout and then login again, you will then be prompted to enter your display name.

Read more
A repeating pattern of pink magnifying glasses on a light blue background
Why do VPN audits matter?
NordVPN running on a desktop, mobile devices, Apple TV, a router and a game console
NordVPN reacts to results from its latest security audit
VPN
7 VPN predictions to look out for in 2025
A VPN runs on a mobile phone placed on a laptop keyboard
The 3 biggest VPN innovations of 2024 – what does the future hold?
Screenshot of Obscura VPN website
Obscura VPN promises to “set the standard for the next-generation of VPNs”
Outlook Calendar on a Tablet
What we learned from VPNs in 2024
Latest in VPN Services
Harry Halpin, CEO and co-founder of Nym Technologies, and Chelsea Manning, Nym Technlogies' security consultant, on stage at the Frontline Club in London during the NymVPN launch on March 13, 2025.
NymVPN is now live – here's everything you need to know
Green background featuring laptop with connect button
I tried the "world's most secure VPN" and while it's not the VPN you'll want, you'll need it sooner than you think
ExpressVPN's Lightway Turbo upgrade – promo image
Can fast be faster? ExpressVPN promises it’s possible
AdGuard VPN during TechRadar tests
AdGuard becomes the latest VPN to add post-quantum encryption
ExpressVPN's new Linux app interface
ExpressVPN releases a major upgrade to its Linux app
NymVPN ap on mobile – promo image
NymVPN officially launches and claims to be "the world’s most secure VPN"
Latest in News
Google Pixel 8a in aloe green showing
Google Pixel 9a benchmark link teases the performance of the upcoming mid-ranger
Quordle on a smartphone held in a hand
Quordle hints and answers for Monday, March 17 (game #1148)
NYT Strands homescreen on a mobile phone screen, on a light blue background
NYT Strands hints and answers for Monday, March 17 (game #379)
NYT Connections homescreen on a phone, on a purple background
NYT Connections hints and answers for Monday, March 17 (game #645)
Apple iPhone 16 Pro HANDS ON
Leaked iPhone 17 dummy units may have given us our best look yet at all four models
A super close up image of the Google Gemini app in the Play Store
It's official: Google Assistant will be retired for phones this year, with Gemini taking over