Intel: 'We could easily have CPUs with hundreds of cores'

Multi-core

There's more to processor performance than simply packing transistors onto a die, of course, as John Moore, vice president of design and innovation at UK semiconductor trade association NMI, points out. "There's only so far we can go before heat density begins to cause problems", he says: that is, the more transistors on a chip, the hotter it gets, and that causes all kinds of reliability issues. "The days of the big, powerful single-core beasts are ending: the future is more about distributed processing; multi-core."

Intel's Antonio Gonzalez agrees. "We could use all these extra transistors to create a single big core," he says, "however, placing multiple cores on a single die delivers a much better solution in terms of performance and energy efficiency."

We've seen some of the results of this approach today, where even budget systems may come with quad-core CPUs, essentially delivering four processors for the price of one. But Gonzalez believes this is just the start.

Intel has already produced an 80-core "Teraflops Research Chip", he points out, and even this isn't an exceptional number: "We could easily have CPUs with hundreds of cores. There are still challenges to meet before this will be practical, but I'm optimistic that we are heading in the right direction, this is a very valuable trend."

80 core chip

HARDCORE: An Intel research project has already produced a chip with 80 cores - and we might see CPUs with hundreds more in the future

Not everyone is quite so enthusiastic about such high numbers of cores. Alex Katouzian, VP of product management at Qualcomm CDMA, comments: "Our systems can go up to at least four cores, 2.5GHz, and I'm sure we'll be able to push these up even more, but from a software perspective there's only so much extra performance this will buy. Because while some applications are truly multi-threaded - web browsing, gaming - most remain single-threaded. And so in the mobile space at least, there will quickly come a time when you stop adding more cores, and instead concentrate on power efficiency."

Snapdragon

ALL IN ONE: Some CPUs are about pure performance. Qualcomm's Snapdragon aims to be a complete system, including a GPU, 3G/LTE modem wifi, GPS, Bluetooth, FM and more on one chip

John Moore also believes the move to multi-threaded applications is key. "The real challenge now isn't the hardware, as much as in creating the software that can take advantage of it. We have generations of software engineers that have been raised to think sequentially, and breaking a problem down into parallel threads instead - and then understanding how to test and debug that code - is no easy task."

However, Intel recognises these issues, says Gonzalez: "We're investigating new programming paradigms for the future," he points out, "as well as working on new tools that will help to parallelise these apps, much more easily than is possible right now."

But, crucially, multicore doesn't just mean adding more regular CPU cores to a die, as ARM's Nayampally points out. "ARM started this multi-processing push back in 2003", he said, "but these extra cores could be DSPs, a GPU, modem, GPS unit, whatever best suits your application."

And this approach, common in the mobile space, is now being taken up by Intel, says Gonzalez: "We're also looking to add more specialised components to the processor, like the GPU and multimedia support in the Sandy Bridge CPUs. This kind of integration cuts latencies, delivers a much better solution in terms of performance and energy efficiency, and delivers these benefits right now - even on single-threaded apps."

Future developments

So what new technologies will these future CPU improvements enable?

For the next few years it looks like business as usual. Transistors will continue to shrink; the number of cores will go up; and our desktops will increase in speed just as they always have.

Applications will become increasingly multi-threaded, and take advantage of other performance-boosting technologies, like GPU acceleration. And a strong focus on energy efficiency means that portable devices should see improvements in both CPU power and battery life.

After that, though, the availability and low price of fast, low-power CPUs will mean that they'll increasingly be used all around us, suggests Intel's Antonio Gonzalez: "In the near future we are going to see a much wider range of computing devices that we have today. There will be more powerful systems in our car, in the house, security systems, even simple robots that may help in domestic activities [that's cleaning the carpet, rather than preparing lunch, probably]. Just a host of devices that in some way analyse the environment around them and provide real world responses."

This isn't science fiction, either: it's happening now. So, for instance, accelerometer chips are being developed at the University of Southampton that will monitor how a section of track behaves when a train passes over it. It can then detect variations in response that might indicate a loss in structural integrity, and warn engineers before this becomes serious enough to cause an accident.

Railtrack integrity

NEXT-GEN: A new generation of chips is being developed that will sense the world, and respond to it - for example, monitoring rail tracks and alerting engineers to imminent structural failure

The Royal Veterinary College is developing another accelerometer-based chip that, when attached to the leg of a horse, can analyse its gait pattern. Detecting small changes in these could help to quickly detect and rest injuries that might otherwise go unnoticed, at least initially, and the same technique may also be applicable to professional athletes.

Elsewhere, Qualcomm believes that our homes will become filled with new smart devices that will help us out in a host of interesting ways. And they won't be boring, static boxes: rather, just like your mobile, they'll have internet connectivity and you'll be able to customise them in a host of useful ways: "In many instances, consumers will be able to download applications to products such as home energy management systems, security systems and connected home products to add new features and functionalities," writes Qualcomm.

Intelligence everywhere

This extra intelligence will be everywhere, presenting all kinds of new opportunities. We may see alarm clocks that have the connectivity and intelligence to detect traffic problems, for instance, and know to wake you a little earlier. NEC is currently testing smart advertising billboards which can identify the age and gender of passers-by, and tailor its display to offer something appropriate to their demographic. And many similar ideas will see smart devices everywhere adapt their functions to suit our presence and needs.

Qualcomm's Alex Katouzian suggested that augmented reality technologies will also become more important. "You might see a sign on a bus, advertising a newly released record," he says. "You point your mobile at it, and a view a piece of concert footage for that artist, a video, or whatever." The system is smart enough to provide instant context to what you're viewing in many different situations.

ARM chip

LIFE-CHANGING: Future CPUs will power smart devices that will change our lives in a host of interesting ways

And this is just the start. The University of Washington has, since 2009, been producing contact lenses with built-in electronics, including a small heads up display. These are early days, but link this with a sufficiently powerful CPU, and, as Microsoft's Steve Clayton points out, there are all kinds of amazing possibilities:

Heads up displays of all types could be imagined. You could walk in to a room and instantly be reminded of everyone's name, their kids' birthdays and their latest status updates on Facebook or Twitter - all without them seeing what you see.

When navigating a strange city, you could be directed without ever having to look down at a map. As an article on TechNet notes, there are other uses such as assisting diabetic wearers keep tabs on blood-sugar levels without needing to pierce a finger.

Amazing. But again, not just science fiction - all these ideas have a basis in solid projects that have delivered very real results. There remains a long way to go, but as we've seen, there's also plenty of scope for CPU improvements to make these kind of things happen.

So while the huge growth in processor performance over the past few years has undoubtedly delivered a host of interesting new technologies, there are many more just around the corner, some that we can barely imagine.

Mike Williams
Lead security reviewer

Mike is a lead security reviewer at Future, where he stress-tests VPNs, antivirus and more to find out which services are sure to keep you safe, and which are best avoided. Mike began his career as a lead software developer in the engineering world, where his creations were used by big-name companies from Rolls Royce to British Nuclear Fuels and British Aerospace. The early PC viruses caught Mike's attention, and he developed an interest in analyzing malware, and learning the low-level technical details of how Windows and network security work under the hood.