A “Best Paper” on Big Data Signal Processing (Intel Labs@SC12)

It was just announced at the awards session at SC12 that Intel has won “best paper” for research into more efficient processing for a fundamental calculation in high performance computing, entitled “A Framework for Low-Communication 1-D FFT.”

Numerous wave applications (e.g. sound, radio) rely on the Fast Fourier Transform (FFT) including signal processing, communications, and multi-media. However, it is a very challenging problem to parallelize effectively. This is because for big FFT datasets running on large clusters, 50%-90% of time can be spent waiting on node-node data transfers rather than useful calculation.

Intel’s Software and Services Group & Intel Labs devised a new framework for distributed 1-D FFT problems which traditionally require three costly all-to-all inter-node data exchanges. The new approach delivers multiple 1D FFT algorithms requiring just a single all-to-all inter-node data exchange. According to the research, for large-scale problems this can double FFT performance (see the paper for details). Another key feature is that users can opt to further increase FFT performance by accepting reduced-accuracy results, so the algorithms scale to fit the needs of the particular application.

 

About Sean Koehl

Sean Koehl (@smkoehl) is an Intel Labs Technology Evangelist working to increase awareness of Intel’s technology research and vision for our future data society. Sean joined Intel in 1998 as an engineer working on silicon optical debug and spent the next five years contributing to the design, packaging and testing of silicon photonics devices. He has spent the past decade leading projects and events to evangelize R&D on silicon photonics, many-core, visual computing, Big Data and other areas. Sean received a B.S. in Applied Physics from Purdue University and holds seven patents.

Comments are closed.