Thermally-Aware Power Distribution Networks for Vertically Integrated Systems

Lead Research Organisation: University of Manchester
Department Name: Computer Science

Abstract

Electronic products have played an overarching role in our societies. The evolution of portable and handheld devices in the past two decades has further augmented the pervasiveness of electronics into our daily activities. In general, the majority of modern electronic products require a heterogeneous set of components. These products include common portable devices or sophisticated systems used in medicine and industry for safety, monitoring, prevention, or therapy. This system heterogeneity will be intensified in the future, since the primary demand for faster processing of the information is augmented by the requirement for accurate sensing and detection of environmental stimuli.
Although these devices have created a flourishing market, the design of high performance and low power computing systems beyond consumer demands remains an omnipresent challenge. The design of more powerful computers is driven not only by the need to answer important scientific questions but also to address new or on-going societal needs. A characteristic example is the data-centers which they offer a variety of services but the relating energy-cost is increasing at an alarming rate. To mitigate these issues scientists and researchers explore disruptive technologies. A promising technology is three-dimensional (3-D) or vertical integration. This emerging technology has appealed to both industry and academia for several reasons. For example, considering the case of portable products, a vertically integrated system can drastically reduce the size of the board, which hosts the various components, by stacking these subsystems into a multi-tier structure reducing the overall size and improving power consumption.
This project will contribute to the evolution of vertically integrated systems by providing new design techniques and innovative analysis tools for the power distribution network of these systems. To better explain the complexity as well as the significance of this task, consider the power grid that supplies our residences. A similar yet severely constrained grid provides current to each transistor within an integrated circuit. The design complexity of this network for vertical multi-tier circuits is much higher similar to the case where the electric installation of a multi-storey building is much more complicated than that of a house. The scale of the problem where billion of "consumers" (i.e. transistors) must be provided with abundant current underlines the need for faster and accurate analysis methods. In this project, the analysis will be complemented by optimization methods, as the resources for the power network are limited and compete with other resources. Using our civic analogy, think of a situation where phone and power cables compete for a limited open space.
Efficient solutions to this problem cannot resort solely to existing design methodologies and/or numerical techniques due to the size of the problem as well as the heterogeneity of the envisioned vertical systems. The proposed research therefore aims at advancing the analysis and design methods of power networks for integrated systems while considering the particular traits and constraints relating to these systems. The results of the project will boost this emerging technology, bringing vertical integration a stride closer to economical high-volume manufacturing.

Planned Impact

The project will have an explicit impact on design technologies for future multi-functional systems including primarily but not limited to electronic components. The immediate impact will be to augment analysis and design capabilities for the interested stakeholders. Within UK prominent corporations, such as ARM and Imagination technologies can exploit the outcomes of the project to ascertain the benefits of vertical integration for their future products. In addition, UK small and medium size enterprises (SMEs), such as Silvaco can benefit from the project. Silvaco is active in design automation and the investigated numerical algorithms and devised techniques, such as the monolithic vs partitioned approach in addressing multi-physics problems can be useful in those tasks that have high computational requirements. Maintaining the strong position of these established companies and leveraging the growth of SMEs within UK translates to a healthier economic environment for the British citizens. To further emphasize this point, consider that the new research framework Horizon 2020, recently launched by the European Union, includes a funding instrument exclusively for enhancing the development of SMEs and other provisions for economic growth through innovative research across Europe. Consequently, the proposed project is on the right track benefitting to the extend it can the electronics sector which currently contributes to 5.4% of the national GDP, employing about 850,000 across UK according to the report on Electronics Systems Challenges and Opportunities (ESCO). This report was composed by senior representatives of the British electronics industry and the Department for Business Innovation and Skills.
The success of this project will guarantee the design of highly robust vertical systems paving the way for the establishment of 3-D integration as a mainstream technology in semiconductors industry. Consequently, the implicit societal impact of the project will be considerable as this technology presents unique opportunities for energy-efficient computing, multi-functionality, and miniaturized products. These products in turn will satisfy customer demands but also contribute to important aspects of our lives including well-being, health care, and wellness. The distinct feature that vertical systems have and which also drives this research effort is that these systems can potentially provide the means to meet these social objectives with a smaller energy overhead and manufacturing cost as compared to state-of-the-art technologies.

Publications

10 25 50
 
Description We delivered a faster, more versatile compared thermal simulator to academic state-of-the-art simulators that determines the temperature across the area of an integrated system. Our tool is equally accurate to commercial tools and has been tested against them. In addition, it can analyze more complex geometries where these geometries are due to the surroundings of the silicon chip, that is the package and the heat sink that removes heat from the chip to the ambient. We have further developed our tool so that it now exhibits a higher performance (computational speed) and performs thermal analysis at the standard cell level.
Exploitation Route Other researchers can use this tool to develop their thermal-aware circuit design methods and this is already happening slowly but steadily. We have already two UK universities who plan to use our tool for their research. The researchers interested in our tool has now grown including academic institutions form all around the world and particularly from the States, where we directly collaborate with several universities.
Sectors Education,Electronics

URL https://staffnet.cs.manchester.ac.uk/acso/thermal-analyzer/
 
Description The output of the project in the form a publicly available tool has inspired other research in the area of thermal analysis and management of integrated systems. Thus, our collaborator after the end of the project has used our analytical results to develop a new tool that also performs thermal analysis. This tool, named PACT is, in turn, compatible with the Openroad design flow. This flow allows the design of integrated circuits (IC) and systems relying less on the commercial tools. These approaches can ease and lower the cost of the IC design process, which is a pressing issue considering the economic and societal implications that have emerged from the ongoing semiconductor shortage. Moreover, the personnel employed in this project has successfully made the next step in their career both in industry and academia, utilizing the results produced in this project. Hence, the project created positive impact in the professional career of the employed researchers. Finally, impact on knowledge has been produced as our theoretical results have already fueled other research in the area of thermal analysis and tens of researchers across the globe has utilized the tool for their experiments.
First Year Of Impact 2020
Sector Electronics
 
Title Manchester thermal analyzer 
Description The Manchester Thermal Analyzer (MTA) has been developed to support thermal analysis across the different steps across the IC design process. In the current version, it supports high-level block design of a 3-D Integrated Circuit (IC) for architecture exploration of next generation integrated systems. System architects can refer to the output of the MTA to refine their designs in order to meet thermal budgeting constraints. Future versions will support physical design verification checking for reliability issues at very fine granularity (e.g., device level) by passing detailed layout information to the MTA. To fully support future 3-D IC designs, the MTA natively supports the 3-D structure of ICs. It is different from previous work, which support the more standard process in thermal simulations of creating a 3-D IC from multiple planar ICs. MTA only requires the 3-D information of the circuit geometry to construct the basic computational mesh for the thermal simulation. The current version of the MTA represents a new, fully 3-D computational model for such ICs. 
Type Of Material Computer model/algorithm 
Provided To Others? No  
Impact Not available yet 
 
Title Manchester thermal analyzer, 2nd release 
Description This is the second version of the thermal simulator which has been expanded now supporting non-linear thermal analysis, more numerical schemes of time integration, and improved performance through more efficient coding. In addition, the tool now supports thermal analysis both at the floorplan (1st release) level and the standard-cell level, properly interfaced with commercial tools used for circuit design, such as the Cadence platform. 
Type Of Material Computer model/algorithm 
Year Produced 2017 
Provided To Others? Yes  
Impact The tool is now better positioned to handle industry-scale circuits and outperforms in terms of solve time and accuracy other academic simulators, such as Hotspot. The pool of researchers using the tool has further grown and older users have migrated to the newer version. 
URL https://staffnet.cs.manchester.ac.uk/acso/thermal-analyzer/
 
Description Support of NSF project through our tool 
Organisation Boston University
Department College of Engineering
Country United States 
Sector Academic/University 
PI Contribution A consortium of three US universities including BU, MIT, and Brown University asked to use our tool as the baseline thermal simulator for developing their own thermal models for phase change materials targeting cooling of multi-core processors. Our tool is provided as in-kind contribution to their project. The project was funded and the consortium now trains newly hired personnel for the project.
Collaborator Contribution The partners use our tool and test its performance and versatility to perform thermal analysis of complex integrated systems.
Impact We expect to have some common publications and interactions in the near future. As their project is still at an early stage, there is no tangible output to report just yet.
Start Year 2017
 
Title MTA 
Description We have implemented a flexible thermal simulator, which computes the temperature profile of an integrated circuit by solving the heat equation numerically with the finite element method. Differently from state-of-the-art tools, the implemented thermal simulator has the ability to compute adaptively refined solutions in both space and time, which is an advanced feature for such a thermal simulator. These adaptive features add to the efficiency of our simulator since we can compute more accurate temperature profiles with more efficiency (i.e., less computational cost). The existing thermal simulator makes use of state-of-the-art preconditioned iterative solvers for the solution of the linear systems arising in computations. The thermal simulator that we have developed so far allows the user to take the details of the integrated circuit floorplan and produce a fully adaptive, transient thermal analysis. The new thermal simulator makes use of the existing, open source finite element library OOMPH-Lib. Part of the development of the thermal simulator has required adding new functionality to the OOMPH-Lib finite element library. Specifically, the ability to read in more complicated meshes which represents the geometry and thermal properties of the integrated circuit. The developed software is flexible and lays the foundation for the fully coupled, non-linear thermal simulator, where the thermal properties of the chip are coupled to the power distribution network. Part of the work has resulted in new ways of generating the computational mesh of the 3-D IC. We are the first research team to introduce an automatic 3-D IC mesh generator by using an in-house framework and GMSH, a well-known open source mesh generation tool. The developed framework supports a hierarchical description of the IC design, which enables designers to simulate thermal profiles at different granularities. MTA uses an XML file for the hierarchical IC description. The reason is because XML is well-suited for storing the data of the hierarchical structure of the IC. We also provide designers with an additional tool to migrate their designs from different simulators to the MTA. Currently, it supports the well-known architecture-level thermal simulator, HotSpot, but will handle other tools in the near future. 
Type Of Technology Software 
Year Produced 2016 
Open Source License? Yes  
Impact A few downloads of the tool. Groups from ICL and Univ. of Southampton have expressed their interest to use the tool for specific applications. In addition, UCSD has requested a copy to use the tool for research purposes. 
URL https://staffnet.cs.manchester.ac.uk/acso/thermal-analyzer/
 
Title MTA v2.0 
Description The second release of the Manchester Thermal Analyzer (MTA) is a comprehensive tool that allows for fast and highly accurate linear and nonlinear thermal simulations of complex physical structures including the IC, the package, and the heatsink. The MTA is targeted for 2.5/3-D IC designs but also handles standard planar ICs. The MTA discretizes the heat equation in space using the finite element method and performs the time integration with unconditionally stable implicit time stepping methods. To improve the computational efficiency without sacrificing accuracy, the MTA features adaptive spatiotemporal refinement. The large-scale linear systems that arise during the simulation are solved with fast preconditioned Krylov subspace methods. The MTA supports thermal analysis of realistic integrated systems and surpasses the computational capabilities and performance of existing academic thermal simulators. For example, the simulation of a processor in a package attached to a heat sink, modeled by a computational grid consisting of over 3 million nodes, takes less than 3 minutes.The MTA is fully parallel and publicly available. 
Type Of Technology Software 
Year Produced 2017 
Impact Our software has been downloaded by researchers from over 10 countries worldwide. We hope to see some citations or further collaborations stemming from the release of the tool. 
URL https://staffnet.cs.manchester.ac.uk/acso/thermal-analyzer/
 
Description Design Automation Conference (university demo) 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Postgraduate students
Results and Impact A beta version of thermal simulator was presented at the University Booth of the Design Automation Conference in USA, the most prestigious conference in the electronic design automation community (EDA). We received feedback and raised awareness about the project and the upcoming release of the tool, which happened later in the year.
Year(s) Of Engagement Activity 2016
 
Description Presentation at the University Exhibition Booth at DATE 2017 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Industry/Business
Results and Impact We presented the 1st version of the tool released to research community last year in the University Exhibition Booth at the Design, Automation, and Test in Europe (DATE) for two successive days. DATE is one of the most prominent events in the area of Electronic Design Automation (EDA) with rich participation of industry from Europe. As an outcome of this activity, the tool had more downloads, leading to a wider use of the tool in the EDA and circuit design community.
Year(s) Of Engagement Activity 2017