Difference between revisions of "OpenPOWER Firmware"

From RCS Wiki
Jump to navigation Jump to search
(list for components)
(26 intermediate revisions by 6 users not shown)
Line 1: Line 1:
'''OpenPOWER Firmware''' is an open-source alternative to OpenFirmware and proprietary IBM firmware used on Power machines.<ref>Kerr, Jeremy. [https://lca2015.linux.org.au/schedule/30305/view_talk OpenPOWER: building an open-source software stack from bare metal]. LCA 2015</ref> It is a general name for many separate pieces of software used to start an IBM POWER chip.<ref>Smith, Stewart. [http://lca2016.linux.org.au/schedule/30215/view_talk Adventures in OpenPOWER Firmware]. LCA 2016</ref>
+
'''OpenPOWER Firmware''' is an open-source alternative to OpenFirmware and proprietary IBM firmware used on Power machines.<ref>Kerr, Jeremy. [https://lca2015.linux.org.au/schedule/30305/view_talk OpenPOWER: building an open-source software stack from bare metal]. LCA 2015 - [https://www.youtube.com/watch?v=DigNr08GVss video on YouTube]</ref> It is a general name for many separate pieces of software used to start recent Power Architecture chips made by IBM.<ref>Smith, Stewart. [http://lca2016.linux.org.au/schedule/30215/view_talk Adventures in OpenPOWER Firmware]. LCA 2016 - [https://www.youtube.com/watch?v=a4XGvssR-ag video on YouTube]</ref>
 +
 
 +
[[OpenBMC|OpenBMC]] is a separate project that creates firmware for the [[BMC|Baseboard Management Controller]].
  
 
== Components ==
 
== Components ==
  
* [[Self-Boot Engine|SBE]] code - loads [[Hostboot|Hostboot]] an a CPU core
+
{| class="wikitable sortable"
* Hostboot - loads [[Skiboot|Skiboot]]
+
! Firmware
* Skiboot (implements [[OpenPOWER Abstraction Layer|OPAL]]) - loads [[Petitboot|Petitboot]] and loads [[On-Chip Controller|OCC]] into the OCC core
+
! Executed on
* Petitboot - loads the operating system
+
! Loaded from
* OCC - controls thermal regulation on certain IBM POWER chips (such as [[POWER9|POWER9]], [[POWER8|POWER8]])
+
! Function
 +
|-
 +
| SBE - OTPROM
 +
[https://git.raptorcs.com/git/talos-sbe/tree/src/boot/otprom_init.S Source]
 +
| [[Self-Boot Engine|SBE]] core (on CPU)
 +
| [[OTPROM|OTPROM]] (on CPU die)
 +
| The portion of [[Self-Boot Engine|Self-Boot Engine]] (SBE) firmware permanently written via eFuses into the POWER9 silicon's OTPROM
 +
* very first instructions executed
 +
* loads remaining SBE firmware from SEEPROM into SBE core
 +
|-
 +
| SBE - SEEPROM
 +
[https://git.raptorcs.com/git/talos-sbe/tree/ Source]
 +
| [[Self-Boot Engine|SBE]] core (on CPU)
 +
| SBE [[SEEPROM|SEEPROM]] (on CPU)
 +
| The portion of [[Self-Boot Engine|Self-Boot Engine]] (SBE) firmware run from rewritable [[SEEPROM|SEEPROM]]
 +
* initialises CPU core
 +
* loads Hostboot Bootloader
 +
* backup copy stored on PNOR SPI Flash, used to stage SBE firmware updates
 +
|-
 +
| Hostboot Bootloader (HBBL)
 +
[https://git.raptorcs.com/git/talos-hostboot/tree/src/bootloader Source]
 +
| CPU core
 +
| SBE [[SEEPROM|SEEPROM]] (on CPU)
 +
|
 +
* first code which runs on main CPU cores; loads and executes rest of Hostboot
 +
* responsible for verifying integrity of Hostboot when secure boot is enabled, so this part of Hostboot is stored on the SBE SEEPROM, even though its source code lives inside the Hostboot repository
 +
|-
 +
| [[Hostboot|Hostboot]]
 +
[https://git.raptorcs.com/git/talos-hostboot/tree/ Raptor Source]
 +
[https://github.com/open-power/hostboot Upstream Source]
 +
| CPU core
 +
| [[PNOR|PNOR]] (SPI Flash)
 +
|
 +
* initialises DRAM (memory training, zeroing of ECC memory, etc.), processor bus, memory buffers
 +
* finally, chainloads Skiboot
 +
|-
 +
| [[Skiboot|Skiboot]]
 +
[https://git.raptorcs.com/git/talos-skiboot/tree/ Raptor Source]
 +
[https://github.com/open-power/skiboot Upstream Source]
 +
| CPU core
 +
| [[PNOR|PNOR]] (SPI Flash)
 +
|
 +
* initialises PCIe controllers, device trees, real time clock, NVlink, sensors
 +
* loads OCC firmware and starts OCC running
 +
* implements [[OpenPOWER Abstraction Layer|OpenPOWER Abstraction Layer]] (OPAL) for OS runtime services; remains resident in RAM after OS boot
 +
* finally, chainloads Skiroot
 +
|-
 +
| [[Skiroot]]/[[Petitboot|Petitboot]]
 +
[https://git.raptorcs.com/git/talos-petitboot/ Source]
 +
| CPU core
 +
| [[PNOR|PNOR]] (SPI Flash)
 +
|
 +
* [[Skiroot]] refers to the Linux kernel and initramfs which runs from RAM
 +
* Contains [[Petitboot]], a userspace application which provides a boot menu
 +
* [[Petitboot]] loads operating system via kexec
 +
|-
 +
| OCC firmware
 +
[https://git.raptorcs.com/git/talos-occ/tree/ Raptor Source]
 +
[https://github.com/open-power/occ Upstream Source]
 +
| [[On-Chip Controller|OCC]] core (on CPU)
 +
| [[PNOR|PNOR]] (SPI Flash)
 +
| The [[On-Chip Controller|On-Chip Controller]] (OCC) manages:
 +
* thermal regulation of CPU chip, turbo frequency selection, voltage ID selection, power measurement, etc.
 +
|-
 +
| CME [[HCODE]]
 +
[https://git.raptorcs.com/git/talos-hcode/tree/ Source]
 +
| [[CME]] cores (on CPU)
 +
| [[PNOR|PNOR]] (SPI Flash)
 +
| The [[Core Management Engine|Core Management Engines]] (CME) are auxillary cores used for power management purposes. They are ultimately responsible to the OCC.
 +
* There is one CME for every pair of SMT4 cores.
 +
|-
 +
| SGPE and PGPE [[HCODE]]
 +
[https://git.raptorcs.com/git/talos-hcode/tree/ Source]
 +
| [[SGPE]] and [[PGPE]] cores (on CPU)
 +
| [[PNOR|PNOR]] (SPI Flash)
 +
| [[GPE|General Purpose Engine]] (GPE) cores which assist, and are managed by, the OCC.
 +
* The [[SGPE|Stop GPEs]] (SGPEs) are part of the mechanism for resuming execution after a STOP instruction is executed (which is a Power ISA instruction which halts the processor).
 +
* The [[PGPE|Pstate GPEs]] (PGPEs) perform pstate management.
 +
|-
 +
| IOPPE [[HCODE]]
 +
[https://git.raptorcs.com/git/talos-hcode/tree/ Source]
 +
| [[IOPPE]] cores (on CPU)
 +
| [[PNOR|PNOR]] (SPI Flash)
 +
|
 +
* Involved in CAPI support.
 +
|- style="background-color:#e0e0e0;"
 +
| [[OpenBMC]]
 +
[https://git.raptorcs.com/git/talos-openbmc/tree/ Source]
 +
| BMC chip
 +
| BMC SPI Flash
 +
|
 +
<small>(This is not part of OpenPOWER firmware, but is mentioned to give a picture of the division of responsibilities. Not all POWER9 systems use a BMC; IBM systems use a [[FSP]].)</small>
 +
* Turns system power rails on and off to energise and deenergise CPU modules, RAM, etc.
 +
* Sends commands to CPU modules over [[FSI]] to commence booting.
 +
* Provides access to PNOR SPI flash containing host firmware via LPC.
 +
* Receives core temperature information from the [[OCC]]; decides and sets fan speeds.
 +
* Powers off system if [[OCC]] indicates catastrophic temperature.
 +
|}
 +
 
 +
[[File:P9_ppe_instances.png|thumb|Diagram of main and auxillary cores on [[POWER9]]]]
 +
 
 +
== Process ==
 +
 
 +
# [[OpenBMC|OpenBMC]] uses [[FSI|FSI]] interface to start SBE
 +
# SBE executes [[OTPROM|OTPROM]], which loads SEEPROM firmware into SBE PIBMEM
 +
# SBE executes SEEPROM firmware
 +
# [[Self-Boot Engine|SBE]] loads Hostboot 
 +
# [[Hostboot|Hostboot]] loads Skiboot
 +
# [[Skiboot|Skiboot]] loads [[OCC]], [[Skiroot]]
 +
# [[Petitboot|Petitboot]] application within [[Skiroot]] loads the operating system
 +
# OS talks to firmware through [[OpenPOWER Abstraction Layer|OPAL]]
  
 
== References ==
 
== References ==
  
 
<references/>
 
<references/>
 +
 +
== See also ==
 +
 +
* [[OpenBMC|OpenBMC]]
 +
* [[OpenPOWER|OpenPOWER]]
  
 
== External Links ==
 
== External Links ==
  
* [https://github.com/open-power/docs OpenPOWER github account]
+
* [https://github.com/open-power/docs OpenPOWER firmware source code on GitHub]
* [https://github.com/open-power/docs OpenPOWER firmware documentation]
+
* '''For a better understanding of OpenPOWER firmware and boot processes, see:'''
 
+
** [https://github.com/open-power/docs/blob/master/hostboot/HostBoot_PG.md Overview of Boot Process]
 +
** [https://github.com/open-power/docs/blob/master/hostboot/P9_Boot_Flow_OpenPOWER.pdf P9 Boot Flow]
 +
** [https://github.com/open-power/docs More OpenPOWER firmware documentation]
 +
** [https://blog.jms.id.au/2015/07/openpower-firmware-stack/ OpenPOWER Firmware Stack] - Joel's Weblog
 +
* Bug tracker for firmware issues specific to [[Raptor Computing Systems|Raptor CS]] products: https://bugs.raptorengineering.com/
 
[[Category:Firmware]]
 
[[Category:Firmware]]

Revision as of 03:45, 7 November 2022

OpenPOWER Firmware is an open-source alternative to OpenFirmware and proprietary IBM firmware used on Power machines.[1] It is a general name for many separate pieces of software used to start recent Power Architecture chips made by IBM.[2]

OpenBMC is a separate project that creates firmware for the Baseboard Management Controller.

Components

Firmware Executed on Loaded from Function
SBE - OTPROM

Source

SBE core (on CPU) OTPROM (on CPU die) The portion of Self-Boot Engine (SBE) firmware permanently written via eFuses into the POWER9 silicon's OTPROM
  • very first instructions executed
  • loads remaining SBE firmware from SEEPROM into SBE core
SBE - SEEPROM

Source

SBE core (on CPU) SBE SEEPROM (on CPU) The portion of Self-Boot Engine (SBE) firmware run from rewritable SEEPROM
  • initialises CPU core
  • loads Hostboot Bootloader
  • backup copy stored on PNOR SPI Flash, used to stage SBE firmware updates
Hostboot Bootloader (HBBL)

Source

CPU core SBE SEEPROM (on CPU)
  • first code which runs on main CPU cores; loads and executes rest of Hostboot
  • responsible for verifying integrity of Hostboot when secure boot is enabled, so this part of Hostboot is stored on the SBE SEEPROM, even though its source code lives inside the Hostboot repository
Hostboot

Raptor Source Upstream Source

CPU core PNOR (SPI Flash)
  • initialises DRAM (memory training, zeroing of ECC memory, etc.), processor bus, memory buffers
  • finally, chainloads Skiboot
Skiboot

Raptor Source Upstream Source

CPU core PNOR (SPI Flash)
  • initialises PCIe controllers, device trees, real time clock, NVlink, sensors
  • loads OCC firmware and starts OCC running
  • implements OpenPOWER Abstraction Layer (OPAL) for OS runtime services; remains resident in RAM after OS boot
  • finally, chainloads Skiroot
Skiroot/Petitboot

Source

CPU core PNOR (SPI Flash)
  • Skiroot refers to the Linux kernel and initramfs which runs from RAM
  • Contains Petitboot, a userspace application which provides a boot menu
  • Petitboot loads operating system via kexec
OCC firmware

Raptor Source Upstream Source

OCC core (on CPU) PNOR (SPI Flash) The On-Chip Controller (OCC) manages:
  • thermal regulation of CPU chip, turbo frequency selection, voltage ID selection, power measurement, etc.
CME HCODE

Source

CME cores (on CPU) PNOR (SPI Flash) The Core Management Engines (CME) are auxillary cores used for power management purposes. They are ultimately responsible to the OCC.
  • There is one CME for every pair of SMT4 cores.
SGPE and PGPE HCODE

Source

SGPE and PGPE cores (on CPU) PNOR (SPI Flash) General Purpose Engine (GPE) cores which assist, and are managed by, the OCC.
  • The Stop GPEs (SGPEs) are part of the mechanism for resuming execution after a STOP instruction is executed (which is a Power ISA instruction which halts the processor).
  • The Pstate GPEs (PGPEs) perform pstate management.
IOPPE HCODE

Source

IOPPE cores (on CPU) PNOR (SPI Flash)
  • Involved in CAPI support.
OpenBMC

Source

BMC chip BMC SPI Flash

(This is not part of OpenPOWER firmware, but is mentioned to give a picture of the division of responsibilities. Not all POWER9 systems use a BMC; IBM systems use a FSP.)

  • Turns system power rails on and off to energise and deenergise CPU modules, RAM, etc.
  • Sends commands to CPU modules over FSI to commence booting.
  • Provides access to PNOR SPI flash containing host firmware via LPC.
  • Receives core temperature information from the OCC; decides and sets fan speeds.
  • Powers off system if OCC indicates catastrophic temperature.
Diagram of main and auxillary cores on POWER9

Process

  1. OpenBMC uses FSI interface to start SBE
  2. SBE executes OTPROM, which loads SEEPROM firmware into SBE PIBMEM
  3. SBE executes SEEPROM firmware
  4. SBE loads Hostboot
  5. Hostboot loads Skiboot
  6. Skiboot loads OCC, Skiroot
  7. Petitboot application within Skiroot loads the operating system
  8. OS talks to firmware through OPAL

References

See also

External Links