Puppet at NYSEThis is a product case study for Puppet in the Financial Services Sector.

NYSE manages 20,000 + servers using Puppet Enterprise

The New York Stock Exchange (NYSE) is the world’s largest stock exchange by market capitalization. In 2015, it raised $137 billion in capital, including $6 billion from tech IPOs, making NYSE the U.S. leader in tech IPOs. NYSE is part of Intercontinental Exchange (ICE), which owns 23 exchanges and marketplaces, as well as five central clearinghouses.

The Challenge

The New York Stock Exchange (NYSE) needed to scale up workloads and infrastructure efficiently and cost-effectively. Provisioning was too slow and held up developers’ work.

ICE, NYSE’s parent company, was mostly satisfied with open source Puppet, but relied on some workarounds.

What Icinga does

Open Source Puppet to Puppet Enterprise

NYSE was an early adopter of Puppet Enterprise. ICE, which relied on open source Puppet for managing its thousands of servers, acquired NYSE in 2013. It soon became apparent that PE would help the newly combined engineering teams merge more quickly and effectively.

That realization lead to migrating other exchanges, marketplaces and clearinghouses within ICE from open source Puppet to Puppet Enterprise. Two years after deciding to go with Puppet Enterprise, 75 percent of ICE’s 20,000-server estate is managed
with Puppet.

“The more we use Puppet Enterprise, the more we find we can do with it,” said Pope Davis, senior director of systems engineering at ICE. “Puppet Enterprise comes with many modules to help us manage our Puppet setup more easily. The open source version does not come with these modules, and those we did use, we needed to modify. We don’t need to modify the modules that ship with Puppet Enterprise, especially with PE 2015, and that saves us a lot of time.”

Puppet Enterprise’s continuing development has brought new capabilities — for example, improved performance and scalability — to ICE and NYSE. “Every new upgrade of Puppet proves to be more innovative, and brings exciting features that we want,” Pope said.

The Results

The New York Stock Exchange (NYSE) and its parent company, Intercontinental Exchange (ICE), now use Puppet Enterprise to manage nearly 20,000 servers on a mix of platforms and enforce regulatory compliance. Plus, the team can now provision development environments for software engineers in 20 minutes — 144 times faster than before using Puppet Enterprise.

  • 75% of ICE’s 20,000 servers are managed by Puppet Enterprise (as of March 2016).
  • Increase from 300 servers per admin to 700 servers per admin.
  • Provisioning dev environments reduced from 1 or 2 days to just 21 minutes.
  • No workarounds needed: Puppet Enterprise “just works.

Looking for help with your Puppet implementation? Our DevOps experts would be happy to connect.