News & Events

How to Unlock Low-Latency Microservices with Pivotal Platform and Solace

Published on February 4, 2020

So you're excited and ready to unlock low-latency microservices. And you've chosen Pivotal Cloud Foundry as the foundation for your microservices and digital transformation.

You've broken down your monolithic e-commerce application and created a new environment composed of small, independent, single purpose microservices. Time for a well-earned swig of that single malt whiskey you've been saving for just the occasion, right? Sorry, not just yet.

Because now you're watching load and latency increase with spikes in usage-is it Black Friday? User experience is suffering! Messages and transactions are getting lost! You're not going to meet your SLAs! How and why is this happening?

How to Unlock Low-Latency Microservices with Pivotal Platform and Solace

Microservice architecture patterns and latency challenges

You're not alone. Many organizations are leveraging microservice architecture patterns to build their next-generation enterprise and deliver business value at a faster pace, but they're realizing that maintaining responsiveness at scale can be tricky. When it comes to building out low-latency microservices, it's important to step back and consider what will happen under heavy loads.

Microservices must frequently interact since each one serves a single purpose. The most common way microservices are connected is with REST, but more developers are recognizing the value of using queuing and streaming technologies.

Transforming monolithic applications into microservices does tend to improve organizational agility and scalability, but it is not always a silver bullet-what was an application is now a distributed system, which can introduce unwanted latency.

Pivotal Cloud Foundry was able to handle the load, so what was the source of this headache? No, it wasn't the whiskey you were taking a swig of earlier. The source of the problem was RabbitMQ.

A lightly loaded RabbitMQ implementation usually exhibits latency lower than a millisecond per message interaction. But as load increases (for example, a spike in orders or a new product introduction) latency can go up 600 milliseconds. If you assume 10 interactions between microservices as part of each transaction, that's six seconds!

How to ensure low-latency microservices

A great solution for this problem is to combine the agility and scalability provided by microservices and Pivotal Cloud Foundry with the low (and deterministic) latency of the Solace Hardware Messaging Appliance.

Solace's appliance utilizes an FPGA hardware data path that ensures latencies of 20 microseconds at any message rate. Best of all, this power can be harnessed using Spring Cloud connectors so that your application is unaware that it is using a service running outside of PCF.

This is done simply by configuring a "User provisioned service" in PCF as shown in this blog entry. This also allows you to get started using our software-based tile offering and switch over to hardware if latency, throughput, or IAAS availability/stability require it-all without expensive and time-consuming code and vendor changes. In fact, did you know there are three ways you can use Solace messaging from your PCF deployment? Check out this blog post to better understand when to use each offering.

We know you want incredible flexibility, and you clearly know your stuff, since you're all about low-latency microservices and Pivotal Cloud Foundry. By adding Solace to your system you can enjoy your whiskey without worrying about latency or losing those Black Friday orders!

It'll be a job well done. And something worth a sip or a swig, depending on your style.

Author: Jonathan Schabowsky

Source: Solace

PT Strategic Partner Solution

  The Bellezza Shopping Arcade
    2nd Floor Unit SA15-16
    Jl. Arteri Permata Hijau, Kec. Kby. Lama
    DKI Jakarta 12210
  +62 812 8700 0879



  Jl. Jend. Sudirman No. 757
    Bandung 40212
(62-22) 603 0590 (Hunting)
(62-22) 603 0967


  Kawasan Industri Medan Star
    Jl. Pelita Raya I Blok F No. 5
    Tanjung Morawa Km 19,2
    Deli Serdang 20362
  (62-61) 7940800
  (62-61) 7941990


  Jl. Tambak Aji I / 6
    Komp. Industri Guna Mekar
    Semarang 50185
  (62-24) 866 3521
  (62-24) 866 3529


  Jl. Ngemplak No. 30
    Komplek Ambengan Plaza
    Blok B 35-37
    Surabaya 60272
  (62-31) 531 9635 (Hunting)
  (62-31) 531 9634


  Perumahan Gunung Madu Plantation
    Jalan Pulau Morotai Blok B No. 1
    Kecamatan Sukarame - Tanjung Baru
    Bandar Lampung


  Jalan Melati No. 2,
    Kelurahan Purwosari
    Laweyan, Surakarta


  Komplek Ilir Barat Permai
    Blok D.I. No. 31
    Kelurahan 24 Ilir, Palembang


  Jalan Ir. Sutami, Pergudangan Tahap II
    Blok S No.3B
    Karang Asam, Samarinda


  Jalan Ir. Sutami,
    Komplek Pergudangan Parangloe Indah
    Blok C-II 3/6, Makassar


  Jalan Raya Wajok Hilir Km. 15,65
    Siantan, Pontianak