Welcome!

Agile Computing Authors: Elizabeth White, Yeshim Deniz, Pat Romanski, Liz McMillan, Larry Alton

Related Topics: @DevOpsSummit, Microservices Expo, Containers Expo Blog

@DevOpsSummit: Blog Feed Post

Trend Shift Analysis | @DevOpsSummit #DevOps #APM #Monitoring

In performance monitoring, trend, or trend shift, is a key metric that is used to indicate change

Trend Shift Analysis
By Pradeep Thalanki and Ankur Vishwakarma

‘Trend’ is a pretty common business term, but its definition tends to vary by industry. In performance monitoring, trend, or trend shift, is a key metric that is used to indicate change.

Why is trend shift important?
Change is inevitable. Today’s websites must frequently update and change to keep up with competition and attract new users, but such changes can have a negative impact on the user experience if not managed properly. The dynamic nature of the Internet makes it necessary to constantly monitor different metrics. One of the biggest challenges in performance monitoring the lack of clarity when configuring alerts. Alerts that are set up using the wrong configuration can lead to an overabundance of false positive alerts or no alerts at all, which results in an increased MTTR.

Webpage response is an important metric that affects end-user experience. If the page takes too long to load, the user gets frustrated and will likely abandon the webpage. A high page load time can be caused by several issues, some of the common problems are:

  1. The server that delivers the page content is unable to handle a surge in requests
  2. The webpage has too many third-party ads/images
  3. The network is sluggish due to maintenance

Monitoring webpage response values or keeping track of the trend shift can help identify any unusual webpage behavior and to ensure a positive user experience.

This is just one of the many scenarios where analyzing trend shift can be valuable. Trend shift alerts are also useful in:

  • Detecting trend shifts on specific ISP or region or city
  • Multi hosting or multi CDN environment

When can you use trend shift?
Trend shift alerts can be set up for metrics that are prone to constant variations in their values. In the image below, a trend shift was detected on July 18 at around 16:00, which continued for about 24 hours. Later, it returned to normal, indicating that the root cause was identified and fixed.

When is trend shift irrelevant?
Trend shift can be detected when there is a sudden change (for a few consecutive runs) in the usual pattern. But if this change is gradual rather than sudden, then trend shift cannot detect the problem. In such cases, warning and critical alerts should be set up for a specific value.

In the image below, we see that the webpage response has increased gradually. The webpage response is around 2500ms in the beginning and increased to around 3500ms over two days’ time. Trend shift alert is not triggered here as the value increased gradually.

Trend shift alerts using Catchpoint
Clients can configure trend shift alerts using Catchpoint; the alerts will help them take necessary action so that end-user experience is not affected.

Below is where you will find the trend shift alerts displayed:

  1. Smartboard page
  2. Alert Log page

Trend shift alerts in the Smartboard page
The assistant widget section in the Smartboard page displays trend shifts. The Smartboard page has been developed using artificial intelligence (intense computing algorithms) that detects the trend shifts. It computes the trend shift for the test time metric (total time taken to complete the test). The Smartboard page does not require any additional configuration to display the trend shift information.

Trend shift alerts in alerts Log
A trend shift alert is triggered and displayed in the alerts log page only after it has been configured in the test properties. Trend shifts can be detected for:

  1. Timing metrics – test time, DNS, send, wait, DOM load, etc.
  2. Ping metrics – ping packet loss, ping RTT
  3. Request metrics – #Requests, #Connections, #Redirects, #Images, #Scripts, #CSS, etc.
  4. Zone metrics – self downloaded bytes, %Self Bottleneck, %Third party bottleneck, etc.

Configuring trend shift alerts
Alerts can be set up in the advanced alerts section in the test properties page as shown below. The default recipients will be notified by an email when a trend shift is detected for the metric it was configured.

Where to find trend shift alerts?
The alerts log page displays a list of alerts; it can be filtered for specific tests and alert types (metric based) for a specified time interval.

How is Trend Shift alert different from other alert types?
For regular alerts, the user should configure the values over/below which an alert should be triggered. In the case of trend shift, however, the user should select the metric to be monitored for trend shift. Trend shift is based on historical comparison, therefore there is no need to set any specific values.

Advantages of trend shift analysis
Let’s take a real scenario where trend shift analysis can be critical. Ecommerce companies rake in major business during the annual sales like Black Friday and Cyber Monday. On such days, these websites experience a rapid hike in traffic with customers rushing in to grab the best deals. The servers managing the website may slow down considerably with the influx of requests. In the image below, we can see that the webpage response shot up during a special discount sale.

Trend shift detects such spikes in the webpage response and helps businesses identify the root cause of the issue. It can provide a lot of data around the incident such as:

  1. Identifying the city with the most number of users
  2. Identifying whether the ISP (Internet Service Provider) was capable of handling the load
  3. Building a better infrastructure so that the load is distributed

Summary
Trend shift signals a change in the website performance. It provides a starting point to analyze the change (increase/decrease) in the metric being monitored. Performance analysts can use this data to identify the root cause and take corrective measures if necessary. Proactively identifying and fixing the issue will improve the user experience and have a positive impact on the company’s revenue.

The post Trend Shift Analysis appeared first on Catchpoint's Blog - Web Performance Monitoring.

Read the original blog entry...

More Stories By Mehdi Daoudi

Catchpoint radically transforms the way businesses manage, monitor, and test the performance of online applications. Truly understand and improve user experience with clear visibility into complex, distributed online systems.

Founded in 2008 by four DoubleClick / Google executives with a passion for speed, reliability and overall better online experiences, Catchpoint has now become the most innovative provider of web performance testing and monitoring solutions. We are a team with expertise in designing, building, operating, scaling and monitoring highly transactional Internet services used by thousands of companies and impacting the experience of millions of users. Catchpoint is funded by top-tier venture capital firm, Battery Ventures, which has invested in category leaders such as Akamai, Omniture (Adobe Systems), Optimizely, Tealium, BazaarVoice, Marketo and many more.

@ThingsExpo Stories
SYS-CON Events announced today that Taica will exhibit at the Japan External Trade Organization (JETRO) Pavilion at SYS-CON's 21st International Cloud Expo®, which will take place on Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. Taica manufacturers Alpha-GEL brand silicone components and materials, which maintain outstanding performance over a wide temperature range -40C to +200C. For more information, visit http://www.taica.co.jp/english/.
Enterprises have taken advantage of IoT to achieve important revenue and cost advantages. What is less apparent is how incumbent enterprises operating at scale have, following success with IoT, built analytic, operations management and software development capabilities – ranging from autonomous vehicles to manageable robotics installations. They have embraced these capabilities as if they were Silicon Valley startups. As a result, many firms employ new business models that place enormous impor...
SYS-CON Events announced today that SourceForge has been named “Media Sponsor” of SYS-CON's 21st International Cloud Expo, which will take place on Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. SourceForge is the largest, most trusted destination for Open Source Software development, collaboration, discovery and download on the web serving over 32 million viewers, 150 million downloads and over 460,000 active development projects each and every month.
SYS-CON Events announced today that Dasher Technologies will exhibit at SYS-CON's 21st International Cloud Expo®, which will take place on Oct 31 - Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. Dasher Technologies, Inc. ® is a premier IT solution provider that delivers expert technical resources along with trusted account executives to architect and deliver complete IT solutions and services to help our clients execute their goals, plans and objectives. Since 1999, we'v...
As popularity of the smart home is growing and continues to go mainstream, technological factors play a greater role. The IoT protocol houses the interoperability battery consumption, security, and configuration of a smart home device, and it can be difficult for companies to choose the right kind for their product. For both DIY and professionally installed smart homes, developers need to consider each of these elements for their product to be successful in the market and current smart homes.
SYS-CON Events announced today that MIRAI Inc. will exhibit at the Japan External Trade Organization (JETRO) Pavilion at SYS-CON's 21st International Cloud Expo®, which will take place on Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. MIRAI Inc. are IT consultants from the public sector whose mission is to solve social issues by technology and innovation and to create a meaningful future for people.
SYS-CON Events announced today that Massive Networks, that helps your business operate seamlessly with fast, reliable, and secure internet and network solutions, has been named "Exhibitor" of SYS-CON's 21st International Cloud Expo ®, which will take place on Oct 31 - Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. As a premier telecommunications provider, Massive Networks is headquartered out of Louisville, Colorado. With years of experience under their belt, their team of...
SYS-CON Events announced today that TidalScale, a leading provider of systems and services, will exhibit at SYS-CON's 21st International Cloud Expo®, which will take place on Oct 31 - Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. TidalScale has been involved in shaping the computing landscape. They've designed, developed and deployed some of the most important and successful systems and services in the history of the computing industry - internet, Ethernet, operating s...
Widespread fragmentation is stalling the growth of the IIoT and making it difficult for partners to work together. The number of software platforms, apps, hardware and connectivity standards is creating paralysis among businesses that are afraid of being locked into a solution. EdgeX Foundry is unifying the community around a common IoT edge framework and an ecosystem of interoperable components.
Coca-Cola’s Google powered digital signage system lays the groundwork for a more valuable connection between Coke and its customers. Digital signs pair software with high-resolution displays so that a message can be changed instantly based on what the operator wants to communicate or sell. In their Day 3 Keynote at 21st Cloud Expo, Greg Chambers, Global Group Director, Digital Innovation, Coca-Cola, and Vidya Nagarajan, a Senior Product Manager at Google, will discuss how from store operations...
In a recent survey, Sumo Logic surveyed 1,500 customers who employ cloud services such as Amazon Web Services (AWS), Microsoft Azure, and Google Cloud Platform (GCP). According to the survey, a quarter of the respondents have already deployed Docker containers and nearly as many (23 percent) are employing the AWS Lambda serverless computing framework. It’s clear: serverless is here to stay. The adoption does come with some needed changes, within both application development and operations. Tha...
SYS-CON Events announced today that IBM has been named “Diamond Sponsor” of SYS-CON's 21st Cloud Expo, which will take place on October 31 through November 2nd 2017 at the Santa Clara Convention Center in Santa Clara, California.
In his Opening Keynote at 21st Cloud Expo, John Considine, General Manager of IBM Cloud Infrastructure, will lead you through the exciting evolution of the cloud. He'll look at this major disruption from the perspective of technology, business models, and what this means for enterprises of all sizes. John Considine is General Manager of Cloud Infrastructure Services at IBM. In that role he is responsible for leading IBM’s public cloud infrastructure including strategy, development, and offering ...
Infoblox delivers Actionable Network Intelligence to enterprise, government, and service provider customers around the world. They are the industry leader in DNS, DHCP, and IP address management, the category known as DDI. We empower thousands of organizations to control and secure their networks from the core-enabling them to increase efficiency and visibility, improve customer service, and meet compliance requirements.
Join IBM November 1 at 21st Cloud Expo at the Santa Clara Convention Center in Santa Clara, CA, and learn how IBM Watson can bring cognitive services and AI to intelligent, unmanned systems. Cognitive analysis impacts today’s systems with unparalleled ability that were previously available only to manned, back-end operations. Thanks to cloud processing, IBM Watson can bring cognitive services and AI to intelligent, unmanned systems. Imagine a robot vacuum that becomes your personal assistant tha...
With major technology companies and startups seriously embracing Cloud strategies, now is the perfect time to attend 21st Cloud Expo October 31 - November 2, 2017, at the Santa Clara Convention Center, CA, and June 12-14, 2018, at the Javits Center in New York City, NY, and learn what is going on, contribute to the discussions, and ensure that your enterprise is on the right path to Digital Transformation.
Recently, REAN Cloud built a digital concierge for a North Carolina hospital that had observed that most patient call button questions were repetitive. In addition, the paper-based process used to measure patient health metrics was laborious, not in real-time and sometimes error-prone. In their session at 21st Cloud Expo, Sean Finnerty, Executive Director, Practice Lead, Health Care & Life Science at REAN Cloud, and Dr. S.P.T. Krishnan, Principal Architect at REAN Cloud, will discuss how they b...
SYS-CON Events announced today that mruby Forum will exhibit at the Japan External Trade Organization (JETRO) Pavilion at SYS-CON's 21st International Cloud Expo®, which will take place on Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. mruby is the lightweight implementation of the Ruby language. We introduce mruby and the mruby IoT framework that enhances development productivity. For more information, visit http://forum.mruby.org/.
Digital transformation is changing the face of business. The IDC predicts that enterprises will commit to a massive new scale of digital transformation, to stake out leadership positions in the "digital transformation economy." Accordingly, attendees at the upcoming Cloud Expo | @ThingsExpo at the Santa Clara Convention Center in Santa Clara, CA, Oct 31-Nov 2, will find fresh new content in a new track called Enterprise Cloud & Digital Transformation.
SYS-CON Events announced today that NetApp has been named “Bronze Sponsor” of SYS-CON's 21st International Cloud Expo®, which will take place on Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. NetApp is the data authority for hybrid cloud. NetApp provides a full range of hybrid cloud data services that simplify management of applications and data across cloud and on-premises environments to accelerate digital transformation. Together with their partners, NetApp emp...