Agile Computing Authors: Yeshim Deniz, Pat Romanski, Elizabeth White, Rene Buest, William Schmarzo

Related Topics: @ThingsExpo, Java IoT, @DevOpsSummit

@ThingsExpo: Blog Post

Performance Testers: Prepare for the Internet of Things | @ThingsExpo #IoT

Ponder the future of performance testing for IoT applications

The Internet has obviously had a huge impact on society to the point where it's hard to remember what life was like before it was around. But here's a thought: we're in for an even bigger transformation.

It's called the Internet of Things, and it's coming quickly. ABI Research predicts there will be 40.9 billion active wireless connected devices by the year 2020. Likewise, IHS Automotive forecasts 152 million cars will be connected to the Internet by the same year. Within the next decade, we are going to see everything from power plants to transportation systems to factories to the appliances in our homes connected together for data collection, analytics, command-and-control, and all sorts of other applications.

What is all this going to mean for performance testing? It's almost impossible to know for sure as so much of this story remains unwritten. However, there are industries where IoT is already happening. Let's take a look at a few of these and ponder the future of performance testing for IoT applications.

Key Performance Areas in IoT
We are still in the early stages of IoT, so not a lot is known about the behavioral and performance characteristics of large-scale IoT systems. However, there are a few things we do know.

When it comes to IoT, it's a pretty safe bet that performance engineers will want to pay particular attention to the following areas:

Dealing with massive data spikes. IoT has the capability of driving traffic spikes that will put Black Friday to shame. For example, an entire building coming online in the morning could deliver a huge amount of data in a short timeframe. Now, think of what would happen when an entire city turns the lights on between 8:30 and 9.

Mission-critical applications and the importance of high performance all the time. If you're running transportation systems on IoT, you've got to know that data is flowing unimpeded, all the time. While we're used to our mobile browsers spinning for half a minute waiting for data to load, that's not going to fly in the Internet of Things.

Security of sensitive information (not just social security numbers). Consider what a competitor could learn from all the data that describes exactly how a proprietary manufacturing plant is operating. Or worse - if a hacker is able to access the control path of a nuclear power plant. Security is paramount in IoT.

The importance of simulation. You can't test in production very easily when dealing with physical systems. Stuff just needs to work. That means you have to invest a lot in simulation, and have realistic scenarios to drive them.

The fact about IoT is that while it hasn't invaded every aspect of our lives yet, it's also not a complete unknown. There are a lot of industries that are already dipping toes or entire feet in the IoT waters. We thought it might be interesting to walk through a few of them.

Thanks largely to technology, the health industry will have some of the most important advancements for the future of our society. Healthcare is intensely personal, and performance testing is a matter of safety and security. When we talk about disease monitoring and measuring the vital signs for the elderly, we're talking about people's lives.

Some particularly interesting achievements and ideas in healthcare that relate to IoT are as follows:

  • Medical Refrigerator Tech: New monitoring tools are available that keep live metrics about controlling the conditions inside medical freezers that store vaccines, medicines and other organic elements.
  • Disease Management: Remote patient-monitoring technology gathers data about pulmonary problems, heart disease and diabetes.
  • Dental Hygiene: A toothbrush can track your brushing habits and even connect to your dentist's office to report how you're doing.
  • Physical Activity Management For The Elderly: Body sensors connect to networks and measure vital signs in an unobtrusive manner or via wearables.

There is a lot we can leverage from existing processes in health industry. Virtual simulation allows you to simulate the actual conditions of the product. Meanwhile, considering bandwidth limiting is important. Patients move around, so you will need to emulate connectivity for specified locations. Finally, don't forget testing in production. It gets tough when a production environment is so fragile and literally, cannot go down.

Environmental Infrastructure
Another hot area that is seeing a lot of innovation as far as IoT goes is city management and the environmental sector. Take water management, for example. We can now monitor real time water usage, its status, and cleanliness over IP networks, which drastically reduces maintenance costs. A multitude of examples occur in agriculture. For example, we are able to control micro-climates in modern greenhouses for better vegetable and fruit production with IoT technology.

When we refer to water supply management and metropolitan management in IoT, security can be a challenge. You cannot leave products vulnerable by missing data encryption, allowing for unauthorized access, or supporting only minimal password requirements. A common tactic may be security through obscurity, like being secretive about how updates to the product are implemented. Be careful about this as a strategy. If your security is breached (maybe by an insider), it could be very hard to recover.

With environmental factors involved, performance testers must realize how their unique device reacts to the various elements. Tough hardware conditions and challenges will require frequent software performance testing. In this industry, we don't want to wait for a headline news story to highlight your product's security breach or find out about product-related shortcomings. If you have questions about performance testing for application security, here's a handy checklist you may find interesting.

Travel And Tourism
We have begun to see an influx of IoT applications in the travel and tourism industry as well. Of course, proximity and live event information is gaining popularity at hot theme parks. You'll also find city applications that monitor crowds and shoppers.

What are the major implications on performance testing for tourism products? Their nature tends to be based upon movement. Sensor technology involves connectivity. In many cases networks can be intermittent or unreliable. As a consumer of a tourism-based application or device, it is important to know that your data will be saved and stored correctly, even if you unexpectedly lose a connection. It also important that it is delivered correctly when your connection is restored. Therefore, it is imperative for product testers of this industry to monitor networks.

In these situations, latency is always significantly higher and you'll see more packet loss. Focus on response times for the client and on server capacity. Keep in mind that there are many networks with different characteristics (private and public), which means there will be more interference with other networks in range. You'll need to perform network speed tests, reviewing the time it takes to fetch DNS information and to connect to the server. The user experience is key in this industry.

In General, Know Your Device
Depending on your point of view, it's either going to be amazing or amazingly scary. But one thing's for sure - it's happening. This year, the activity around the Internet of Things (or IoT as it's often abbreviated) has increased dramatically. You hear about it in the news, corporations are building strategies around it, and enthusiasts are beginning to get together and play around with it, reminiscent of Steve Jobs and Steve Wozniak in the Homebrew Computer Club.

One thing to remember - in IoT, it's all about the device. This is what feeds data into the system, and it's how things are controlled. Users will likely manage IoT applications through mobile devices as well.

Now's a great time to get familiar with IoT and keep track of the exciting things happening in this space. IoT is going to drive huge demand for performance testing, so get in front of the trend, sharpen those skills, and you'll be in for an exciting decade!

Photo Credit: Brendan C

More Stories By Tim Hinds

Tim Hinds is the Product Marketing Manager for NeoLoad at Neotys. He has a background in Agile software development, Scrum, Kanban, Continuous Integration, Continuous Delivery, and Continuous Testing practices.

Previously, Tim was Product Marketing Manager at AccuRev, a company acquired by Micro Focus, where he worked with software configuration management, issue tracking, Agile project management, continuous integration, workflow automation, and distributed version control systems.

@ThingsExpo Stories
Predicting the future has never been more challenging - not because of the lack of data but because of the flood of ungoverned and risk laden information. Microsoft states that 2.5 exabytes of data are created every day. Expectations and reliance on data are being pushed to the limits, as demands around hybrid options continue to grow.
Business professionals no longer wonder if they'll migrate to the cloud; it's now a matter of when. The cloud environment has proved to be a major force in transitioning to an agile business model that enables quick decisions and fast implementation that solidify customer relationships. And when the cloud is combined with the power of cognitive computing, it drives innovation and transformation that achieves astounding competitive advantage.
Poor data quality and analytics drive down business value. In fact, Gartner estimated that the average financial impact of poor data quality on organizations is $9.7 million per year. But bad data is much more than a cost center. By eroding trust in information, analytics and the business decisions based on these, it is a serious impediment to digital transformation.
Digital Transformation: Preparing Cloud & IoT Security for the Age of Artificial Intelligence. As automation and artificial intelligence (AI) power solution development and delivery, many businesses need to build backend cloud capabilities. Well-poised organizations, marketing smart devices with AI and BlockChain capabilities prepare to refine compliance and regulatory capabilities in 2018. Volumes of health, financial, technical and privacy data, along with tightening compliance requirements by...
Andrew Keys is Co-Founder of ConsenSys Enterprise. He comes to ConsenSys Enterprise with capital markets, technology and entrepreneurial experience. Previously, he worked for UBS investment bank in equities analysis. Later, he was responsible for the creation and distribution of life settlement products to hedge funds and investment banks. After, he co-founded a revenue cycle management company where he learned about Bitcoin and eventually Ethereal. Andrew's role at ConsenSys Enterprise is a mul...
DXWordEXPO New York 2018, colocated with CloudEXPO New York 2018 will be held November 11-13, 2018, in New York City and will bring together Cloud Computing, FinTech and Blockchain, Digital Transformation, Big Data, Internet of Things, DevOps, AI, Machine Learning and WebRTC to one location.
DXWorldEXPO LLC announced today that "Miami Blockchain Event by FinTechEXPO" has announced that its Call for Papers is now open. The two-day event will present 20 top Blockchain experts. All speaking inquiries which covers the following information can be submitted by email to [email protected] Financial enterprises in New York City, London, Singapore, and other world financial capitals are embracing a new generation of smart, automated FinTech that eliminates many cumbersome, slow, and expe...
DXWorldEXPO | CloudEXPO are the world's most influential, independent events where Cloud Computing was coined and where technology buyers and vendors meet to experience and discuss the big picture of Digital Transformation and all of the strategies, tactics, and tools they need to realize their goals. Sponsors of DXWorldEXPO | CloudEXPO benefit from unmatched branding, profile building and lead generation opportunities.
The best way to leverage your Cloud Expo presence as a sponsor and exhibitor is to plan your news announcements around our events. The press covering Cloud Expo and @ThingsExpo will have access to these releases and will amplify your news announcements. More than two dozen Cloud companies either set deals at our shows or have announced their mergers and acquisitions at Cloud Expo. Product announcements during our show provide your company with the most reach through our targeted audiences.
DevOpsSummit New York 2018, colocated with CloudEXPO | DXWorldEXPO New York 2018 will be held November 11-13, 2018, in New York City. Digital Transformation (DX) is a major focus with the introduction of DXWorldEXPO within the program. Successful transformation requires a laser focus on being data-driven and on using all the tools available that enable transformation if they plan to survive over the long term. A total of 88% of Fortune 500 companies from a generation ago are now out of bus...
With 10 simultaneous tracks, keynotes, general sessions and targeted breakout classes, @CloudEXPO and DXWorldEXPO are two of the most important technology events of the year. Since its launch over eight years ago, @CloudEXPO and DXWorldEXPO have presented a rock star faculty as well as showcased hundreds of sponsors and exhibitors! In this blog post, we provide 7 tips on how, as part of our world-class faculty, you can deliver one of the most popular sessions at our events. But before reading...
Cloud Expo | DXWorld Expo have announced the conference tracks for Cloud Expo 2018. Cloud Expo will be held June 5-7, 2018, at the Javits Center in New York City, and November 6-8, 2018, at the Santa Clara Convention Center, Santa Clara, CA. Digital Transformation (DX) is a major focus with the introduction of DX Expo within the program. Successful transformation requires a laser focus on being data-driven and on using all the tools available that enable transformation if they plan to survive ov...
As IoT continues to increase momentum, so does the associated risk. Secure Device Lifecycle Management (DLM) is ranked as one of the most important technology areas of IoT. Driving this trend is the realization that secure support for IoT devices provides companies the ability to deliver high-quality, reliable, secure offerings faster, create new revenue streams, and reduce support costs, all while building a competitive advantage in their markets. In this session, we will use customer use cases...
DXWorldEXPO LLC announced today that ICOHOLDER named "Media Sponsor" of Miami Blockchain Event by FinTechEXPO. ICOHOLDER give you detailed information and help the community to invest in the trusty projects. Miami Blockchain Event by FinTechEXPO has opened its Call for Papers. The two-day event will present 20 top Blockchain experts. All speaking inquiries which covers the following information can be submitted by email to [email protected] Miami Blockchain Event by FinTechEXPO also offers s...
With tough new regulations coming to Europe on data privacy in May 2018, Calligo will explain why in reality the effect is global and transforms how you consider critical data. EU GDPR fundamentally rewrites the rules for cloud, Big Data and IoT. In his session at 21st Cloud Expo, Adam Ryan, Vice President and General Manager EMEA at Calligo, examined the regulations and provided insight on how it affects technology, challenges the established rules and will usher in new levels of diligence arou...
Dion Hinchcliffe is an internationally recognized digital expert, bestselling book author, frequent keynote speaker, analyst, futurist, and transformation expert based in Washington, DC. He is currently Chief Strategy Officer at the industry-leading digital strategy and online community solutions firm, 7Summits.
Digital Transformation and Disruption, Amazon Style - What You Can Learn. Chris Kocher is a co-founder of Grey Heron, a management and strategic marketing consulting firm. He has 25+ years in both strategic and hands-on operating experience helping executives and investors build revenues and shareholder value. He has consulted with over 130 companies on innovating with new business models, product strategies and monetization. Chris has held management positions at HP and Symantec in addition to ...
Cloud-enabled transformation has evolved from cost saving measure to business innovation strategy -- one that combines the cloud with cognitive capabilities to drive market disruption. Learn how you can achieve the insight and agility you need to gain a competitive advantage. Industry-acclaimed CTO and cloud expert, Shankar Kalyana presents. Only the most exceptional IBMers are appointed with the rare distinction of IBM Fellow, the highest technical honor in the company. Shankar has also receive...
Enterprises have taken advantage of IoT to achieve important revenue and cost advantages. What is less apparent is how incumbent enterprises operating at scale have, following success with IoT, built analytic, operations management and software development capabilities - ranging from autonomous vehicles to manageable robotics installations. They have embraced these capabilities as if they were Silicon Valley startups.
Internet-of-Things discussions can end up either going down the consumer gadget rabbit hole or focused on the sort of data logging that industrial manufacturers have been doing forever. However, in fact, companies today are already using IoT data both to optimize their operational technology and to improve the experience of customer interactions in novel ways. In his session at @ThingsExpo, Gordon Haff, Red Hat Technology Evangelist, shared examples from a wide range of industries – including en...