Welcome!

Web 2.0 Authors: Pat Romanski, Plutora Blog, Dana Gardner, Elizabeth White, Liz McMillan

Related Topics: SOA & WOA, Java, .NET, Linux, Virtualization, Web 2.0

SOA & WOA: Article

Fanning the Flames of Agile

The brilliance of agile is that it is easy to understand

Knowledge creation is a major source of value creation. And great companies -and their employees - know that continuous learning is a key to generating knowledge, and thus value. The agile mindset, particularly in development, is gaining popularity, with credit to a suite of powerful ideas and practices commonly known as the agile methodology - defined by Wikipedia as "software development methods based on iterative and incremental development."

Agile on Paper
In February 2001, a group of 17 software developers wrote the Agile Manifesto, the Magna Carta of the agile movement. At just 68 words, it was elegant, but at that point just words on paper. Early attempts to apply it came by adapting existing techniques such as lean manufacturing (adapted from Toyota's methodologies), Crystal, Scrum and XP (Extreme Programming). Admittedly, we were still learning. Buying into "agile" signaled your ideals were more lofty than grounded. Agile supporters were revolutionary, but agile was not.

Later that year, Ken Schwaber and Mike Beedle, two of the manifesto's signatories, published the watershed Agile Software Development With SCRUM. The authors noted how the Agile Manifesto could map to tangible business practices and showcased how they actually applied it. They described agile in a real-world setting, and the world hasn't been the same since. They moved SCRUM from abstract rugby imagery to concrete possibility.

We learned that agile is an approach for value generation - an approach for moving ideas from an early ideal to sustainable, real-world changes.

Most of all, we learned that agile concepts are valid.

Agile in Practice
Concepts are one thing, but successful application is quite another.

Let's look at the company where I work. SAS is the world's largest privately held software company, and we have been proponents of the agile mindset since the company's inception in 1976. SAS invests 25 percent of revenues back into R&D and regards itself as a learning company. We learn by listening; we learn by doing.

SAS first evaluated agile Scrum in 2007. Teams heard of early wins and wanted to apply agile in their own areas. Since then, SAS has formally trained thousands of personnel and invested in an infrastructure for its R&D portfolio. At SAS, agile is applied across the enterprise. It's used to manage small projects and very large projects encompassing hundreds of staff members. It's also used to bring a common approach to how SAS manages its products.

Agile is empirical - that is, we apply, learn and adapt. It is true for applying any one specific agile practice, and it is true for applying agile at scale over years. This leads to some questions: What did we learn? How did we adapt? Moreover, what cultural norms did we lean on to help garner such a strong embrace of agile and its benefits? Knowing the answers to these questions could help accelerate your own success story.

We Learned One Size Does Not Fit All
Agile books and blogs make it all sound so clean: Do A, then B, then C. Further, with so much positive press on agile development, it is tempting for any firm's executive or business controls team to mandate a one-size-fits-all approach.

Instead of mandating the same approach for everyone, we fostered a grass-roots movement. Concurrently, we used a senior executive as an advocate and recruited an operational agile champion to drive the rollout. It is important for the executive team to understand and expect agile from its teams, but not from a single template.

We adapted by creating the flexible SAS Agile Framework. It includes three integral parts: setup (training and coaching), defined practices, and an agile team self-assessment survey. The framework is helping us meet demands and energize teams with the freedom to envision and realize exciting opportunities.

Agile is applied differently in R&D, Pubs, IT, Professional Services, and other divisions in SAS. Practices are configured in the best way for the teams and markets they serve.

We Learned to Nurture the Movement
Bottom line: We watched and we listened. We nurtured our cultural norm of not accepting the status quo, and to keep a skeptical eye. More specifically, we worked hard to make sure teams weren't buying in just because of the buzz. It was important that they understood the business drivers of agile, planned time for training and startup, and applied the right agile practices in the right way for their project.

Just as with every team member, every team is different. When a team member became critical of certain agile practices for a team, we listened closely.

A Journey, Not a Destination
View agile as a journey: It takes a moment to learn, but a lifetime to master. Teams typically invest in group training, and then a small pilot. Agile is not unlike other practices where at first it's awkward, challenging and even slightly less productive. However, as a team becomes more comfortable, you'll typically hear people say they would never go back. We're all motivated by accomplishments, and agile creates the thriving state of productivity and morale we need to achieve them.

We Adapted Our Software Development Life Cycle (SDLC)
SAS is like other software development firms where the existence of an overarching software development life cycle is important. At SAS, agile holds ours together. It serves as the glue between all groups and ensures that products flow along an orderly and controlled path. Five years into agile at scale, we re-evaluated the process, then made it less linear and extended it to overlap even more than it already did. We halved the lifecycle size. We reduced the number of management checkpoints and cut back the number of required artifacts. Yet because of how agile overlays the entire process, it resulted in a better way for R&D.

We Adapted by Investing in Agile Coaches
Coaching can make a big difference, and not only in sports.

A common question asked with enterprises new to agile is: Who should play the role of the Scrum master? At SAS, this role fell to our project managers. We were fortunate. Publicly held firms find this challenging because of the required mechanisms and extra control systems their project managers must handle. Although SAS is a $3 billion dollar company, we're private and can operate unencumbered.

In our journey we noticed that teams fared better when they engaged with experienced agile veterans - they got up to speed faster. We looked closer and found by internal survey data that coaching has a positive correlation on all of intended benefits of Scrum. We now have a large team of trained coaches engaged with their own teams and others as well.

We Adapted by Tirelessly Encouraging Transparency
We also applied the agile philosophy of transparency about larger project risks and mitigations to being frank and open with individual team members. This helped create healthy, self-directed work teams.

For example, our teams openly discuss the agile self-assessment surveys. Teams independently record and then jointly discuss summary and detailed data scores and write-in comments. The discussion is useful for identifying two to three action items, but even more useful for helping teams build trust and maturity.

A word of caution, however: Be careful when looking at agile metadata between teams. Teams perform at different rates, have different compositions, and come to know requirements estimates (story points) differently. Asking a team why its numbers are different from another's can threaten its freedom and inadvertently move them to game. Can we benefit from enterprisewide analysis? Yes, if we thoroughly describe to teams the intention of such an analysis and why it's being done. It helps drive corporate training and updates upper management on progress, for instance.

We Adapted by Bringing a New Meaning to the Term ‘Flexible'
At SAS, we were able to establish a different type of relationship with our product owners, development and test teams, and support teams. We moved from setting long-range targets with multiple commitments and promises to shorter-range iterative targets. Demos now occur routinely, and that in turn builds confidence with all project stakeholders.

Benefits, Compounded
Practices yield benefits. Better practices yield better benefits.

In the internal survey mentioned earlier, we noticed something profound. Teams that tended to adopt agile practices with a higher degree of maturity tended to have better results overall. Intuitively, one might suspect this to be true - and the data objectively proved it. That evidence makes it even easier for staff members at all levels to commit.

SAS is an agile company. Our customers and workforce are increasingly receptive to the large-scale implementation of agile Scrum. It's now a part of our daily fiber and undoubtedly will continue to be part of our ongoing success.

The brilliance of agile is that it is easy to understand. The danger of agile is that it is easy to understand, and can be underestimated. Be mindful of what it takes to employ it well to yield the most benefit. Engage. Find a cohort, a validation pilot, a way to connect. Most of all, enjoy the journey.

More Stories By Tim Arthur

Tim Arthur, MSMOT, PMP, CSM, draws from the experience of very small to very large private and public projects managed under various models. He’s been with SAS for 15 years. Prior to that he led mission-critical 24/7 global software systems with IBM for 17 years. As the SAS Agile Champion he’s helped train and coach over 3,000 people on teams of all sizes, worldwide.

Comments (0)

Share your thoughts on this story.

Add your comment
You must be signed in to add a comment. Sign-in | Register

In accordance with our Comment Policy, we encourage comments that are on topic, relevant and to-the-point. We will remove comments that include profanity, personal attacks, racial slurs, threats of violence, or other inappropriate material that violates our Terms and Conditions, and will block users who make repeated violations. We ask all readers to expect diversity of opinion and to treat one another with dignity and respect.


@ThingsExpo Stories
The industrial software market has treated data with the mentality of “collect everything now, worry about how to use it later.” We now find ourselves buried in data, with the pervasive connectivity of the (Industrial) Internet of Things only piling on more numbers. There’s too much data and not enough information. In his session at @ThingsExpo, Bob Gates, Global Marketing Director, GE’s Intelligent Platforms business, to discuss how realizing the power of IoT, software developers are now focused on understanding how industrial data can create intelligence for industrial operations. Imagine ...
Things are being built upon cloud foundations to transform organizations. This CEO Power Panel at 15th Cloud Expo, moderated by Roger Strukhoff, Cloud Expo and @ThingsExpo conference chair, addressed the big issues involving these technologies and, more important, the results they will achieve. Rodney Rogers, chairman and CEO of Virtustream; Brendan O'Brien, co-founder of Aria Systems, Bart Copeland, president and CEO of ActiveState Software; Jim Cowie, chief scientist at Dyn; Dave Wagstaff, VP and chief architect at BSQUARE Corporation; Seth Proctor, CTO of NuoDB, Inc.; and Andris Gailitis, C...
Today’s enterprise is being driven by disruptive competitive and human capital requirements to provide enterprise application access through not only desktops, but also mobile devices. To retrofit existing programs across all these devices using traditional programming methods is very costly and time consuming – often prohibitively so. In his session at @ThingsExpo, Jesse Shiah, CEO, President, and Co-Founder of AgilePoint Inc., discussed how you can create applications that run on all mobile devices as well as laptops and desktops using a visual drag-and-drop application – and eForms-buildi...
The Internet of Things is tied together with a thin strand that is known as time. Coincidentally, at the core of nearly all data analytics is a timestamp. When working with time series data there are a few core principles that everyone should consider, especially across datasets where time is the common boundary. In his session at Internet of @ThingsExpo, Jim Scott, Director of Enterprise Strategy & Architecture at MapR Technologies, discussed single-value, geo-spatial, and log time series data. By focusing on enterprise applications and the data center, he will use OpenTSDB as an example t...
Cultural, regulatory, environmental, political and economic (CREPE) conditions over the past decade are creating cross-industry solution spaces that require processes and technologies from both the Internet of Things (IoT), and Data Management and Analytics (DMA). These solution spaces are evolving into Sensor Analytics Ecosystems (SAE) that represent significant new opportunities for organizations of all types. Public Utilities throughout the world, providing electricity, natural gas and water, are pursuing SmartGrid initiatives that represent one of the more mature examples of SAE. We have s...
SYS-CON Media announced that Splunk, a provider of the leading software platform for real-time Operational Intelligence, has launched an ad campaign on Big Data Journal. Splunk software and cloud services enable organizations to search, monitor, analyze and visualize machine-generated big data coming from websites, applications, servers, networks, sensors and mobile devices. The ads focus on delivering ROI - how improved uptime delivered $6M in annual ROI, improving customer operations by mining large volumes of unstructured data, and how data tracking delivers uptime when it matters most.
The 3rd International Internet of @ThingsExpo, co-located with the 16th International Cloud Expo - to be held June 9-11, 2015, at the Javits Center in New York City, NY - announces that its Call for Papers is now open. The Internet of Things (IoT) is the biggest idea since the creation of the Worldwide Web more than 20 years ago.
The true value of the Internet of Things (IoT) lies not just in the data, but through the services that protect the data, perform the analysis and present findings in a usable way. With many IoT elements rooted in traditional IT components, Big Data and IoT isn’t just a play for enterprise. In fact, the IoT presents SMBs with the prospect of launching entirely new activities and exploring innovative areas. CompTIA research identifies several areas where IoT is expected to have the greatest impact.
There is no doubt that Big Data is here and getting bigger every day. Building a Big Data infrastructure today is no easy task. There are an enormous number of choices for database engines and technologies. To make things even more challenging, requirements are getting more sophisticated, and the standard paradigm of supporting historical analytics queries is often just one facet of what is needed. As Big Data growth continues, organizations are demanding real-time access to data, allowing immediate and actionable interpretation of events as they happen. Another aspect concerns how to deliver ...
The Internet of Things will greatly expand the opportunities for data collection and new business models driven off of that data. In her session at @ThingsExpo, Esmeralda Swartz, CMO of MetraTech, discussed how for this to be effective you not only need to have infrastructure and operational models capable of utilizing this new phenomenon, but increasingly service providers will need to convince a skeptical public to participate. Get ready to show them the money!
Scott Jenson leads a project called The Physical Web within the Chrome team at Google. Project members are working to take the scalability and openness of the web and use it to talk to the exponentially exploding range of smart devices. Nearly every company today working on the IoT comes up with the same basic solution: use my server and you'll be fine. But if we really believe there will be trillions of these devices, that just can't scale. We need a system that is open a scalable and by using the URL as a basic building block, we open this up and get the same resilience that the web enjoys.
Code Halos - aka "digital fingerprints" - are the key organizing principle to understand a) how dumb things become smart and b) how to monetize this dynamic. In his session at @ThingsExpo, Robert Brown, AVP, Center for the Future of Work at Cognizant Technology Solutions, outlined research, analysis and recommendations from his recently published book on this phenomena on the way leading edge organizations like GE and Disney are unlocking the Internet of Things opportunity and what steps your organization should be taking to position itself for the next platform of digital competition.
In their session at @ThingsExpo, Shyam Varan Nath, Principal Architect at GE, and Ibrahim Gokcen, who leads GE's advanced IoT analytics, focused on the Internet of Things / Industrial Internet and how to make it operational for business end-users. Learn about the challenges posed by machine and sensor data and how to marry it with enterprise data. They also discussed the tips and tricks to provide the Industrial Internet as an end-user consumable service using Big Data Analytics and Industrial Cloud.
How do APIs and IoT relate? The answer is not as simple as merely adding an API on top of a dumb device, but rather about understanding the architectural patterns for implementing an IoT fabric. There are typically two or three trends: Exposing the device to a management framework Exposing that management framework to a business centric logic Exposing that business layer and data to end users. This last trend is the IoT stack, which involves a new shift in the separation of what stuff happens, where data lives and where the interface lies. For instance, it's a mix of architectural styles ...
IoT is still a vague buzzword for many people. In his session at @ThingsExpo, Mike Kavis, Vice President & Principal Cloud Architect at Cloud Technology Partners, discussed the business value of IoT that goes far beyond the general public's perception that IoT is all about wearables and home consumer services. He also discussed how IoT is perceived by investors and how venture capitalist access this space. Other topics discussed were barriers to success, what is new, what is old, and what the future may hold. Mike Kavis is Vice President & Principal Cloud Architect at Cloud Technology Pa...
Dale Kim is the Director of Industry Solutions at MapR. His background includes a variety of technical and management roles at information technology companies. While his experience includes work with relational databases, much of his career pertains to non-relational data in the areas of search, content management, and NoSQL, and includes senior roles in technical marketing, sales engineering, and support engineering. Dale holds an MBA from Santa Clara University, and a BA in Computer Science from the University of California, Berkeley.
The Internet of Things (IoT) is rapidly in the process of breaking from its heretofore relatively obscure enterprise applications (such as plant floor control and supply chain management) and going mainstream into the consumer space. More and more creative folks are interconnecting everyday products such as household items, mobile devices, appliances and cars, and unleashing new and imaginative scenarios. We are seeing a lot of excitement around applications in home automation, personal fitness, and in-car entertainment and this excitement will bleed into other areas. On the commercial side, m...
Almost everyone sees the potential of Internet of Things but how can businesses truly unlock that potential. The key will be in the ability to discover business insight in the midst of an ocean of Big Data generated from billions of embedded devices via Systems of Discover. Businesses will also need to ensure that they can sustain that insight by leveraging the cloud for global reach, scale and elasticity.
"People are a lot more knowledgeable about APIs now. There are two types of people who work with APIs - IT people who want to use APIs for something internal and the product managers who want to do something outside APIs for people to connect to them," explained Roberto Medrano, Executive Vice President at SOA Software, in this SYS-CON.tv interview at Cloud Expo, held Nov 4–6, 2014, at the Santa Clara Convention Center in Santa Clara, CA.
Performance is the intersection of power, agility, control, and choice. If you value performance, and more specifically consistent performance, you need to look beyond simple virtualized compute. Many factors need to be considered to create a truly performant environment. In his General Session at 15th Cloud Expo, Harold Hannon, Sr. Software Architect at SoftLayer, discussed how to take advantage of a multitude of compute options and platform features to make cloud the cornerstone of your online presence.