Click here to close now.

Welcome!

Web 2.0 Authors: David Miller, Wayne Lam, Liz McMillan, Dana Gardner, Adrian Bridgwater

Related Topics: Web 2.0, Java, Microservices Journal, GovIT

Web 2.0: Article

The FTC Is More Responsive than NASA

A naively relaunched site might go down on the first cron run in a flood of scheduled posts and emails

The United States Congress managed to avoid a default with a last-minute agreement. But the reboot's still in progress, and many federal government servers and services remain shut down. The cause of the online blackout is this set of guidelines released by the Office of Management and Budget, and in particular their answer to this question:

Q5: What if the cost of shutting down a website exceeds the cost of maintaining services?
A5: The determination of which services continue during an appropriations lapse is not affected by whether the costs of shutdown exceed the costs of maintaining services.

This might seem ridiculous at first glance, but anyone who builds websites shouldn't be surprised that they included this directive. Keeping a site running isn't just a matter of paying hosting bills, and even the most well-crafted architectures never stop needing a hand at the wheel (especially where security is concerned). This is an unusual time, and it comes with unusual traffic patterns: the role of government is being questioned, and nothing brings in pageviews like national political scrutiny. Having a .gov domain is a major liability when you don't have staff waiting to perform disaster recovery.

So things look bad now - sites down, no timeline for return. The shutdown guidelines didn't instruct agencies to create plans to relaunch their web properties, but they'll need to have one in place if they want it to go smoothly. A naively relaunched site might go down on the first cron run in a flood of scheduled posts and emails. ‘Open data' government sites will get slammed by scrapers trying to make up for lost time. Exciting new bugs will pop up for data-driven government sites that never made plans for backfilling missing data or coping with null values. And of course, every site will have to deal with the traffic from rubberneckers - as soon as the news story breaks that a given agency's site is up, people who would otherwise never consider looking at it will scope it out.

This has led to an interesting question around the office: which agencies are best prepared to turn the lights back on? We do synthetic monitoring, so we're prepared to figure it out.

AppView Web synthetic user experience data for a set of government websites affected by the shutdown.

The first step in setting up synthetic monitoring is to choose a source. I went with our web monitor in Ashburn, Virginia because its proximity to Washington, D.C. makes it a solid proxy for the congressional staffers that drive a disproportionately high amount of traffic to breaking stories.

Next up, I chose several monitoring targets based on stories from VentureBeat, theWashington PostComputerworld, and Politico. Many government sites could've made the list, but I narrowed it down to five with a high impact on researchers, scientists, and the open government movement:

Finally, I defined each site's scripted transaction with our Selenium-based Firefox script recorder plugin. Since each site's layout is unique, I went with simple transactions across the board. That meant focusing on common user actions (browsing for recent news) instead of more complicated workflows (registering for accounts or logging in).

Pretty straightforward, right? There's just one caveat to be aware of: I opted to record these scripts on the Internet Archive's cached, pre-shutdown versions of the sites. That means that they'll intentionally fail when they're run against a shutdown splash page. By setting it up like this, I'll only see a green light when everything is back to business as usual.

And, well, it didn't take long to get there! My guess had been that NASA would be back first, but in the end, it was actually the FTC website that crossed the finish line less than two hours into the 17th. Someone, somewhere stayed up all night to press that button and turn the site back on again - and even though I wasn't watching, I know right when it happened and what impact it had on response time.

The FTC site has sub-one-second response time.

The FTC site has sub-one-second response time.

On the other hand, it looks like Census.gov and Data.gov were scheduled to open business at 9 AM this morning:

Census.gov saw a brief latency spike a few transactions after it first started serving pages.

Census.gov saw a brief latency spike a few transactions after it first started serving pages.

500px-gov-data

It seems that being a tech-savvy agency doesn't have much impact on responsiveness,
because NASA and NIST are still down as of this blog post:

500px-gov-nasa

NASA's site won't get past the homepage, as of this article.

500px-gov-nist

NIST's site may actually be running from some locations, as our web monitor in Virginia can access part of it even though I see a nopaywall. However, it took over a minute to load a largely static page.

All told, I think the FTC deserves some real credit for their user experience. It takes less than one second to get information on making a FOIA request, and they were ready for business almost eight hours before some other government sites. On the other hand, I expected a much better showing from NASA and NIST. I already guessed wrong, but what's your take as to when they'll be back up and running?

More Stories By James Meickle

James started as a hobbyist web developer, even though his academic background is in social psychology and political science. Lately his interests as a professional Drupal developer have migrated towards performance, security, and automation. His favorite languages is Python, his favorite editor is Sublime, and his favorite game is Dwarf Fortress.

@ThingsExpo Stories
Container frameworks, such as Docker, provide a variety of benefits, including density of deployment across infrastructure, convenience for application developers to push updates with low operational hand-holding, and a fairly well-defined deployment workflow that can be orchestrated. Container frameworks also enable a DevOps approach to application development by cleanly separating concerns between operations and development teams. But running multi-container, multi-server apps with containers is very hard. You have to learn five new and different technologies and best practices (libswarm, sy...
SYS-CON Events announced today that DragonGlass, an enterprise search platform, will exhibit at SYS-CON's 16th International Cloud Expo®, which will take place on June 9-11, 2015, at the Javits Center in New York City, NY. After eleven years of designing and building custom applications, OpenCrowd has launched DragonGlass, a cloud-based platform that enables the development of search-based applications. These are a new breed of applications that utilize a search index as their backbone for data retrieval. They can easily adapt to new data sets and provide access to both structured and unstruc...
Converging digital disruptions is creating a major sea change - Cisco calls this the Internet of Everything (IoE). IoE is the network connection of People, Process, Data and Things, fueled by Cloud, Mobile, Social, Analytics and Security, and it represents a $19Trillion value-at-stake over the next 10 years. In her keynote at @ThingsExpo, Manjula Talreja, VP of Cisco Consulting Services, will discuss IoE and the enormous opportunities it provides to public and private firms alike. She will share what businesses must do to thrive in the IoE economy, citing examples from several industry sector...
With major technology companies and startups seriously embracing IoT strategies, now is the perfect time to attend @ThingsExpo in Silicon Valley. Learn what is going on, contribute to the discussions, and ensure that your enterprise is as "IoT-Ready" as it can be! Internet of @ThingsExpo, taking place Nov 3-5, 2015, at the Santa Clara Convention Center in Santa Clara, CA, is co-located with 17th Cloud Expo and will feature technical sessions from a rock star conference faculty and the leading industry players in the world. The Internet of Things (IoT) is the most profound change in personal an...
The security devil is always in the details of the attack: the ones you've endured, the ones you prepare yourself to fend off, and the ones that, you fear, will catch you completely unaware and defenseless. The Internet of Things (IoT) is nothing if not an endless proliferation of details. It's the vision of a world in which continuous Internet connectivity and addressability is embedded into a growing range of human artifacts, into the natural world, and even into our smartphones, appliances, and physical persons. In the IoT vision, every new "thing" - sensor, actuator, data source, data con...
Buzzword alert: Microservices and IoT at a DevOps conference? What could possibly go wrong? In this Power Panel at DevOps Summit, moderated by Jason Bloomberg, the leading expert on architecting agility for the enterprise and president of Intellyx, panelists will peel away the buzz and discuss the important architectural principles behind implementing IoT solutions for the enterprise. As remote IoT devices and sensors become increasingly intelligent, they become part of our distributed cloud environment, and we must architect and code accordingly. At the very least, you'll have no problem fil...
IoT is still a vague buzzword for many people. In his session at @ThingsExpo, Mike Kavis, Vice President & Principal Cloud Architect at Cloud Technology Partners, discussed the business value of IoT that goes far beyond the general public's perception that IoT is all about wearables and home consumer services. He also discussed how IoT is perceived by investors and how venture capitalist access this space. Other topics discussed were barriers to success, what is new, what is old, and what the future may hold. Mike Kavis is Vice President & Principal Cloud Architect at Cloud Technology Pa...
Disruptive macro trends in technology are impacting and dramatically changing the "art of the possible" relative to supply chain management practices through the innovative use of IoT, cloud, machine learning and Big Data to enable connected ecosystems of engagement. Enterprise informatics can now move beyond point solutions that merely monitor the past and implement integrated enterprise fabrics that enable end-to-end supply chain visibility to improve customer service delivery and optimize supplier management. Learn about enterprise architecture strategies for designing connected systems tha...
There's Big Data, then there's really Big Data from the Internet of Things. IoT is evolving to include many data possibilities like new types of event, log and network data. The volumes are enormous, generating tens of billions of logs per day, which raise data challenges. Early IoT deployments are relying heavily on both the cloud and managed service providers to navigate these challenges. In her session at Big Data Expo®, Hannah Smalltree, Director at Treasure Data, discussed how IoT, Big Data and deployments are processing massive data volumes from wearables, utilities and other machines...
SYS-CON Events announced today that the "First Containers & Microservices Conference" will take place June 9-11, 2015, at the Javits Center in New York City. The “Second Containers & Microservices Conference” will take place November 3-5, 2015, at Santa Clara Convention Center, Santa Clara, CA. Containers and microservices have become topics of intense interest throughout the cloud developer and enterprise IT communities.
SYS-CON Events announced today that MetraTech, now part of Ericsson, has been named “Silver Sponsor” of SYS-CON's 16th International Cloud Expo®, which will take place on June 9–11, 2015, at the Javits Center in New York, NY. Ericsson is the driving force behind the Networked Society- a world leader in communications infrastructure, software and services. Some 40% of the world’s mobile traffic runs through networks Ericsson has supplied, serving more than 2.5 billion subscribers.
The 4th International Internet of @ThingsExpo, co-located with the 17th International Cloud Expo - to be held November 3-5, 2015, at the Santa Clara Convention Center in Santa Clara, CA - announces that its Call for Papers is open. The Internet of Things (IoT) is the biggest idea since the creation of the Worldwide Web more than 20 years ago.
The 17th International Cloud Expo has announced that its Call for Papers is open. 17th International Cloud Expo, to be held November 3-5, 2015, at the Santa Clara Convention Center in Santa Clara, CA, brings together Cloud Computing, APM, APIs, Microservices, Security, Big Data, Internet of Things, DevOps and WebRTC to one location. With cloud computing driving a higher percentage of enterprise IT budgets every year, it becomes increasingly important to plant your flag in this fast-expanding business opportunity. Submit your speaking proposal today!
Since 2008 and for the first time in history, more than half of humans live in urban areas, urging cities to become “smart.” Today, cities can leverage the wide availability of smartphones combined with new technologies such as Beacons or NFC to connect their urban furniture and environment to create citizen-first services that improve transportation, way-finding and information delivery. In her session at @ThingsExpo, Laetitia Gazel-Anthoine, CEO of Connecthings, will focus on successful use cases.
The explosion of connected devices / sensors is creating an ever-expanding set of new and valuable data. In parallel the emerging capability of Big Data technologies to store, access, analyze, and react to this data is producing changes in business models under the umbrella of the Internet of Things (IoT). In particular within the Insurance industry, IoT appears positioned to enable deep changes by altering relationships between insurers, distributors, and the insured. In his session at @ThingsExpo, Michael Sick, a Senior Manager and Big Data Architect within Ernst and Young's Financial Servi...
The recent trends like cloud computing, social, mobile and Internet of Things are forcing enterprises to modernize in order to compete in the competitive globalized markets. However, enterprises are approaching newer technologies with a more silo-ed way, gaining only sub optimal benefits. The Modern Enterprise model is presented as a newer way to think of enterprise IT, which takes a more holistic approach to embracing modern technologies.
17th Cloud Expo, taking place Nov 3-5, 2015, at the Santa Clara Convention Center in Santa Clara, CA, will feature technical sessions from a rock star conference faculty and the leading industry players in the world. Cloud computing is now being embraced by a majority of enterprises of all sizes. Yesterday's debate about public vs. private has transformed into the reality of hybrid cloud: a recent survey shows that 74% of enterprises have a hybrid cloud strategy. Meanwhile, 94% of enterprises are using some form of XaaS – software, platform, and infrastructure as a service.
One of the biggest impacts of the Internet of Things is and will continue to be on data; specifically data volume, management and usage. Companies are scrambling to adapt to this new and unpredictable data reality with legacy infrastructure that cannot handle the speed and volume of data. In his session at @ThingsExpo, Don DeLoach, CEO and president of Infobright, will discuss how companies need to rethink their data infrastructure to participate in the IoT, including: Data storage: Understanding the kinds of data: structured, unstructured, big/small? Analytics: What kinds and how responsiv...
The Workspace-as-a-Service (WaaS) market will grow to $6.4B by 2018. In his session at 16th Cloud Expo, Seth Bostock, CEO of IndependenceIT, will begin by walking the audience through the evolution of Workspace as-a-Service, where it is now vs. where it going. To look beyond the desktop we must understand exactly what WaaS is, who the users are, and where it is going in the future. IT departments, ISVs and service providers must look to workflow and automation capabilities to adapt to growing demand and the rapidly changing workspace model.
From telemedicine to smart cars, digital homes and industrial monitoring, the explosive growth of IoT has created exciting new business opportunities for real time calls and messaging. In his session at @ThingsExpo, Ivelin Ivanov, CEO and Co-Founder of Telestax, shared some of the new revenue sources that IoT created for Restcomm – the open source telephony platform from Telestax. Ivelin Ivanov is a technology entrepreneur who founded Mobicents, an Open Source VoIP Platform, to help create, deploy, and manage applications integrating voice, video and data. He is the co-founder of TeleStax, a...