Welcome!

Agile Computing Authors: XebiaLabs Blog, Suresh Sambandam, Liz McMillan, Elizabeth White, Moshe Kranc

Blog Feed Post

Effective Storage for Growing Data Volumes

By Ian Kilpatrick, chairman Wick Hill Group

Dealing with vast amounts of data used to be a problem faced purely by large enterprises. However, in today's world of rapidly increasing data, it's now an issue for companies of all sizes.

Data is increasing for all sorts of reasons, which include the use of social media and the increased use of mobile devices such as smartphones and tablets, which have dramatically increased the amount of data being backed up on the network.

Symantec's recent State of Information Survey conducted over 38 countries worldwide found that SMEs expected their storage to increase by 178% over the next year.

The large amount of data companies now produce, which can be in the terabytes and petabytes, needs to be backed up and stored so it can be accessed easily and quickly. It needs to be archived in case it is needed in the future and also for compliance reasons; and it needs to be replicated, so it's available for use in the case of a disaster. All this needs to be done cost-effectively and securely.

Storage is a notoriously boring subject for many people, and it tends to get pushed down the list of priorities. While enterprises have the resources to manage their back-up and storage issues, many organisations consider it a necessary evil and don't review its financial effectiveness or its fitness for future purpose.

This is a shame, as in all matters IT, times have moved on from things such as old-style tape systems. Modern solutions are bigger, better, easier and lower cost, often with features previously only available on enterprise systems.

Increases in data volume now make storage a key business issue for companies. Performance issues, which result from companies being overwhelmed by data or by backing up, could impact on profitability. The inability to access data quickly, in the event of a disaster, could put a company out of business.

Some recent statistics indicate that 43% of businesses that close after a natural disaster never re-open and a further 29% close within two years. One of the key reasons for this is the failure of their disaster-recovery planning. Back-ups and back-up plans need to be tested regularly to ensure that they are relevant or actually working. Finding that your back-ups are corrupted, when you absolutely need them, is too late.

Which route forward?
The question is how to choose a storage solution that will cope with current storage needs as well as taking you forward into a future of unpredictable, and mushrooming, data growth?

Storage solutions for companies outside the Top 500 range from traditional tape to the cloud, with other options and permutations in between. For some organisations, cloud may be the answer. For others, particularly if they have been using tape in the past, the leap to the cloud is just too great and they want something more tangible, such as disc-based storage.

For some, the solution may be a hybrid one which gives local back up with background cloud back-up. This option provides speed of access with the security of offsite cloud.

Companies still using traditional tape for back-up and archiving will be finding it increasingly inadequate for their needs, that is if they've checked recently. Tape also has inherent disadvantages.

It's cumbersome, expensive, has a finite life and is easily damaged. It takes longer and longer, the more you are backing up. And it can be very difficult to find things quickly on tape when you need them.

The cloud, while it may seem like a great option to many, isn't for everyone. One disadvantage of the cloud, which many aren't aware of, is that the data is probably going to be stored on traditional tape.

Another issue to be aware of is how long it takes to seed and download data over limited capacity internet connections. Seeding a terabyte of data in the cloud on a 10mbps connection with nothing else going on will take 300 hours (12.5 days).

This means that accessing it and downloading it could take days. If you have a serious disaster recovery situation, this may possibly be acceptable, but it's a serious hindrance if you need to access stored data quickly during the normal day-to-day running of a business.

Solutions
One solution for more conservative SMEs is to use RDX removable hard disc cartridges for storage. They combine the best of hard disc and tape storage. They scale with a business, but, unlike tape, are very rugged and reliable. It's a step forward, for those who have been using tape, which isn't too different from what went before.

RDX cartridges back-up and restore data very quickly (much quicker than tape) and are very secure. They are typically available in sizes from 160 gigabytes to 1.5 terabytes. You just add extra cartridges as your storage needs expand.

Imation, for example, which has a specialist division for SME storage, provides an RDX solution, the A8, which can accommodate up to 12 terabytes of data.

The A8 helps SMEs conduct high-performance back-up, data protection, archiving, restoration and cloud-enabling. It can mix RDX cartridges of different sizes, so users can start with lower capacity cartridges and add higher capacity ones as needs dictate.

A solution like this allows organisations to quickly back up and instantly access their crucial data. It gives them more operational flexibility and the ability to cost-effectively and quickly recover their data in the event of a disaster. Users get the benefits of RDX cartridge storage, but also keep cloud options open.

Imation also provides another product which gives companies a comprehensive set of storage and back-up options.

DataGuard is a network attached storage (NAS) backup appliance which uses hard disk drives, removable RDX® disk cartridges, replication, and cloud storage to provide up to four layers of data protection. It shortens back-up windows and allows for fast recovery.

DataGuard is capable of making multiple copies of content as local online copies, replicated copies, optional offline RDX copies and remote online (cloud) copies.

It means companies can have all bases covered. They don't have to go with the cloud straight away, but the facility is there to do it when and if they are ready.

Another company which provides a solution which gives the best of both worlds, both local and cloud storage, is Barracuda with its Barracuda Backup Service.

This provides full local data back-up and is combined with a storage subscription, to replicate data to the cloud at two offsite locations. So organisations get onsite back-ups for fast restore times and secure, offsite storage for disaster recovery.

The Barracuda system uses a technology called deduplication, which reduces traditional back-up storage requirements by 20 to 50 times, while also reducing back-up windows and bandwidth requirements.

Deduplication works by eliminating redundant data. Only one unique instance of the data is actually retained. The redundant data is replaced with a pointer to the original copy.

Conclusion
One constant is guaranteed. Storage and data access requirements will (as they always have done) continue to grow, in fact the pace appears to be accelerating. Alongside the change in data volumes, new options have become available which provide enterprise-level solutions at affordable prices.

A range of such options is available from RDX cartridges to cloud services, plus a variety of combinations in between. Such solutions allow organisations to effectively back-up and store data, so it doesn't cause serious performance problems on the network; they allow the data to be quickly available for both the running of the business and for compliance purposes; and they offer a disaster recovery option.

Bio of author
Ian Kilpatrick is chairman of international value added distributor Wick Hill Group plc, specialists in market development for secure IP infrastructure solutions and convergence. Kilpatrick has been involved with the Group for more than 35 years. Wick Hill supplies organisations from enterprises to SMEs, through an extensive value-added network of accredited VARs.

Kilpatrick has an in-depth experience of IT and unified communications (UC) with a strong vision of the future. He looks at these areas from a business point-of-view and his approach reflects his philosophy that business benefits, ease-of-use and cost of ownership are key factors, rather than just technology. He has authored numerous articles and publications, as well as being a regular speaker at conferences, exhibitions and seminars. For more information about Wick Hill, please visit http://www.wickhill.com or www.twitter.com/wickhill.

ENDS

For further press information, please contact Annabelle Brown on 01326 318212, email [email protected]. For reader queries, contact Wick Hill on 01483 227600. Web http://www.wickhill.com. For pic of Ian Kilpatrick, please contact Annabelle Brown or download from www.wickhill.com/company/press/pictures

Read the original blog entry...

More Stories By RealWire News Distribution

RealWire is a global news release distribution service specialising in the online media. The RealWire approach focuses on delivering relevant content to the receivers of our client's news releases. As we know that it is only through delivering relevance, that influence can ever be achieved.

@ThingsExpo Stories
"delaPlex is a software development company. We do team-based outsourcing development," explained Mark Rivers, COO and Co-founder of delaPlex Software, in this SYS-CON.tv interview at 18th Cloud Expo, held June 7-9, 2016, at the Javits Center in New York City, NY.
ReadyTalk has expanded the capabilities of the FoxDen collaboration platform announced late last year to include FoxDen Connect, an in-room video collaboration experience that launches with a single touch. With FoxDen Connect, users can now not only engage in HD video conferencing between iOS and Android mobile devices or Chrome browsers, but also set up in-person meeting rooms for video interactions. A host’s mobile device automatically recognizes the presence of a meeting room via beacon tech...
On Dice.com, the number of job postings asking for skill in Amazon Web Services increased 76 percent between June 2015 and June 2016. Salesforce.com saw its own skill mentions increase 37 percent, while DevOps and Cloud rose 35 percent and 28 percent, respectively. Even as they expand their presence in the cloud, companies are also looking for tech professionals who can manage projects, crunch data, and figure out how to make systems run more autonomously. Mentions of ‘data science’ as a skill ...
Amazon has gradually rolled out parts of its IoT offerings in the last year, but these are just the tip of the iceberg. In addition to optimizing their back-end AWS offerings, Amazon is laying the ground work to be a major force in IoT – especially in the connected home and office. Amazon is extending its reach by building on its dominant Cloud IoT platform, its Dash Button strategy, recently announced Replenishment Services, the Echo/Alexa voice recognition control platform, the 6-7 strategic...
SYS-CON Events announced today that LeaseWeb USA, a cloud Infrastructure-as-a-Service (IaaS) provider, will exhibit at the 19th International Cloud Expo, which will take place on November 1–3, 2016, at the Santa Clara Convention Center in Santa Clara, CA. LeaseWeb is one of the world's largest hosting brands. The company helps customers define, develop and deploy IT infrastructure tailored to their exact business needs, by combining various kinds cloud solutions.
For basic one-to-one voice or video calling solutions, WebRTC has proven to be a very powerful technology. Although WebRTC’s core functionality is to provide secure, real-time p2p media streaming, leveraging native platform features and server-side components brings up new communication capabilities for web and native mobile applications, allowing for advanced multi-user use cases such as video broadcasting, conferencing, and media recording.
SYS-CON Events announced today that Venafi, the Immune System for the Internet™ and the leading provider of Next Generation Trust Protection, will exhibit at @DevOpsSummit at 19th International Cloud Expo, which will take place on November 1–3, 2016, at the Santa Clara Convention Center in Santa Clara, CA. Venafi is the Immune System for the Internet™ that protects the foundation of all cybersecurity – cryptographic keys and digital certificates – so they can’t be misused by bad guys in attacks...
The cloud market growth today is largely in public clouds. While there is a lot of spend in IT departments in virtualization, these aren’t yet translating into a true “cloud” experience within the enterprise. What is stopping the growth of the “private cloud” market? In his general session at 18th Cloud Expo, Nara Rajagopalan, CEO of Accelerite, explored the challenges in deploying, managing, and getting adoption for a private cloud within an enterprise. What are the key differences between wh...
There will be new vendors providing applications, middleware, and connected devices to support the thriving IoT ecosystem. This essentially means that electronic device manufacturers will also be in the software business. Many will be new to building embedded software or robust software. This creates an increased importance on software quality, particularly within the Industrial Internet of Things where business-critical applications are becoming dependent on products controlled by software. Qua...
In addition to all the benefits, IoT is also bringing new kind of customer experience challenges - cars that unlock themselves, thermostats turning houses into saunas and baby video monitors broadcasting over the internet. This list can only increase because while IoT services should be intuitive and simple to use, the delivery ecosystem is a myriad of potential problems as IoT explodes complexity. So finding a performance issue is like finding the proverbial needle in the haystack.
Machine Learning helps make complex systems more efficient. By applying advanced Machine Learning techniques such as Cognitive Fingerprinting, wind project operators can utilize these tools to learn from collected data, detect regular patterns, and optimize their own operations. In his session at 18th Cloud Expo, Stuart Gillen, Director of Business Development at SparkCognition, discussed how research has demonstrated the value of Machine Learning in delivering next generation analytics to imp...
The 19th International Cloud Expo has announced that its Call for Papers is open. Cloud Expo, to be held November 1-3, 2016, at the Santa Clara Convention Center in Santa Clara, CA, brings together Cloud Computing, Big Data, Internet of Things, DevOps, Digital Transformation, Microservices and WebRTC to one location. With cloud computing driving a higher percentage of enterprise IT budgets every year, it becomes increasingly important to plant your flag in this fast-expanding business opportuni...
The Internet of Things will challenge the status quo of how IT and development organizations operate. Or will it? Certainly the fog layer of IoT requires special insights about data ontology, security and transactional integrity. But the developmental challenges are the same: People, Process and Platform. In his session at @ThingsExpo, Craig Sproule, CEO of Metavine, demonstrated how to move beyond today's coding paradigm and shared the must-have mindsets for removing complexity from the develo...
SYS-CON Events announced today that MangoApps will exhibit at the 19th International Cloud Expo, which will take place on November 1–3, 2016, at the Santa Clara Convention Center in Santa Clara, CA. MangoApps provides modern company intranets and team collaboration software, allowing workers to stay connected and productive from anywhere in the world and from any device.
Large scale deployments present unique planning challenges, system commissioning hurdles between IT and OT and demand careful system hand-off orchestration. In his session at @ThingsExpo, Jeff Smith, Senior Director and a founding member of Incenergy, will discuss some of the key tactics to ensure delivery success based on his experience of the last two years deploying Industrial IoT systems across four continents.
Basho Technologies has announced the latest release of Basho Riak TS, version 1.3. Riak TS is an enterprise-grade NoSQL database optimized for Internet of Things (IoT). The open source version enables developers to download the software for free and use it in production as well as make contributions to the code and develop applications around Riak TS. Enhancements to Riak TS make it quick, easy and cost-effective to spin up an instance to test new ideas and build IoT applications. In addition to...
Identity is in everything and customers are looking to their providers to ensure the security of their identities, transactions and data. With the increased reliance on cloud-based services, service providers must build security and trust into their offerings, adding value to customers and improving the user experience. Making identity, security and privacy easy for customers provides a unique advantage over the competition.
"We've discovered that after shows 80% if leads that people get, 80% of the conversations end up on the show floor, meaning people forget about it, people forget who they talk to, people forget that there are actual business opportunities to be had here so we try to help out and keep the conversations going," explained Jeff Mesnik, Founder and President of ContentMX, in this SYS-CON.tv interview at 18th Cloud Expo, held June 7-9, 2016, at the Javits Center in New York City, NY.
"There's a growing demand from users for things to be faster. When you think about all the transactions or interactions users will have with your product and everything that is between those transactions and interactions - what drives us at Catchpoint Systems is the idea to measure that and to analyze it," explained Leo Vasiliou, Director of Web Performance Engineering at Catchpoint Systems, in this SYS-CON.tv interview at 18th Cloud Expo, held June 7-9, 2016, at the Javits Center in New York Ci...
Internet of @ThingsExpo, taking place November 1-3, 2016, at the Santa Clara Convention Center in Santa Clara, CA, is co-located with the 19th International Cloud Expo and will feature technical sessions from a rock star conference faculty and the leading industry players in the world and ThingsExpo Silicon Valley Call for Papers is now open.