Welcome!

Artificial Intelligence Authors: Yeshim Deniz, Elizabeth White, Pat Romanski, Liz McMillan, Kevin Benedict

Related Topics: @ThingsExpo, Open Source Cloud, @DXWorldExpo

@ThingsExpo: Blog Post

IoT Network Visibility | @ThingsExpo @SolarWinds #IoT #IIoT #M2M #API

Accelerating complexity is just one challenge in how hybrid IT is affecting IT departments

Why Network Visibility Beyond the Firewall Is Critical in the IoT Era

In the hybrid IT era, complexity is the name of the game. In fact, according to the recent SolarWinds IT Trends Report 2017, IT professionals report the number one challenge of hybrid IT is increased infrastructure complexity. Accelerating complexity is just one challenge in how hybrid IT is affecting IT departments. Internet of things (IoT) implementations are a great example of one more unexpected, emerging technology IT teams must address.

In the report, IT professionals reported the second greatest challenge of hybrid IT is lack of control and visibility into the performance of cloud-based applications and infrastructure. Most IoT devices connect to cloud back ends or edge/fog-distributed endpoints, rather than traditional data centers. Distributed workloads by their nature put admins in a bind, and the multiplicative nature of IoT devices makes the visibility challenge even more difficult. But this isn't all doom and gloom. The path to managing these complexities is found by exploring the ways IoT use cases play out in different implementations, and identifying solutions for IT professionals to better manage the hybrid IT and IoT convergence.

IoT in Practice
To best understand how to manage complexity and gain visibility beyond the firewall in the IoT era, consider common IoT scenarios in hybrid IT organizations.

Cloud-Based IoT
In this scenario, the back end of the IoT infrastructure is in the public cloud. Potentially millions of distributed devices and multiple clustered workload systems are all reporting data back to the cloud, making cloud monitoring extremely critical. IT professionals managing these cloud-based IoT implementations must be able to view the entire network path to ensure end-user performance, or at least synthetic application performance (if the end user is an IoT bot). This can be difficult because the traffic is completely outside of the firewall. Instrumenting the end-user experience is key to troubleshooting issues, and monitoring cloud infrastructure and cloud components of the application at the same time is necessary.

On-Premises IoT
A great example of this scenario would be industrial IoT, where there are multiple IoT devices but production data is captured in the organization's data center. In this case, the IoT devices create massive amounts of data on-premises, effectively creating the complexity of analyzing a multi-tiered Big Data application. Massive processing and storage is required - perhaps Hadoop® and MapReduce are at play - as well as streaming analytics and transformation. And then, of course, there are security considerations, reporting or regulatory requirements that stem from allowing IoT devices to connect with the data delivery network. For example, are there considerations for new protocols like MQ Telemetry Transport Protocol (MQTT) access instead of HTTP and managing Transport Layer Security (TLS) traffic through the firewall?

All of this can place a significant inbound traffic burden on the on-premises data center, a relative tidal wave from the outside world into the on-premises system via firewalls. An added wrinkle is open source. Many IoT solutions and enabling technologies are based on open source, publicly available projects. Too often, developers in a hurry to get to market are quick to download a package off of GitHub without vetting for security. IT professionals and security managers must ensure control and some method of codebase oversight over these new application delivery stack elements to secure the code accessing our networks.

Edge-Based IoT
This is also known as fog-based IoT - computing at the edge. Here, distributed data collection and processing facilities distill data in the field rather than sending in built-to-cloud or on-premises repositories. For example, a municipal government may have sensors watching traffic patterns to optimize traffic light signaling strategies. In their model, processing IoT data in the field is more cost effective, even if it requires distributed compute resources located offsite. However, those distributed elements must still be managed, their network traffic assured, and performance monitored just as if they were safely back home in a rack, but with the challenge of remote access and latency.

Best Practices for Managing IoT Complexity and Visibility
Regardless of whether an IoT implementation is cloud-based, on-premises, or on the edge, there are common practices that should be followed in order to conquer complexity and visibility issues:

  1. The most powerful tool for hybrid IT gives a single view. Troubleshooting across the boundaries of hybrid IT can have massive positive effects on productivity. At the end of the day, successful management of IoT requires cross-environment visibility.
  2. Education and skill-building should be ongoing. IT departments should work with the business to ensure some budget is allocated to education, personal development training, conference passes, and certifications for IT professionals. Investing in the IT team can pay some of the greatest dividends in terms of being able to manage complexity, especially considering that nearly half of today's IT professionals say IT professionals entering the workforce now do not possess the skills necessary to manage hybrid IT environments. Create the skills on teams now instead of waiting for them to come in the future.
  3. Geek out on data. IT professionals should think about how to unlock their inner data scientists. Rather than just pushing data around, it's important for today's IT professionals to bring operations data and hybrid IT data into the lab and experiment with it. Doing this will likely uncover new insights that can help identify performance issues associated with IoT.

Perhaps one day, there will just be cloud, but in no case is that tomorrow. Hybrid IT will only become more complex and difficult to manage at least for the next few years. A little motivational alarm is okay, as long as IT professionals don't get discouraged and continue close skills gaps. IT professionals who take necessary steps today to improve their environments - regardless of IoT scenario - may experience the empowerment that comes with full visibility across on-premises, to the cloud and beyond, wherever workloads may lie.

More Stories By Patrick Hubbard

Patrick Hubbard is a head geek and senior technical product marketing manager at SolarWinds, with 20 years of technical expertise and IT customer perspective. His networking management experience includes work with campus, data center, high availability and disaster recovery, and storage networks, and with VoIP, telepresence and VDI in both Fortune 500 companies and startups in the high tech, transportation, financial services and telecom industries.

Comments (0)

Share your thoughts on this story.

Add your comment
You must be signed in to add a comment. Sign-in | Register

In accordance with our Comment Policy, we encourage comments that are on topic, relevant and to-the-point. We will remove comments that include profanity, personal attacks, racial slurs, threats of violence, or other inappropriate material that violates our Terms and Conditions, and will block users who make repeated violations. We ask all readers to expect diversity of opinion and to treat one another with dignity and respect.


@ThingsExpo Stories
In his session at @ThingsExpo, Arvind Radhakrishnen discussed how IoT offers new business models in banking and financial services organizations with the capability to revolutionize products, payments, channels, business processes and asset management built on strong architectural foundation. The following topics were covered: How IoT stands to impact various business parameters including customer experience, cost and risk management within BFS organizations.
Here are the Top 20 Twitter Influencers of the month as determined by the Kcore algorithm, in a range of current topics of interest from #IoT to #DeepLearning. To run a real-time search of a given term in our website and see the current top influencers, click on the topic name. Among the top 20 IoT influencers, ThingsEXPO ranked #14 and CloudEXPO ranked #17.
While the focus and objectives of IoT initiatives are many and diverse, they all share a few common attributes, and one of those is the network. Commonly, that network includes the Internet, over which there isn't any real control for performance and availability. Or is there? The current state of the art for Big Data analytics, as applied to network telemetry, offers new opportunities for improving and assuring operational integrity. In his session at @ThingsExpo, Jim Frey, Vice President of S...
With the introduction of IoT and Smart Living in every aspect of our lives, one question has become relevant: What are the security implications? To answer this, first we have to look and explore the security models of the technologies that IoT is founded upon. In his session at @ThingsExpo, Nevi Kaja, a Research Engineer at Ford Motor Company, discussed some of the security challenges of the IoT infrastructure and related how these aspects impact Smart Living. The material was delivered interac...
Andrew Keys is Co-Founder of ConsenSys Enterprise. He comes to ConsenSys Enterprise with capital markets, technology and entrepreneurial experience. Previously, he worked for UBS investment bank in equities analysis. Later, he was responsible for the creation and distribution of life settlement products to hedge funds and investment banks. After, he co-founded a revenue cycle management company where he learned about Bitcoin and eventually Ethereal. Andrew's role at ConsenSys Enterprise is a mul...
Amazon started as an online bookseller 20 years ago. Since then, it has evolved into a technology juggernaut that has disrupted multiple markets and industries and touches many aspects of our lives. It is a relentless technology and business model innovator driving disruption throughout numerous ecosystems. Amazon’s AWS revenues alone are approaching $16B a year making it one of the largest IT companies in the world. With dominant offerings in Cloud, IoT, eCommerce, Big Data, AI, Digital Assista...
In his session at Cloud Expo, Alan Winters, U.S. Head of Business Development at MobiDev, presented a success story of an entrepreneur who has both suffered through and benefited from offshore development across multiple businesses: The smart choice, or how to select the right offshore development partner Warning signs, or how to minimize chances of making the wrong choice Collaboration, or how to establish the most effective work processes Budget control, or how to maximize project result...
The Founder of NostaLab and a member of the Google Health Advisory Board, John is a unique combination of strategic thinker, marketer and entrepreneur. His career was built on the "science of advertising" combining strategy, creativity and marketing for industry-leading results. Combined with his ability to communicate complicated scientific concepts in a way that consumers and scientists alike can appreciate, John is a sought-after speaker for conferences on the forefront of healthcare science,...
In his keynote at 19th Cloud Expo, Sheng Liang, co-founder and CEO of Rancher Labs, discussed the technological advances and new business opportunities created by the rapid adoption of containers. With the success of Amazon Web Services (AWS) and various open source technologies used to build private clouds, cloud computing has become an essential component of IT strategy. However, users continue to face challenges in implementing clouds, as older technologies evolve and newer ones like Docker c...
When shopping for a new data processing platform for IoT solutions, many development teams want to be able to test-drive options before making a choice. Yet when evaluating an IoT solution, it’s simply not feasible to do so at scale with physical devices. Building a sensor simulator is the next best choice; however, generating a realistic simulation at very high TPS with ease of configurability is a formidable challenge. When dealing with multiple application or transport protocols, you would be...
Data is the fuel that drives the machine learning algorithmic engines and ultimately provides the business value. In his session at Cloud Expo, Ed Featherston, a director and senior enterprise architect at Collaborative Consulting, discussed the key considerations around quality, volume, timeliness, and pedigree that must be dealt with in order to properly fuel that engine.
Personalization has long been the holy grail of marketing. Simply stated, communicate the most relevant offer to the right person and you will increase sales. To achieve this, you must understand the individual. Consequently, digital marketers developed many ways to gather and leverage customer information to deliver targeted experiences. In his session at @ThingsExpo, Lou Casal, Founder and Principal Consultant at Practicala, discussed how the Internet of Things (IoT) has accelerated our abilit...
Detecting internal user threats in the Big Data eco-system is challenging and cumbersome. Many organizations monitor internal usage of the Big Data eco-system using a set of alerts. This is not a scalable process given the increase in the number of alerts with the accelerating growth in data volume and user base. Organizations are increasingly leveraging machine learning to monitor only those data elements that are sensitive and critical, autonomously establish monitoring policies, and to detect...
Dion Hinchcliffe is an internationally recognized digital expert, bestselling book author, frequent keynote speaker, analyst, futurist, and transformation expert based in Washington, DC. He is currently Chief Strategy Officer at the industry-leading digital strategy and online community solutions firm, 7Summits.
Two weeks ago (November 3-5), I attended the Cloud Expo Silicon Valley as a speaker, where I presented on the security and privacy due diligence requirements for cloud solutions. Cloud security is a topical issue for every CIO, CISO, and technology buyer. Decision-makers are always looking for insights on how to mitigate the security risks of implementing and using cloud solutions. Based on the presentation topics covered at the conference, as well as the general discussions heard between sessio...
Recently, REAN Cloud built a digital concierge for a North Carolina hospital that had observed that most patient call button questions were repetitive. In addition, the paper-based process used to measure patient health metrics was laborious, not in real-time and sometimes error-prone. In their session at 21st Cloud Expo, Sean Finnerty, Executive Director, Practice Lead, Health Care & Life Science at REAN Cloud, and Dr. S.P.T. Krishnan, Principal Architect at REAN Cloud, discussed how they built...
In his keynote at 18th Cloud Expo, Andrew Keys, Co-Founder of ConsenSys Enterprise, provided an overview of the evolution of the Internet and the Database and the future of their combination – the Blockchain. Andrew Keys is Co-Founder of ConsenSys Enterprise. He comes to ConsenSys Enterprise with capital markets, technology and entrepreneurial experience. Previously, he worked for UBS investment bank in equities analysis. Later, he was responsible for the creation and distribution of life settl...
IoT solutions exploit operational data generated by Internet-connected smart “things” for the purpose of gaining operational insight and producing “better outcomes” (for example, create new business models, eliminate unscheduled maintenance, etc.). The explosive proliferation of IoT solutions will result in an exponential growth in the volume of IoT data, precipitating significant Information Governance issues: who owns the IoT data, what are the rights/duties of IoT solutions adopters towards t...
With tough new regulations coming to Europe on data privacy in May 2018, Calligo will explain why in reality the effect is global and transforms how you consider critical data. EU GDPR fundamentally rewrites the rules for cloud, Big Data and IoT. In his session at 21st Cloud Expo, Adam Ryan, Vice President and General Manager EMEA at Calligo, examined the regulations and provided insight on how it affects technology, challenges the established rules and will usher in new levels of diligence arou...
Organizations planning enterprise data center consolidation and modernization projects are faced with a challenging, costly reality. Requirements to deploy modern, cloud-native applications simultaneously with traditional client/server applications are almost impossible to achieve with hardware-centric enterprise infrastructure. Compute and network infrastructure are fast moving down a software-defined path, but storage has been a laggard. Until now.