Artificial Intelligence Authors: Rostyslav Demush, Elizabeth White, Liz McMillan, Pat Romanski, William Schmarzo

Related Topics: Artificial Intelligence, Java IoT, Microservices Expo

Artificial Intelligence: Article

Finding the Flaws of the Whole, Not Just the Flaws of the Parts

Why automated analysis and measurement is a must for SAP systems

The Visible and the Invisible in SAP
It would seem like the last thing we need in SAP systems is more metrics. Automated solutions that investigate, monitor and track ERP systems are common, so why are major corporations increasingly employing automated metrics for SAP systems?

Like all systems that span the enterprise, SAP systems suffer from the "six blind men and the elephant" problem - each man is able to envision his own part of the elephant, but putting together a picture of the whole animal is a problem. It is this "whole is greater than the sum of its parts" view that SAP developers need to get their arms around.

In what has become an all too frequent post-customization scenario, SAP developers are called to fix a transaction performance problem. Usually they find that availability is great, there's nothing wrong with the code - no odd changes - but somehow latency is in the tank. So what's wrong?

Some recent research on this very issue looked at 30 customer installs at large installations at Fortune 1000 companies with a lot of customization. The study looked closely at how database calls are handled in these installations.

The result was startling - 80 percent of the database interactions were being improperly handled. Large packet sizes, too much chatter, improper error handling, loops in queries and lapses in connection handling were prevalent. These problems caused periodic and significant business disruption. As we know, intermittent problems are the hardest to trace and fix because if you can't replicate it, you can't see what to fix - it's the kind of problem that traps you in the office on a Sunday until 3 a.m.

How does this kind of thing end up happening with such alarming frequency? After all, no ABAP developer worth his or her salt would ever do such things and no database admin would be caught dead writing inefficient queries. It must be those darn six blind men!

Figure 1: A Typical SAP Ecosystem

The blind men are the symptom caused by three types of complexity:

  1. Technological Complexity: A typical SAP install has a large number of interconnected, customized components, with dependencies spanning from the GUI to the database layer. Business transactions cut across applications, functional roles within IT, business processes and business divisions. No single developer or even team of developers can comprehend the system end to end. Changes have ripple effects that are difficult to predict and control. None of these is by itself a bad thing, but together they make it very hard to get a sense of how the system is working as a whole to accomplish its critical business tasks.
  2. Process Complexity: Because the system crosses organizational boundaries within and outside IT, it runs into different processes within these groups. Each process demands a unique skill set for the people involved, and has its own timeframe, maturity level, inputs and outputs. It is inevitable that when seen as one large "super-process," a lot falls through the cracks because no one person or team has the complete end-to-end view.
  3. Governance Complexity: When you add organizational and reporting structures to the process complexity layer, you get governance complexity. This is about the hierarchies of authority and influence that manipulate the processes. The result is a highly scrutinized business-critical system that outruns technology, process, and governance boundaries. In such situations, one team's priority may not be another's, resulting in an inability to see the end-to-end view.

As we see in the next section, this fragmented view of the systems causes all the typical problems that beset ERP systems.

Structural Visibility of the Whole System
Inability to capture the end-to-end view leads to the usual problems people cite with ERP systems - escalating maintenance costs (over and above the 18% license cost) and nagging performance and stability problems. The root causes of these problems are hard to discern, but they have become almost clichéd and yawn inducing in their recurrence...

What people who cite these problems don't realize is there's nothing any individual developer can do (other than what they're already doing) to fix these problems. It's not what I do or what you did - it's what happens when we put together what a couple of hundred of us did at different locations, on different parts of the system, at different times, under different deadlines.

It's like the deficit. You didn't cause it and there's nothing you alone can do to reduce it. It's the result of thousands of things coming together to add up to something enormous that's beyond the control of any one person or group. Nevertheless, it could harm us all, so what can we do?

When the whole is greater than the sum of its parts, what we need is structural visibility into how the parts come together to create the whole. In the case of an ERP system, you need measures of two levels of quality: the software's architectural quality - the structural quality - and the quality of coding practices and level of compliance with security standards - the implementation quality. These measures are essential for catching business disruption problems early before they become too expensive to fix.

Figure 2: Sample End-to-End System Quality Metrics

Moreover, you cannot just measure the individual parts because that fails to take into account how each of them comes together to form the final product. And while an individual may be able to assess the quality of a single part manually, manually measuring the whole product is a daunting and grossly inefficient task, one that no one team member can or should be asked to undertake. Automating analysis of the parts and the whole is a far more efficient means to an end.

Three Conditions an Automated Analysis and Measurement System Must Satisfy
A fundamental fact about software quality that makes it a challenge to quantify is that quality is contextual - you cannot evaluate the quality of an element independently of its environment. This means that any process for measuring the structural quality of the entire system must satisfy three conditions:

  1. It must be automated to avoid falling into the technology, process and governance white spaces.
  2. It must be comprehensive in its technology coverage, yet come in a single package. Not surprisingly, it has to cover the entire system from GUI to middleware, to the customized parts, all the way to the database.  In modern systems, this means it has to cover a multiplicity of languages, technologies and frameworks. This comprehensive coverage must all come together in the same package; if you use a patchwork of tools, you will inevitably fall into the cracks between technology, process and governance boundaries.
  3. It must rise to the structural level to measure quality in the context of the system as a whole. From an implementation standpoint, this will most likely mean that it must produce detailed architectural maps of the entire system - views of the components and how they are connected - and run sophisticated pattern-matching algorithms that are specifically calibrated for measuring quality - performance, stability and maintainability - in the SAP environment.

An example of how to accomplish this is to base automated analysis and measurement of ERP systems on a very detailed understanding of the architectural structure of the system - what the components are and how they're interconnected - by building the architectural model from the ground up in intense detail. Such sophisticated pattern-matching algorithms are then specifically tuned to measuring quality in terms of performance, stability and maintainability in the ERP environment. A top automated analysis platform for ERP systems may have more than 100 pattern-matching rules for SAP. (Note: The number of pattern-matching rules can vary from one ERP to another.) A robust end-to-end automated quality measurement system for the Siebel platform may also have more than 100 rules for detecting patterns and anti-patterns that are critical to system quality, while leading PeopleSoft-specific solutions may need more than 400 sophisticated pattern-matching rules to evaluate the holistic engineering quality of the system).

Regardless of how many rules are in place, it is vital that the platform detects changes between the original core application and the customized application, or between patched and un-patched version of the same application. Along with detailed architectural visibility and objective measures of quality hot spots, such a solution will give IT organizations and system integrators a detailed, practical roadmap for sequencing their development, maintenance and upgrade tasks.

The technological, process, and governance complexity of SAP systems make them very difficult to manage for peak cost and business performance. Furthermore, because the whole system is more than just the sum of its parts, the analysis and measurement must rise to the structural level to quantify and evaluate the structural quality of the system, making an automated analysis and quality measurement system a necessity.

More Stories By Jitendra Subramanyam

Jitendra Subramanyam is Director of Product Strategy and Research at CAST, Inc., in New York City. He is responsible for helping to develop and grow the ecosystem of IT service providers who benefit from integrating CAST into their operations, governance and process improvement programs.

Comments (0)

Share your thoughts on this story.

Add your comment
You must be signed in to add a comment. Sign-in | Register

In accordance with our Comment Policy, we encourage comments that are on topic, relevant and to-the-point. We will remove comments that include profanity, personal attacks, racial slurs, threats of violence, or other inappropriate material that violates our Terms and Conditions, and will block users who make repeated violations. We ask all readers to expect diversity of opinion and to treat one another with dignity and respect.

@ThingsExpo Stories
"Akvelon is a software development company and we also provide consultancy services to folks who are looking to scale or accelerate their engineering roadmaps," explained Jeremiah Mothersell, Marketing Manager at Akvelon, in this SYS-CON.tv interview at 21st Cloud Expo, held Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA.
"MobiDev is a software development company and we do complex, custom software development for everybody from entrepreneurs to large enterprises," explained Alan Winters, U.S. Head of Business Development at MobiDev, in this SYS-CON.tv interview at 21st Cloud Expo, held Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA.
SYS-CON Events announced today that CrowdReviews.com has been named “Media Sponsor” of SYS-CON's 22nd International Cloud Expo, which will take place on June 5–7, 2018, at the Javits Center in New York City, NY. CrowdReviews.com is a transparent online platform for determining which products and services are the best based on the opinion of the crowd. The crowd consists of Internet users that have experienced products and services first-hand and have an interest in letting other potential buye...
"IBM is really all in on blockchain. We take a look at sort of the history of blockchain ledger technologies. It started out with bitcoin, Ethereum, and IBM evaluated these particular blockchain technologies and found they were anonymous and permissionless and that many companies were looking for permissioned blockchain," stated René Bostic, Technical VP of the IBM Cloud Unit in North America, in this SYS-CON.tv interview at 21st Cloud Expo, held Oct 31 – Nov 2, 2017, at the Santa Clara Conventi...
SYS-CON Events announced today that Telecom Reseller has been named “Media Sponsor” of SYS-CON's 22nd International Cloud Expo, which will take place on June 5-7, 2018, at the Javits Center in New York, NY. Telecom Reseller reports on Unified Communications, UCaaS, BPaaS for enterprise and SMBs. They report extensively on both customer premises based solutions such as IP-PBX as well as cloud based and hosted platforms.
Large industrial manufacturing organizations are adopting the agile principles of cloud software companies. The industrial manufacturing development process has not scaled over time. Now that design CAD teams are geographically distributed, centralizing their work is key. With large multi-gigabyte projects, outdated tools have stifled industrial team agility, time-to-market milestones, and impacted P&L stakeholders.
"Space Monkey by Vivent Smart Home is a product that is a distributed cloud-based edge storage network. Vivent Smart Home, our parent company, is a smart home provider that places a lot of hard drives across homes in North America," explained JT Olds, Director of Engineering, and Brandon Crowfeather, Product Manager, at Vivint Smart Home, in this SYS-CON.tv interview at @ThingsExpo, held Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA.
Coca-Cola’s Google powered digital signage system lays the groundwork for a more valuable connection between Coke and its customers. Digital signs pair software with high-resolution displays so that a message can be changed instantly based on what the operator wants to communicate or sell. In their Day 3 Keynote at 21st Cloud Expo, Greg Chambers, Global Group Director, Digital Innovation, Coca-Cola, and Vidya Nagarajan, a Senior Product Manager at Google, discussed how from store operations and ...
"Cloud Academy is an enterprise training platform for the cloud, specifically public clouds. We offer guided learning experiences on AWS, Azure, Google Cloud and all the surrounding methodologies and technologies that you need to know and your teams need to know in order to leverage the full benefits of the cloud," explained Alex Brower, VP of Marketing at Cloud Academy, in this SYS-CON.tv interview at 21st Cloud Expo, held Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clar...
In his session at 21st Cloud Expo, Carl J. Levine, Senior Technical Evangelist for NS1, will objectively discuss how DNS is used to solve Digital Transformation challenges in large SaaS applications, CDNs, AdTech platforms, and other demanding use cases. Carl J. Levine is the Senior Technical Evangelist for NS1. A veteran of the Internet Infrastructure space, he has over a decade of experience with startups, networking protocols and Internet infrastructure, combined with the unique ability to it...
It is of utmost importance for the future success of WebRTC to ensure that interoperability is operational between web browsers and any WebRTC-compliant client. To be guaranteed as operational and effective, interoperability must be tested extensively by establishing WebRTC data and media connections between different web browsers running on different devices and operating systems. In his session at WebRTC Summit at @ThingsExpo, Dr. Alex Gouaillard, CEO and Founder of CoSMo Software, presented ...
"There's plenty of bandwidth out there but it's never in the right place. So what Cedexis does is uses data to work out the best pathways to get data from the origin to the person who wants to get it," explained Simon Jones, Evangelist and Head of Marketing at Cedexis, in this SYS-CON.tv interview at 21st Cloud Expo, held Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA.
WebRTC is great technology to build your own communication tools. It will be even more exciting experience it with advanced devices, such as a 360 Camera, 360 microphone, and a depth sensor camera. In his session at @ThingsExpo, Masashi Ganeko, a manager at INFOCOM Corporation, introduced two experimental projects from his team and what they learned from them. "Shotoku Tamago" uses the robot audition software HARK to track speakers in 360 video of a remote party. "Virtual Teleport" uses a multip...
Gemini is Yahoo’s native and search advertising platform. To ensure the quality of a complex distributed system that spans multiple products and components and across various desktop websites and mobile app and web experiences – both Yahoo owned and operated and third-party syndication (supply), with complex interaction with more than a billion users and numerous advertisers globally (demand) – it becomes imperative to automate a set of end-to-end tests 24x7 to detect bugs and regression. In th...
A strange thing is happening along the way to the Internet of Things, namely far too many devices to work with and manage. It has become clear that we'll need much higher efficiency user experiences that can allow us to more easily and scalably work with the thousands of devices that will soon be in each of our lives. Enter the conversational interface revolution, combining bots we can literally talk with, gesture to, and even direct with our thoughts, with embedded artificial intelligence, whic...
SYS-CON Events announced today that Evatronix will exhibit at SYS-CON's 21st International Cloud Expo®, which will take place on Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. Evatronix SA offers comprehensive solutions in the design and implementation of electronic systems, in CAD / CAM deployment, and also is a designer and manufacturer of advanced 3D scanners for professional applications.
Leading companies, from the Global Fortune 500 to the smallest companies, are adopting hybrid cloud as the path to business advantage. Hybrid cloud depends on cloud services and on-premises infrastructure working in unison. Successful implementations require new levels of data mobility, enabled by an automated and seamless flow across on-premises and cloud resources. In his general session at 21st Cloud Expo, Greg Tevis, an IBM Storage Software Technical Strategist and Customer Solution Architec...
To get the most out of their data, successful companies are not focusing on queries and data lakes, they are actively integrating analytics into their operations with a data-first application development approach. Real-time adjustments to improve revenues, reduce costs, or mitigate risk rely on applications that minimize latency on a variety of data sources. In his session at @BigDataExpo, Jack Norris, Senior Vice President, Data and Applications at MapR Technologies, reviewed best practices to ...
An increasing number of companies are creating products that combine data with analytical capabilities. Running interactive queries on Big Data requires complex architectures to store and query data effectively, typically involving data streams, an choosing efficient file format/database and multiple independent systems that are tied together through custom-engineered pipelines. In his session at @BigDataExpo at @ThingsExpo, Tomer Levi, a senior software engineer at Intel’s Advanced Analytics gr...
When talking IoT we often focus on the devices, the sensors, the hardware itself. The new smart appliances, the new smart or self-driving cars (which are amalgamations of many ‘things’). When we are looking at the world of IoT, we should take a step back, look at the big picture. What value are these devices providing? IoT is not about the devices, it’s about the data consumed and generated. The devices are tools, mechanisms, conduits. In his session at Internet of Things at Cloud Expo | DXWor...