Tuesday, December 4, 2012

Using Word Clouds to Analyze Legacy BI Applications

If you have end-user reporting applications on the mainframe, some of them may have been around for decades. More than likely, the original coders have long ago retired and few people today can explain what these applications are doing.

I decided to add some visualization to shed light on legacy applications' inner secrets. Here is a word cloud generated from the keywords found inside a legacy FOCUS 4GL application:
After scanning the legacy libraries, I used the R statistical programming language to create a word cloud.

Somebody with an understanding of the FOCUS language can decipher this word cloud and quickly see that this application runs on a mainframe computer (e.g., the DYNAM commands) using green-screen technologies (e.g., the -CRTFORM and PFKEY commands). It is primarily a mainframe reporting application (the TABLE command) using menu navigation screens.

What is unusual is the big CASE keyword, which is a MODIFY database maintenance feature to provide procedural branching.

In this word cloud, the MODIFY count is small, the CRTFORM count is slightly bigger, and the CASE count is relatively large. Without looking, my first hunch is that somebody used the old IBI MODIFYTALK facility to automatically generate an add/update/delete online transaction application. That 1980s tool was notorious for generating a lengthy routine with lots of CASE logic.

In addition to the keywords, I could also do a word cloud of the actual database tables being accessed. If I needed more detail, I could also do word clouds for the columns of particular tables.

Since I'm a visual guy, this seems much nicer to me than looking at a spreadsheet or tabular report of numbers.

Of course, this type of visual analysis is not limited to the FOCUS product from Information Builders. It could be done for the other 4GLs (NOMAD and RAMIS) or reporting tools such as SAS, QMF/SQL, Crystal Reports, etc.

There is no reason you should not understand your legacy reporting applications.

If you are interested in learning more, just contact me. 

Here are some other links: 

No comments:

About Me

My Photo


With over 20 years of industry experience, Doug Lautzenheiser has provided business intelligence services for well-known organizations such as Procter & Gamble, JPMorgan Chase, Omnicare, Wendy’s International, the State of Indiana, and the State of Oklahoma. ComputerWorld recognized one of Doug's projects with honors for innovative use of technology.  Doug is a featured blogger on BI software at Smart Data Collective.

With his broad knowledge of technologies, business processes, and industry best practices, Doug provides client value by performing strategic advisory services; leading tactical BI application development projects; and enabling dramatic reductions in time, cost, and risks through his unique automated BI consolidation application.

Doug has hands-on experience with a variety of enterprise applications. He is degreed summa cum laude in Information Systems from the University of Cincinnati. An experienced trainer and mentor, Doug has provided educational services to organizations such as National Semiconductor, Ford Motor Company, Northwest Airlines, Principal Financial Group, and Target Stores. Doug is the owner of Kencura Systems.

Talk to Doug before manually performing a large BI initiative. Doug will show you how other smart companies saved time and money by following proven methodologies and automating BI processes instead of letting somebody "wing it" with a manual approach.


B2B software vendor leadership. BI implementations, standardization, and consolidation; data warehousing; WebFOCUS; iWay; BI vendors (Cognos, SAP Business Objects/Crystal Reports, Microstrategy, Actuate, Hyperion/Brio, SAS, Tableau Software); ERP; and full SDLC.