Cartographer Project Release Notes

From Krupczak.org

(Redirected from Release Notes)

Jump to: navigation, search

Release 1.6

Release 1.6 will primarily be a bugfix release. It consists of the following components:

Cartographer GUI version 0.60
Agent engine (xmpd) version 0.80
MIB-2 plugin version 1.0
Cartographer plugin version 0.60
Java XMP package version 1.30

What's New in Release 1.6?

Cartographer agent engine added more code to check for and recover from broken sessions
Cartographer plugin Windows Vista and higher properly sets its dynamic port range above 49152 thus resulting in fewer false dependencies
Cartographer agent supports Windows 8
Xmpquery core dumps if it cannot find its certificate (.pem) file
Xmpquery can now output PDUs in XML format for use as input to other tools
Updated cartographerMib.xml for disk reads/writes, system total CPU counters, and virtualSystem MIB objects
Solaris 9 x86 MIB-2 assertions failed with certain IPv6 MIB data; fixed.
Cartographer agent packaging did not correctly identify libgcc.i686 dependency
Cartographer agent DHCP discovery could chop some hostnames due to a buffer that was too small
Cartographer agent systemName in coreMib requires that primary DNS suffix be set properly in Computer properties
Cartographer agent peer scan interval defaults to 15-minutes
Cartographer agent could choke if TCP accept failed
Cartographer agent logfile-discovered dependencies were incorrect if contained IPv6 addresses
Cartographer agent now fully supports IPv6 for XMP sessions
Cartographer agent command-line tools now support IPv6 sessions and command-line args updated to accommodate
Cartographer agent MIB-2 now fully supports IPv6 on all platforms
Cartographer agent cartographer-local.xml now distributed between agents and contains system-specific directives
Cartographer agent Schema definitions for configuration files now published
Cartogrpaher agent autoUpgrade setting in xmpd.xml can now eat values 0, 1, true, false to better match XML boolean base type
Cartographer agent example configuration settings documented on Cartographer Web page
Cartographer agent now exchanges PDUs referencing schema definition rather than DTD
Cartographer agent MIB object cpuTotalWait was incorrectly spelled
Cartographer agent updated install instructions on Web to include RPMs
Cartographer agent updated cartographerMib.xml to specify that endpoint table includes IPv4 and IPv6 addresses
Cartographer agent engine PDU counters not updated consistently
Cartographer agent extendedBoolean unknown value can be -1 or 2
Cartographer agent logfile-discovered dependencies now ensure that arguments do not cause XML parse errors
Cartographer agent logfile-discovered dependencies were not properly substituting $2 argument to actual value
Cartographer agent all MIB files now documented in XML format conforming to a schema definition
This will be the last release of Cartographer that supports Windows XP
Cartographer GUI fixed dependency display for isolated verticies
Cartographer GUI QueryPrune enabled option added to global options dialog
Cartographer GUI added support for matching IP address to hostnames when DNS resolution fails
Cartographer GUI added support for system search by IP address
Cartographer GUI splash screen updated and converted to PNG
Cartographer GUI update agent information now updates description in ComputerSystem
Cartographer GUI added refresh buttons to views and main window
Cartographer GUI periodically calculates graph-edit-distance
Cartographer GUI now supports XMP sessions over IPv6
Cartographer GUI close-window now only exits entire application on last window close
Cartographer GUI now uses GIT for revision control
Schema files now published via http://xmlns.krupczak.org
Cartographer GUI View options now include ability to turn off dependency selection
Cartographer GUI QueryPrune thread now calls statusChangeSystem() to update icons
Cartographer GUI Control-f in main window search bar now does not re-size window
Cartographer GUI graph view updates now performed on EDT
Cartographer GUI various JFrame windows now set window icons
Cartographer GUI fixed exception in event detail viewing
Cartographer GUI supports now supports session read timeouts
Cartographer GUI add last match time to logfile dependency query
Cartographer GUI updated to use JGraphX 1.10.3.1
Cartographer GUI Endpoint View does not have tool tips for edges
Cartographer GUI Endpoint View graph creation does not mirror Dependency View
Cartographer GUI Endpoint view should default to concentric circles layout
Java XMP package now allows MIB object types of boolean and bool
Java XMP package now supports client authentication via SSL certificates
Java XMP package cleaned up XmpListener and XmpSession code
Java XMP package includes support for IPv6 sessions
Java XMP package includes support for query timeouts so sessions do not block indefinitely
Java XMP package updated so all PDUs use protocol schema definition but still support DTD
Java XMP package renamed to lower case xmp

Known Issues in 1.6

Cartographer agent does not yet support new service control architectures on Solaris and Linux
XMP library port to Python is still needed
MIB-2 plugin not yet ported to Solaris 11
Some default installations of 64-bit Linux do not automatically include 32-bit versions of libxml, libz, and libgcc and thus need to be installed by hand. On Redhat/Fedora 64-bit systems, one can add them very simply by executing the following command:

yum install libxml2.i386 libgcc.i386

Some default installations of 64-bit Linux do not automatically include a 32-bit libgcc_s which is required by pthreads_cancel(). If not present, the library can be installed by hand.

yum install libgcc.i386

Cartographer Agent Windows installer can create a second system tray entry on upgrade.

Release 1.5

Release 1.5 is primarily a bugfix release. It consists of the following components:

Cartographer GUI version 0.50
Agent engine (xmpd) version 0.7903
MIB-2 plugin version 0.9603
Cartographer plugin version 0.5006

What's New in Release 1.5?

Cartographer GUI has been ported to the JGraphX graph library (JGraph version 6) and extensively re-worked. Improvements and fixes have been made to the Java/Swing event handling and window drawing/updating. Major architectural changes are in store for future versions.

Cartographer GUI views now update automatically and periodically

Cartographer GUI layouts are not re-created unless explicitly needed. This improvement should cut down on CPU and memory consumption.

Cartographer GUI debug/stderr window now does not forced on top of other windows

Cartographer GUI Fixed handling of reachable status

Cartographer GUI status bars now properly updated via Swing event queue

Cartographer GUI query/prune thread writes its status to the status bar

Cartographer GUI can now set dependency age out interval in minute-granularity

Cartographer plugin includes fixes for IPv6 remote filesystem detection and reachability

Cartographer plugin better works around DNS errors when determining dependency client/server. Many times, systems have forward records that do not match reverse records. Cartographer plugin now better accommodates those situations.

Cartographer plugin win32 router discovery could be fooled by bogus pattern matching of IP addresses

Cartographer plugin includes fixes for IPv6 reachability testing

Cartographer plugin peer contact and reachable times were incorrectly initialized

Cartographer plugin includes detection of newer chronyd discovery

Cartographer plugin now includes ability to configure dependencyScanInterval via cartographer.xml config file. Default is 90-seconds now which reduces Cartographer agent CPU consumption.

Cartographer plugin better detects local IPv6 dependencies

MIB2 plugin now includes IPv6 addresses when communicating with Cartographer plugin

Known Issues in Release 1.5

Cartographer agent does not yet support new service control architectures on Solaris and Linux

XMP library port to Python is still needed

XMP sessions still not IPv6 capable

MIB-2 plugin not yet ported to Solaris 11

Need more IPv6 support in MIB-2 (e.g. IPv6 routers)

Some default installations of 64-bit Linux do not automatically include 32-bit versions of libxml, libz, and libgcc and thus need to be installed by hand. On Redhat/Fedora 64-bit systems, one can add them very simply by executing the following command:

yum install libxml2.i386 libgcc.i386

Some default installations of 64-bit Linux do not automatically include a 32-bit libgcc_s which is required by pthreads_cancel(). If not present, the library can be installed by hand.

yum install libgcc.i386

Dynamic ports, on Windows machines, often start in the registered ports range (1024 through 49151) and therefore can give false dependencies.

Cartographer Agent Windows installer can create a second system tray entry on upgrade.

Release 1.4

Release 1.4 is primarily a bugfix release. It consists of the following components:

Cartographer GUI version 0.36
Agent engine (xmpd) version 0.79
MIB-2 plugin version 0.96
Cartographer plugin version 0.50

Whats New in Release 1.4?

Matching algorithms loosened in order to cut down on the number of duplicate connection-based dependencies (e.g. database and LDAP dependencies). Reducing the number of duplicates also cuts down on the total size of the global graph that must be disseminated among agents and thus it reduces their resource footprint.
Solaris package did not remove cores, and .old files when pkgrm command executed.
Lots of code cleanup in agent engine.
Win32 APPVER set to 5.01 in Makefile.win32.common such that XP is now the minimum Windows kernel and build environment that is supported.
Added kernelSize variable to Cartographer MIB and plugin to indicate whether underlying operating system is 32-bit or 64-bit (and eventually 128-bit?)
Code cleanup with respect to IPv6 hostname resolution
Logfile monitoring table added to Cartographer MIB and plugin. Logfiles can now be monitored for regular expressions. Logfile events not yet implemented as work is still underway on a unified event architecture.
Tool testregex added so that regular expression testing can be conducted against logfiles. This tool uses the same regular expression library that Cartographer uses.
Logfile derived dependencies now supported. That is, Cartographer can discover system and application dependencies by grog'ing through logfiles for regular expressions. Differing regular expressions can be specified for adding and removing dependencies.
Fixed nasty deadlock bug in Cartographer when dealing with virtualness.
Added more internal support for IPv6 including hostname resolution, connection dependencies, socklib code, etc. Sessions are not yet IPv6 capable nor are command-line tools.
Added support IPv6 ICMP echo testing in Cartographer plugin.
Fixed bug in virtualness determination
Version numbers of all components now supported to 4 decimal places
Added support for newer Linux device naming conventions in MIB2 plugin.
Added subgraphlastChange and subgraphLastUpdate variables in Cartographer MIB and plugin. These variables indicate when a particular agent's view of the global graph has changed.
Server and Router views added to Cartographer GUI
View Options now has "Show Servers" which overrides other view settings in Cartographer GUI.
Updated splash screen in Cartographer GUI
Dependency timeout intervals, in Cartographer GUI, now support increased granularity.
Cartographer GUI system tooltips updated to include kernel size if known.

Known Issues in Release 1.4

Same as known issues in 1.3.

Release 1.3

Release 1.3 is primarily a bugfix release. It consists of the following components:

Cartographer GUI version 0.33
Agent engine (xmpd) version 0.78
MIB-2 plugin version 0.95
Cartographer plugin version 0.49

Whats New in Release 1.3?

Cartographer Agent RPM and Solaris packages now available
Additional fields in process table including CPU times, start times, and
Process table I/O counters include disk read and write ops and read and write bytes
Cartographer plugin now tracks sub-graph of global dependency graph and makes it available via MIB object
xmpgetsubgraph tool added to agent distribution
Am I virtual MIB object added to indicate of underlying system is virtual or real
Dependency table additions for availability statistics including create time and running average of response time
Filesystem space percentages MIB object added
Fixed bug in CUPs printer parsing so that differing ports are properly accommodated
MIB-2 IPv4 and IPv6 interface names were identical leading to erroneous polling results
Updated connectionInfo.xml file includes new well-known ports for dependency discovery
coreModule table could cause agent to flap when introducing a new component
Fixed coreModule table race condition that could cause deadlock
DNS forward/reverse mismatches in cases where IP addresses resolve to multiple hostnames
Updated Windows OS versioning info
GUI now has computer system component flag to prevent pruning
GUI system properties dialog displays system classification/type as well as bytes/messages in/out
GUI can now export the global dependency graph in GraphXML format
GUI now has a find system dialog in views
GUI now has view option to display only routers
GUI can now be installed using Windows installer and Linux RPM
GUI now properly updates single-system dependency view
GUI has dependency search and system search dialogs
GUI now uses different icons to indicate system types (e.g. DHCP client, router, email server, firewall, etc.)
GUI now double-checks IP addresses before adding new system in order to prevent duplicate systems
GUI now has more view options

Known Issues in Release 1.3

Some default installations of 64-bit Linux do not automatically include 32-bit versions of libxml, libz, and libgcc and thus need to be installed by hand. On Redhat/Fedora 64-bit systems, one can add them very simply by executing the following command:

yum install libxml2.i386 libgcc.i386

Some default installations of 64-bit Linux do not automatically include a 32-bit libgcc_s which is required by pthreads_cancel(). If not present, the library can be installed by hand.

yum install libgcc.i386

Dynamic ports, on Windows machines, often start in the registered ports range (1024 through 49151) and therefore can give false dependencies.

Cartographer Agent Windows installer can create a second system tray entry on upgrade.

Cartographer GUI dependency age out interval cannot be set less than one hour; in certain high-volume connection environments this can cause excessive amounts of dependencies to be tracked even though they have been aged out at the agent level.

Release 1.2

Release 1.2 is primarily a bugfix release. It consists of the following components:

Cartographer GUI version 0.32
Agent engine (xmpd) version 0.76
MIB-2 plugin version 0.94
Cartographer plugin version 0.47

Whats New in Release 1.2?

Many many bug fixes
libpcre now bundled with all platforms
enhanced Linux start script
Added support for cartographer-local.xml config file for specifying local dependencies
Added better support for Asterisk sip dependencies
Added support for IPv6 hostname resolution
Support for transit dependencies added
Agent engine uname info now matches cartographer plugin
Parsing of cups files enhanced
Cartographer plugin now implements internal graph of dependencies

Release 1.1

Release 1.1 is primarily a bugfix release. It consists of the following components:

Cartographer GUI version 0.30
Agent engine (xmpd) version 0.74
MIB-2 plugin version 0.94
Cartographer plugin version 0.44

Whats New in Release 1.1?

Minor Tweaks and Enhancements

Windows installer for Cartographer agent officially released. It previously had been beta.
Agent support for Windows 64-bit on Vista and higher.
Tested on Windows 7.
Tweaks for Windows Vista and Windows 7.
Added CPU total counters to Cartographer CPU table.
Added system-wide scalar CPU totals.
More tweaks and enhancements for 64-bit Linux kernels.
XML schemas for XMP SMI and protocol are now defined and included in release.
Routing dependency enhancements.
Support for Win2k dropped (really, this is a feature). WinXP and higher are supported.
Cartographer GUI - search fields in main window and debug windows
Cartographer GUI - Addition of refresh button to views
Cartographer GUI - Proper window sizing when querying for scalars and tables
Cartographer GUI - added support for sorting columns in various tabular queries
Cartographer GUI - added system and dependency counters to views
Cartographer GUI - graph traversal algorithms DFS and BFS have been added
Cartographer GUI - graph properties order, size, and connectedness added to system properties

Bug Fixes

Various memory leaks in agent and plugins tracked down using Valgrind and Helgrind.
mib2 - LinkUp and LinkDown Traps would sometimes incorrectly report ifIndex value. ifIndex value is worthless but it is sometimes expected by management software.
mib2 - Include interface name in LinkUp and LinkDown Traps to more easily identify the interface that is changing state.
Cartographer plugin - peer dependency discovery was not properly handling peers that had dependencies to themselves.
xmpd - Update DNS hostname resolution functions to properly call re-entrant functions rather than thread-unsafe versions.
Cartographer plugin - updated to properly call re-entrant functions instead of thread-unsafe versions.
mib2 - ifSpeed improperly set to 0 for IPv6 interfaces.
mib2 - support for (worthless) ifIndex now included for backwards compatibility
restartxmpd.sh - improperly called chmod. Fix to include correct path.
mib2 - ifSpeed improperly set to 0 for tunnel interfaces.
Cartographer plugin - 127.127.1.0 is improperly showing up in dependency tables for local dependencies to NTP.
Cartographer plugin - diskReadKB = diskWriteKB for Solaris and Linux. Fixed typo.
Cartographer plugin - Drive (filesystem) C:\ could be skipped due to incorrect bitmask manipulation
Cartographer GUI - fixes for various Java/Swing multi-threading issues
Cartographer GUI - fixes for session XMP re-establishment
Cartographer GUI - NullPtrException when running concentric circle layout w/o facade
Cartographer GUI - added support for timeout options
Cartographer GUI - double-clicking on tabular values should not make text fields editable

Release 1

Whats New in Release 1?

Everything is "new" in this release. While it is the first publicly available release, the software has been in continuous usage for quite some time (see the different copyright dates in various source files) and is stable.

Why are the version numbers less than one when this release is termed Release 1? Version 1.x will signify a stable API and protocol. Since this is the first publicly available release, we felt it best to gather community feedback prior to codifying a version 1.0.

The first, initial release consists of the following components/versions.

Cartographer GUI version 0.27
Agent engine (xmpd) version 0.72
MIB2 plugin version 0.91
Cartographer plugin version 0.41

Known Issues in Release 1

Some default installations of 64-bit Linux do not automatically include 32-bit versions of libxml, libz, and libgcc and thus need to be installed by hand. On Redhat/Fedora 64-bit systems, one can add them very simply by executing the following command:

yum install libxml2.i386 libgcc.i386

Some default installations of 64-bit Linux do not automatically include a 32-bit libgcc_s which is required by pthreads_cancel(). If not present, the library can be installed by hand.

yum install libgcc.i386

Rare segmentation-fault on UNIX.

New and improved Windows Vista security makes running ntsetup and cartographertray a real chore.

Automatic upgrades sometimes (very rarely) fail because agent engine takes too long to stop and re-start.

Windows use of reserved ports during dynamic binding fools some dependency determination. For example, an application may ask for a dynamically-bound TCP port and be assigned the well-known and/or reserved port of 1812 thus triggering a false Radius dependency.

Dependencies determined via TCP port allocation may be missed of the connections are short-lived.

XML DTDs or Schemas are needed for XMP and MIBs.

IPv6 support is included but still needs more work with respect to DNS.

NAT'ing routers obstruct inward-bound XMP communication.

Self-deployment is still under development but self-upgrading functionality is complete and included in this release.