StreamBase New and Noteworthy

The StreamBase Authoring Guide was updated to include a page to explain how the new TIBCO AMS operator works. See Using the TIBCO AMS Operator.

The LiveView Reserved Word Page now includes the words PIVOT and VALUES in the LiveView Additional Reserved Words section.

The LiveView Authentication and Authorization and Using SSL with LiveView Server pages were reorganized and clarified.

The Decision Table operator now includes an Emit Non-Matching Tuples option. If the option is selected and no matching decision table rules fire, a tuple is emitted. If this option is not selected, tuples are emitted only when a rule fires. One use case is to avoid breaking the tuple flow across the operator when you want a tuple to flow through the Decision Table operator whether there is a matching rule or not.

The OSI PI adapter suite now includes an Event Frames adapter that allows applications to access Event Frames on Asset Framework servers. The OSI PI adapters are described in OSIsoft PI Adapters and their use is demonstrated in OSI PI Adapter Sample.

The general purpose TERR operator was replaced with a new version that has upgraded functionality. The previous TERR operator is still present for compatibility with your existing modules, but its use is now discouraged. The previous TERR operator is now labeled TERR Legacy in the Insert Operator or Adapter dialog. TIBCO recommends upgrading your modules to use the new TERR operator.

This release also provides a new TERR Predict operator, which implements a locked down predict-only instance of TERR functionality. This operator is used to load RDS files and perform predict operations on them.

The TERR operators are described in Using the TERR Operator and Using the TERR Predict Operator. The TERR Sample provides modules that illustrate both new operators.

Four new adapters were added to the WITSML adapter suite. These are:

For information about their use, see Using the WITSML Operators.

StreamBase 7.6.8 introduces the TIBCO StreamBase® Adapter for Apache Kudu suite, which includes five global Java operators:

The Kudu operators are described in Using the Apache Kudu Operators. The Apache Kudu Sample provides modules that illustrate the new operators.

The version of the RFA libraries that support the three adapters for the Thomson Reuters Enterprise Platform for Real-Time was updated to 8.0. The RFA 8.0 API no longer supports RFA 5, so support for that feature set was removed from the adapter suite. See Thomson Reuters Enterprise Platform for Real-Time Subscribing Input Adapter and related pages.

The TIBCO StreamBase® Adapter for Activ Financial includes a new command, listmatch. Using this command lists all available instruments on the feed that match the given search string.

The Web Server Request and Response adapters now include new options to pass to the Jetty server. These include:

For more information regarding these adapters, see Web Server Request Adapter and Web Server Response Adapter.

The TIBCO StreamBase® Output Adapter for TIBCO Spotfire® Automation Services now supports TIBCO Spotfire Server versions 7.5 and later. See Spotfire Automation Services Output Adapter for more information about this adapter, and TIBCO Spotfire® Automation Services Adapter Samples for sample information that demonstrates its use.

The TIBCO StreamBase® Adapter for Bloomberg B-Pipe now supports overrides for reference data requests. See Bloomberg B-Pipe Input Adapter for more information about this adapter and Bloomberg Server API and B-Pipe Adapter Samples for sample information that demonstrates its use.

The TIBCO StreamBase® Operator For H2O Model Evaluator sample is now bundled with H2O library version 3.10.4.1.

The Query operator, when used with JDBC Table data sources, now converts JDBC CLOB values to and from StreamBase strings rather than blobs. CLOB values longer than maxint() characters are truncated to maxint() characters. It is possible, though not likely, that there exist StreamBase applications that would be affected by this change upon migration to 7.6.7. If you encounter any migration issues due to this change, please contact TIBCO Product Support.

An optional JDBC URL field was added to allow for advanced connection strings. Also, the adapter now supports Microsoft SQL Server 2016.

Imbalance Volume was added to the status. Also, a new optional port is available which will output the order imbalance information.

The File Writer and HDFS File Writer adapters are enhanced as follows:

The three adapters for Apache Kafka are enhanced as follows:

The MQTT Client adapter was updated to use the Eclipse Paho Java Client V3 1.1.0 library.

Disconnect exception messages are now included in the Status port message.

The adapter can now connect to a multi-instance queue manager by specifying two hosts in the configuration.

This release includes a new set of operators for the Apache Cassandra database management system. The operators in this suite are implemented as StreamBase global Java operators, as follows:

See Using the Apache Cassandra Operators for a description of each operator. A sample illustrates the use of these adapters, as described in Apache Cassandra Operator Sample.

The following enhancements are available. See Bloomberg B-Pipe Input Adapter.

The consumer adapter can now output a status message when a subscription occurs, which will give the current offset of the topic and partition. Also, the Kafka Consumer adapter documentation has been updated to better reflect the status port messages. See Kafka Consumer Adapter.

The adapter now includes the following enhancements. See Kafka Producer Adapter.

The operator now includes the following enhancement and change. See Using the Decision Table Operator for more information.

The adapter's path variable of the control port schema can now be a string OR list<string>. See HDFS File System Adapter.

The adapter can now output its monitored files and directories when monitoring starts. See File Monitor Input Adapter.

The Developer Edition of TIBCO Enterprise Runtime for R (TERR) bundled with StreamBase is now TERR 4.2.

TERR 4.2 and later is now provisionally supported on Macintosh OS X machines. See the TERR Operator page in the Authoring Guide for the necessary conditions.

The following TIBCO products are now supported on Microsoft Windows 10:

This release adds the ability to specify a separate background color for group title bars than for the group itself. Select a group in the EventFlow canvas to view its Properties view page. This now contains:

You can set default colors by following the Colors and Fonts link at the top of the EventFlow Rendering page in the Studio Preferences dialog.

The File Delimiter property was enhanced to allow the \t string to represent a tab delimiter. For more information, see CSV File Reader Adapter page

Release 7.6.5 adds the following new properties to use when making web requests with the Web Reader Input Adapter:

For more information about their usage, see the Web Reader Input Adapter page.

UMDF 2.0 support was added in release 7.6.1, but was not release-noted at the time. For more information about this adapter, see the BM&FBovespa UMDF Adapter page.

The Kafka Producer and Consumer adapters were enhanced to allow null message values.

Release 7.6.5 deprecates the use of the system.statv2 stream of profiling statistics, which was replaced with system.statv3. However, since TIBCO recommends that all access to profiling data occur through the StreamBaseMonitor API, no customer-visible changes are expected. The raw stat streams are internal only, and TIBCO does not support accessing them directly.

At the same time, the sbmonitor command, which (despite our own recommendation) does use the raw stat stream instead of the monitor API, is also now deprecated. Both the statv2 stream and the sbmonitor command will be removed in a future release.

As of release 7.6.5, the Trading Components Framework and the FX Dealing Accelerator were both removed from the StreamBase package. This also means that the File → Load StreamBase Framework menu option was no longer functional and was removed. The Frameworks book, recently renamed the Accelerators book, was removed from all versions of StreamBase documentation.

You can now find the FX Dealing Accelerator and its documentation on the TIBCO Community site. The Trading Components Framework can now be found using Studio's File → StreamBase Component Exchange menu option. As of this release, that option was updated to be able to load multiple Studio projects for a single selection in the Component Exchange dialog.

The new JPMML Model Evaluator operator enables StreamBase applications to execute numerical models expressed as Java PMML (Predictive Model Markup Language). The JPMML operator is described on Using the JPMML Model Evaluator Operator, and is illustrated in a new sample described on JPMML Operator Sample.

The TERR operator now uses the standard <section> child elements of the <adapter-configuration> element to specify its settings in the sbd.sbconf file. See the operator sample's supplied sbd.sbconf for an example of the new format.

The Decision Table operator now includes the following changes:

The sbc list command now takes arguments of the form operator:operator-type where operator-type is the name of a StreamBase operator as shown in the Palette view. For example, sbc list operator:union shows all Union operators in the currently running application.

You can spell or abbreviate the operator-type argument in reasonable ways, and can use any letter case. For example, for the Module Reference type, you can enter: module-ref, moduleref, Module-Reference, modulereference, and so on.

However, the Decision Table (DT) operator is not handled directly by sbc list operator. That is, no response is defined for sbc list operator:decision-table. However, you can locate the DT operators in a running application in two steps as follows: Since DT operators are implemented internally as Module References, first get a list of all Module References in your application. Second, run sbc describe on the likely candidates. For example, for the Decision Table operator named analyzeCredit:

> sbc list module-ref
module-ref    calcInterest
module-ref    analyzeCredit
> sbc describe analyzeCredit
<module-reference name="analyzeCredit" refers-to="decision-table"/>

The refers-to attribute is newly available in this release to distinguish Decision Table operators from other Module Reference operators in a large application.

For further information, see the sbc command page of the Reference Guide.

The HDFS suite of adapters includes the following changes:

On all platforms, the 64-bit Oracle JDK version bundled with StreamBase for private use by StreamBase and Live Datamart applications is now 1.8.0_u91.

The embedded JDK is used to launch StreamBase Server, StreamBase Studio, LiveView Server, and all StreamBase and Live Datamart applications. As before, you can override this installed default to use a different supported JDK, as described in Using an External JDK.

The Java Client Libraries for StreamBase and LiveView are fully compatible with Java 7, but we recommend using Oracle Java 8, preferably 1.8.0_u91 or later, to compile and run your own client applications, custom function, custom adapters, and monitoring applications. The Java Client Libraries themselves are compiled with target set to Java 1.7 to maintain compatibility.

As before, TIBCO supports and recommends a customer-installed instance of Azul Zing for deployments of TIBCO LiveView servers on Linux x86_64 platforms when very large heap sizes are required. Contact Azul Systems to obtain and license Zing for LiveView. When Zing is installed in its default location, LiveView Server detects and launches with it by default. TIBCO LiveView servers support Azul Zing versions that correspond to Oracle JDK 8 versions.

As of this release, the state of the Allow loading deprecated Global Operators/Adapters Preferences setting is now enabled by default. This prevents customer EventFlow applications from showing errors when imported into Studio 7.6.3 or later after we deprecate a Global Java Operator or Adapter. Change the Preference setting to restore the recent behavior.

Effective with TIBCO StreamBase® 7.6.3 and TIBCO® Live Datamart 2.1.3, both products, when installed on Linux or Windows, include a copy of TIBCO® Enterprise Runtime for R Developer Edition. See the Licensing Considerations page for details on the license terms under which TERR is included.

Release 2.5.1 of the TIBCO StreamBase® Add-in for Microsoft Excel was updated to support the authoring of rules files for use with the Decision Table operator described next. The StreamBase Excel Add-in is licensed separately from TIBCO StreamBase, and has a separate download and installation procedure, and separate documentation

StreamBase 7.6.3 includes a new Decision Table operator in the EventFlow Editor's Palette view. Decision tables provide a way to express a complex set of business rules as a table of conditions that apply to incoming tuple fields, with one or more specified actions for each row of conditions. By default, all rows of the table are evaluated against each incoming tuple, with an option to stop evaluation at the first matching row.

Decision table files can be authored in StreamBase Studio by means of the new Decision Table Editor and its companion Table Analyzer. However, decision table files can also be authored by non-technical users by means of the StreamBase Add-in for Microsoft Excel, described above. Decision table files can be downloaded from a running StreamBase Server into Excel, edited there, and uploaded back to the server to supplement or modify a set of running business rules.

StreamBase’s Decision Table feature is based on the Decision Table feature of TIBCO BusinessEvents®. The StreamBase operator can import and use rules files authored in and saved from BusinessEvents in both its native .rulefunctionimpl file format and as Excel files exported from BusinessEvents.

The StreamBase Decision Table feature is described in Using Decision Tables, while the use of the operator itself is described in Using the Decision Table Operator. There is a new Decision Table sample described in Decision Table Operator Sample.

The new Spark MLlib Model Evaluator operator enables StreamBase applications to execute numerical models generated with Apache Spark MLlib. The Spark MLlib operator is described on Using the Spark MLlib Model Evaluator Operator, and is illustrated in a new sample described on Spark Operator Sample.

The new H2O Model Evaluator operator enables StreamBase applications to execute numerical models generated with the H2O Fast Scalable Machine Learning package. The H2O operator is described on Using the H2O Model Evaluator Operator, and is illustrated in a new sample described on H2O Operator Sample.

The TERR operator was enhanced as follows:

TIBCO BusinessEvents® release 5.3 and later has a StreamBase channel, which allows BusinessEvents to send and receive messages from a StreamBase application's input and output streams. Refer to BusinessEvents documentation for release 5.3 or later for instructions on using this feature.

This StreamBase release 7.6.3 includes a new sample described on BusinessEvents Fraud Detection that illustrates the StreamBase half of the BusinessEvents StreamBase Channel feature. This StreamBase sample provides half of a full working sample, with the other half provided in BusinessEvent 5.3. You need both sample halves to successfully run the full sample.

This release includes a new suite of adapters for connecting to RabbitMQ servers. The following new adapters are available:

The adapters are illustrated in a set of new samples described on Rabbit Adapter Samples.

This release includes a new adapter for connecting with TIBCO® LogLogic Unity, and allows a StreamBase application to query a LogLogic Unity server.

For more information see LogLogic Unity Query Input Adapter. The adapter's functionality is illustrated in a new sample described on LogLogic Unity Sample.

The TIBCO suite of HDFS adapters now includes the TIBCO StreamBase® File System Adapter for Apache HDFS. HDFS is the well-known acronym for the Hadoop Distributed File System. The new adapter performs various operations on the HDFS file system determined by the command value of its input tuple. For more information about this adapter, see HDFS File System Adapter.

The OSIsoft PI Adapter suite now includes two additional adapters:

The following updates were made for the existing adapters:

The OSI PI adapters are described on, see OSIsoft PI Adapters and are illustrated in a sample described on OSIPI Sample.

This release includes a new adapter for connecting to a WITSML data store, and to allow read, write, and delete operations on the log, well, and wellbore data types. The WITSML connectivity solution is intended for the oil and gas industry to retrieve and send well data between well operators, service companies, and regulatory agencies. The TIBCO WITSML connectivity solution is implemented as a suite of ten global Java operators. The WITSML operators are described on Using the TIBCO WITSML Operators, and are illustrated in a set of new samples described on WITSML Adapter Samples.

The Apache Kafka Consumer, Producer, and Admin adapters were updated as follows:

TIBCO Spotfire® Automation Services release 7.5 changed the way clients connect to the Spotfire server from using the SOAP protocol to using the REST protocol. The Spotfire Automation Services Output Adapter was updated to handle either protocol, adding a new check box property Previous Version Compatibility. When this property is cleared, the adapter connects using REST; when selected, the adapter uses SOAP.

The Web Reader adapter has a new option, Unescape HTML results, to disable unescaping of the received text. See the related adapter page for more information.

The WebRequest Adapter no longer needs to request data location properties because URL Parameters and the Body field, if available, are now selected by default. See the related adapter page for more information.

XML Namespaces can now be added when converting a tuple to XML.

The ActiveSpaces suite of operators was updated as follows:

For more information see Using the TIBCO ActiveSpaces Operators

On all platforms, the 64-bit Oracle JDK version bundled with StreamBase for private use by StreamBase and Live Datamart applications is now 1.8.0_u73.

The embedded JDK is used to launch StreamBase Server, StreamBase Studio, LiveView Server, and all StreamBase and Live Datamart applications. As before, you can override this installed default to use a different supported JDK, as described in Using an External JDK.

The Java Client Libraries for StreamBase and LiveView are fully compatible with Java 7, but we recommend using Oracle Java 8, preferably 1.8.0_u73 or later, to compile and run your own client applications, custom function, custom adapters, and monitoring applications. The Java Client Libraries themselves are compiled with target set to Java 1.7 to maintain compatibility.

As before, TIBCO supports and recommends a customer-installed instance of Azul Zing for deployments of TIBCO LiveView servers on Linux x86_64 platforms when very large heap sizes are required. Contact Azul Systems to obtain and license Zing for LiveView. When Zing is installed in its default location, LiveView Server detects and launches with it by default. TIBCO LiveView servers support Azul Zing versions that correspond to Oracle JDK 8 versions.

The .NET Client API in this release adds Tuple.CreateWritableTuple(), which returns a copy of the current tuple that is guaranteed to be writable.

The TIBCO StreamBase adapter solution for TIBCO FTL^® was enhanced with four new operators that provide support for the FTL Map operation feature that was added to TIBCO FTL in its release 4.2 and later. These operators allow a StreamBase application to perform various operations on FTL maps, including getting and setting messages, iterating through a map's messages, and removing messages from a map. The four FTL Map operators are described on TIBCO FTL Map Adapters in the Adapters Guide. The new operators are illustrated in a new sample added to the existing TIBCO FTL samples described in the Samples Guide.

ActiveSpaces operators that provide a status port were updated to provide better feedback when a connection is lost. The operators now include a Connect On Startup adapter property (set to true by default to preserve existing functionality). If set to False, the node does not try to connect to the Metaspace. Instead, it relies on whatever other nodes connecting to the same space to establish the connection.

Any ActiveSpaces operator with a status port now emits status tuples on detecting any ActiveSpaces state change (such as INITIAL to READY), and on detecting any member joining or leaving the space.

The TERR Operator was updated to support an optional command input port as well as a data input port. The command port supports a single command string, reset, which causes the current TERR instance to be stopped and restarted.

The operator now supports specifying whether the script entry to monitor is a directory or file. If you specify a directory, only files with the .RData extensions (with that exact spelling) are monitored; other file types in the specified directory that change, are added, or deleted are ignored.

The operator's dynamic and static modes of operation were updated and clarified. For details on these and the above changes, see Using the TERR Operator in the Authoring Guide.

The TIBCO StreamBase® Input Adapter for UDP has a new property to specify the maximum packet size. Both the UDP Input Adapter and the Output Adapter for UDP now have the ability to select between unicast and multicast modes.

The ResourceFilePropertyDescriptor class now allows an operator's Properties view, when prompting for a resource, to select a directory as well as a file.

In previous releases, on any Mac with OS X Yosemite or later, double-clicking one of the DMG distribution files that contains StreamBase plus Live Datamart, or LiveView Desktop, could start a spinning beach ball timeout period that could last for many minutes. An alternate installation method was described in the Installation Guide.

Starting with releases 7.5.5 and 7.6.1, TIBCO StreamBase DMG files now have a workaround for the Apple bug that was creating this situation. Thus, this issue is now completely resolved, and no longer requires the alternate installation method.

In previous releases, the last line of the Aggregate operator's Edit Dimension dialog, when selecting a Predicate type dimension, was: Evaluate all Emit and Close predicates before adding the new tuple to the window. While this description was technically correct, and the dialog was and is behaving as designed, the wording of this check box's label was causing confusion. As of this release, the label for the final check box in that dialog is now: Do not include the current tuple in the output of an aggregate window when emitted.

A new keyboard shortcut, A A, is available to open the Adapters, Global Operators dialog over the EventFlow Editor canvas.

The replaceelement() function in the expression language was extended with two new syntax forms that let you specify an update function or a predicate function instead of an index value for locating the list elements to be replaced.

The EventFlow Editor's Annotations tab gained a new check box in the Module Annotations section in release 7.6.0. As of 7.6.1, that check box's label now reads Constants and dynamic variables in this module will be visible to any module referenced inside it. This change adds dynamic variables to the support for inherting constants that was added in 7.6.0.

The default state of this check box is cleared. In this state, constants and dynamic variables defined on the Definitions tab have scope only for this module, and can override only parameters defined in this module. With the check box selected, constants and dynamic variables defined in an outer module can override parameters defined in inner modules.

Customers who use the profiling capabilities of StreamBase are aware that they connect to a system stream named system.statv2. Starting with this release, there is a new profiling stream available, system.statv3. However, the existing statv2 stream is still the default, so no behavior changes are required. By default, all current profiling applications are expected to continue working normally.

For those who wish to experiment with the new statistics stream, you can expect around a ten times improvement in network bandwidth usage, especially with large Live Datamart projects. This improvement comes at the expense of incompatible statistics output: the new stream does not emit human-readable statistics like before. To interpret the new stream, you must write a monitoring application using the StreamBaseMonitor API for either Java or .NET. You can configure StreamBase to emit statistics on the statv3 stream by setting the Java system property streambase.appgen.stats.schema.version=3 or the environment variable STREAMBASE_APPGEN_STATS_SCHEMA_VERSION=3.

This release includes a new set of adapters for the Apache Kafka publish-subscribe message broker system, in which messaging is implemented as a distributed commit log. The adapters in this suite are implemented as StreamBase global Java operators, as follows:

A sample illustrates the use of these adapters, as described in Apache Kafka Adapter Samples.

The TERR adapter was updated to support a new mode of operation where, rather than doing text substitution of variables into your TERR script, the input variables are directly inserted into the TERR environment where they can be accessed by the TERR script. This is expected to increase performance for large input scripts. The original method is still available in the adapter.

The Toronto Broadcast Feed Adapter was updated to support 24-digit timestamps in STAMP feeds. The adapter now accepts either 17-digit or 24-digit STAMP-format timestamps.

The StreamBase Feed Simulation adapter was extended to accept a file name as an optional third argument on its control port. This allows you to apply that adapter's feed simulation to more than one file, changeable at runtime. The specified file must exist, and it must match the same output schema as the file currently running, and must have access to all resources required.

The Web Server Response Adapter was updated with the ability to add default HTTP headers to the response. These default headers are applied to each HTTP response, but if the input tuple contains HTTP headers, they override the defaults.

On all platforms, the 64-bit Oracle JDK version bundled with StreamBase for private use by StreamBase and Live Datamart applications is now 1.8.0_u65. JDK 8 is required to run StreamBase Server and StreamBase Studio.

The embedded JDK is used to launch StreamBase Server, StreamBase Studio, LiveView Server, and all StreamBase and Live Datamart applications. As before, you can override this installed default to use a different supported JDK, as described in Using an External JDK.

The Java Client Libraries for StreamBase and LiveView are fully compatible with Java 7, but we recommend using Oracle Java 8, preferably 1.8.0_u65 or later, to compile and run your own client applications, custom functions, custom adapters, and monitoring applications. The Java Client Libraries themselves are compiled with target set to Java 1.7 to maintain compatibility.

As before, TIBCO supports and recommends a customer-installed instance of Azul Zing for deployments of TIBCO LiveView servers on Linux x86_64 platforms when very large heap sizes are required. Contact Azul Systems to obtain and license Zing for LiveView. When Zing is installed in its default location, LiveView Server detects and launches with it by default. TIBCO LiveView servers support Azul Zing versions that correspond to Oracle JDK 8 versions.

In the StreamBaseMonitor API, the OperatorInfo#getPercentUsage method was changed to return the exponentially weighted moving average of the current CPU usage. This brings the API in line with the sbmonitor command line tool, which always reported EWMA.

The Profiling page in the StreamBase Administration Guide was updated to discuss statistics emitted by the sbprofile command for input and output streams.

TIBCO Live Datamart 2.1 is automatically installed as part of TIBCO StreamBase® 7.6. TIBCO StreamBase and TIBCO Live Datamart are separately licensed, as described on License Considerations. However, you no longer need to download and run a separate installer to access LiveView features.

For further details on the New and Updated features of TIBCO Live Datamart, see the separate New and Noteworthy for the Live Datamart product family.

The TIBCO StreamBase CEP Connectivity Package contained several premium adapters that have separate licensing concerns, and are not included in the base TIBCO StreamBase installation. If you licensed any of these adapters, install the StreamBase Connectivity Package from the TIBCO download site.

The contents of this package are subject to change from release to release. Starting with releases 7.5.5 and 7.6.0, the following adapter is no longer part of either the Connectivity Package or the TIBCO StreamBase base kit: