Planet OpenNMS

December 08, 2021

December 2021 Releases – Horizon 29.0.2, Meridians 2021.1.7, 2020.1.15, 2019.1.26

In December, we released updates to all OpenNMS Meridian versions under active support, as well as Horizon 29.

Horizon 29.0.2

Release 29.0.2 contains a fix for a Jetty CVE, plus a number of bug fixes and small enhancements, including changes to user auth, Twin API, VMware, and running as non-root.

For a high-level overview of what has changed in Horizon 29, see What’s New in OpenNMS Horizon 29.

The codename for Horizon 29.0.2 is Satanic Nightjar.

Meridian Point Releases

Meridian 2019.1.26 contains a fix for a Jetty CVE, and an update to fix a bug in user auth changes.

Meridian 2020.1.15 added some SNMP auth related fixes on top of 2019's changes.

Meridian 2021.1.7 added doc updates, auth fixes, and Trapd improvements on top of 2020's updates.

For a list of changes, see the release notes:

by RangerRick at December 08, 2021 08:15 PM

December 06, 2021

OpenNMS On the Horizon – Config API, OIA, VMware, Twin API, Collectd, Enlinkd, Karaf, Flows, BMP, JAAS, Sentinel, FeatherDS, Vue, Geomaps, Helm

Since last time, we worked on config management and validation, OIA, VMware collection, Twin API tracing, documentation, Collectd, IPC, Enlinkd, Karaf, flow thresholding, Pollerd, router config backup, discovery exclude-url, BMP telemetry RRDs, JAAS and Setinel, FeatherDS UI updates, Vue geomaps, smoke tests, and Helm.

Github Project Updates

Internals, APIs, and Documentation
  • Freddy did some cleanup and cosolidation in the config validation and marshalling code.
  • Jesse worked on some OIA API improvements, including adding health check support.
  • Christian fixed some VMware datacollection config issues.
  • Chandra did more work on tracing support for the Twin API.
  • Stefan fixed an issue with the node/interface cache.
  • Jesse fixed a race condition in eventconf reloading.
  • Bonnie and Ronny updated some BMP, developer, flow, and SNMP datacollection docs.
  • Yang did more work on Collectd refactoring improvements.
  • Tikayat, Pushkar, and Upendra worked on config management support for SNMP, Trapd, WMI, and XMP.
  • Chandra worked on setting up some default IPC config.
  • Patrick continued his work on integrating Karaf and the config API.
  • Stefan worked on some performance improvements to Enlinkd.
  • Christian and Dustin worked on flow thresholding support.
  • Stefan worked around a bug where scheduling in Pollerd could still be referencing deleted services.
  • Dustin worked on TFTP integration for router configs.
  • Alberto worked on exclude-url support in the discovery config.
  • Upendra worked on some DAO ITs for the config management API.
  • Ronny added a default RRD config for BMP telemetry.
  • Mark Bordelon worked on some PoC code for jaas authentication in Sentinel.
Web, ReST, UI, and Helm
  • Mike did more Feather updates to the UI.
  • Jane and Mike worked on some fixes in the new geomap.
  • Shankar worked on some schema REST tests.
  • Stefan updated Helm to not use legacy (Angular) promises.
  • Stefan made it possible to use multiple queries in the Helm flow datasource.
  • Makarand updated a bunch of UI code to use feather components.
  • Alberto updated the requisitions to remember which node layout you're using.
  • I worked on some OpenNMS.js dependency updates.
  • Stefan added support to the query "hide" flag in Helm for flows.
Contributors

Thanks to the following contributors for committing changes since last OOH:

  • Alberto Ramos
  • Benjamin Reed
  • Bonnie Robinson
  • Chandra Gorantla
  • Christian Pape
  • Dustin Frisch
  • Freddy Chu
  • Jane Hou
  • Jesse White
  • Makarand Patil
  • Mark Bordelon
  • Mark Mahacek
  • Mike Rose
  • Patrick Schweizer
  • Pushkar Suthar
  • Ronny Trommer
  • Shankar Suman
  • Stefan Wachter
  • Tikayat Mohanta
  • Upendra Guggilam
  • Yang Li
  • Zoë Knox

Release Roadmap

Upcoming December Releases

OpenNMS is on a monthly release schedule, with releases happening on the second Wednesday of the month.

The next OpenNMS release day is December 8th, 2021.

We currently expect minor updates to Horizon 29 and all supported Meridian releases.

Next Horizon: 30 (Q2 2022)

The next major Horizon release will be Horizon 30.

Horizon 30 is currently expected to have the following features:

  • the start of a new Vue-based UI using the Feather Design System
  • thresholding support for Flow data
  • support for running OIA plugins on Minion and Sentinel
  • support for backing up router configuration files
Next Meridian: 2022 (Q1 2022)

The current expectation is that we will release Meridian 2022 in Q1 of next year. It will be based on Horizon 29 plus any bug fixes that happen between November and the Meridian release.

Disclaimer

Note that this is just based on current plans; dates, features, and releases can change or slip depending on how development goes.

The statements contained herein may contain certain forward-looking statements relating to The OpenNMS Group that are based on the beliefs of the Group’s management as well as assumptions made by and information currently available to the Group’s management. These forward-looking statements are, by their nature, subject to significant risks and uncertainties.

...We apologize for the excessive disclaimers. Those responsible have been sacked.

Mynd you, møøse bites Kan be pretti nasti...

We apologise again for the fault in the disclaimers. Those responsible for sacking the people who have just been sacked have been sacked.

Until Next Time…

If there’s anything you’d like me to talk about in a future OOH, or you just have a comment or criticism you’d like to share, don’t hesitate to say hi.

- Ben

Resolved Issues Since Last OOH

  • NMS-12992: Update labelling in Configure Discover screen
  • NMS-13212: Vertical/Horizontal Layout Choice Not Persisting
  • NMS-13421: BMP monitoring documentation diagram update
  • NMS-13508: Node cache gets out of sync with database
  • NMS-13579: Link to release notes in web Help / About needs updating
  • NMS-13650: Tracing support for twin communication
  • NMS-13659: Minion /etc/sysconfig/minion file refers to Sentinel
  • NMS-13685: Document how to install from source
  • NMS-13689: Deprecate wiki to public, make internal only
  • NMS-13690: Make Wiki internal only
  • NMS-13709: Flow Thresholds: Scheduling for data collection & thresholding
  • NMS-13731: Twin logs doesn't appear in ipc.log
  • NMS-13739: Add OIA plugin support for Minion
  • NMS-13765: Optionally include a table of event parameters on the event detail page
  • NMS-13772: Web-based file editor for $OPENNMS_HOME/etc/
  • NMS-13779: Remove link to wiki from the landing page
  • NMS-13780: Add support for VMware 7.0.3 performance data collection
  • NMS-13781: Uncatched exception when importing a VMware virtual machine without an IP interface
  • NMS-13787: OIA event configuration extensions do not work reliably
  • NMS-13788: opennms-webapp-hawtio %post chown errors
  • NMS-13798: Update FeatherDS, replace LightDark icon, replace sidebar with navigation rail

by RangerRick at December 06, 2021 10:47 PM

November 29, 2021

OpenNMS On the Horizon – Docs, Karaf, Config Management, Twin API, Maven, VMware, Flows, Thresholding, Collectd, Enlinkd, OIA, Minion, FeatherDS UI, Geomap, REST

Since last time, we worked on docs, Karaf support and config migration in the config management API, the Twin API, Maven component mapping, integration test fixes, VMware support, flow thresholding, collector and Enlinkd improvements, OIA on the Minion, file editing in the new UI, the Vue geomap, requisition editing, and REST APIs.

Github Project Updates

Internals, APIs, and Documentation
  • Mark worked on daemon config docs.
  • Patrick did more work on Karaf internal support for config stored in the CM API.
  • Chandra continued his changes to add tracing support to the Twin API.
  • Pushkar, Dmitri, and Upendra worked on migrating the JMX, SNMP, Trapd, WMI, and XMP configs to the CM API.
  • Bonnie worked on more migration of docs from the wiki.
  • Freddy did more work on validation/mapping in the CM API.
  • Jerry and Jesse did more work on a tool for mapping our Maven components.
  • Tikayat worked on integration test changes related to the CM API.
  • Shankar wrapped up some VMware integration updates.
  • Dustin worked on thresholding for flow data.
  • Marcel worked on some updates to the asset topology provider docs.
  • Yang Li worked on some improvements to the collector engine.
  • David Schlenk contributed a fix for role and user changes.
  • Stefan worked on some performance improvements to Enlinkd queries.
  • Ronny added support for collecting from VMware 7.x.
  • Bonnie worked on some BMP monitoring and flow doc updates.
  • Stefan continued to work on cleaning up Karaf bundle auto-refresh behavior.
  • Ronny updated the developer docs to include instructions on running PostgreSQL in a container.
  • Jesse worked on adding support for running OIA plugins on the Minion.
Web, ReST, UI, and Helm
  • Mike did more work on web-based file editing as well as some refactoring in the new UI.
  • Jane worked on some cleanup of the new Vue geomap code.
  • Farid and Jane continued to work on wrapping up alarm marker color updates in the geomap.
  • Tripti worked on dependency updates in the new UI.
  • Jesse did some build updates to the new UI.
  • Alberto worked on a fix to remember layout preferences in the requisition editor.
  • Shankar made some unit tests for the REST API for the CM backend.
Contributors

Thanks to the following contributors for committing changes since last OOH:

  • Alberto Ramos
  • Benjamin Reed
  • Bonnie Robinson
  • Chandra Gorantla
  • David Schlenk
  • Dmitri Herdt
  • Dustin Frisch
  • Farid Ahmad
  • Freddy Chu
  • Jane Hou
  • Jerry Beuree
  • Jesse White
  • Marcel Fuhrmann
  • Mark Mahacek
  • Mike Rose
  • Patrick Schweizer
  • Pushkar Suthar
  • Ronny Trommer
  • Shankar Suman
  • Stefan Wachter
  • Tikayat Mohanta
  • Tripti Bansal
  • Upendra Guggilam
  • Yang Li

The Wiki is Dead, Long Live the (Discourse) Wiki

As many of you know, the OpenNMS wiki has long been a bit of a mess.
A bunch of folks have been doing the hard work of migrating the useful bits to the Discourse.

At this point, the value of keeping the wiki around is lower than the value of closing it down, so we are going to finally do just that, on December 1st.

We'll keep an internal copy around in case we need to migrate anything else that got missed, so if you can think of something specific that really needs moving over, let us know.

The new location for general (non-versioned) configuration tips and other useful stuff in the Knowledge Base category of the OpenNMS Discourse.

Knowledge Base.

Discourse.

Tell your friends.

Release Roadmap

Upcoming December Releases

OpenNMS is on a monthly release schedule, with releases happening on the second Wednesday of the month.

The next OpenNMS release day is December 8th, 2021.

We currently expect a minor update to Horizon 29.

Next Horizon: 30 (Q2 2022)

The next major Horizon release will be Horizon 30.

Horizon 30 is currently expected to have the following features:

  • the start of a new Vue-based UI using the Feather Design System
  • thresholding support for Flow data
  • support for running OIA plugins on Minion and Sentinel
  • support for backing up router configuration files
Next Meridian: 2022 (Q1 2022)

The current expectation is that we will release Meridian 2022 in Q1 of next year. It will be based on Horizon 29 plus any bug fixes that happen between November and the Meridian release.

Disclaimer

Note that this is just based on current plans; dates, features, and releases can change or slip depending on how development goes.

The statements contained herein may contain certain forward-looking statements relating to The OpenNMS Group that are based on the beliefs of the Group’s management as well as assumptions made by and information currently available to the Group’s management. These forward-looking statements are, by their nature, subject to significant risks and uncertainties.

...We apologize for the excessive disclaimers. Those responsible have been sacked.

Mynd you, møøse bites Kan be pretti nasti...

We apologise again for the fault in the disclaimers. Those responsible for sacking the people who have just been sacked have been sacked.

Until Next Time…

If there’s anything you’d like me to talk about in a future OOH, or you just have a comment or criticism you’d like to share, don’t hesitate to say hi.

- Ben

Resolved Issues Since Last OOH

  • HELM-299: Support multiple flow queries per panel
  • NMS-8769: New created user cannot login
  • NMS-13532: Migrate ResourceTypes from wiki to docs
  • NMS-13538: SNMP Asset Provisioning Adapter missing docs
  • NMS-13561: Geo map: Display different colors on map base on alarm severity
  • NMS-13605: Geo-Map: make Alarms | Nodes tab more apparent
  • NMS-13632: geo-map: rename "LAST CAPABILITIES SCAN", "Apply Filter" and "Submit"
  • NMS-13665: Geo-Map: add Feather UI to geo-map project
  • NMS-13706: Flow Thresholds: Proof-of-concept implementation (in-memory approach)
  • NMS-13749: Improve Related Events box in Alarm detail page
  • NMS-13761: Authorization changes not taking immediate effect
  • NMS-13771: Flow Threshold: Create session by Interface Id
  • NMS-13774: VMware sessions not correctly closed in all cases

by RangerRick at November 29, 2021 07:16 PM

November 22, 2021

OpenNMS On the Horizon – Config API, Docs, Twin API, SNMP Metadata, Maven, Zabbix, Sentinel, JAXB, Karaf, Collectd, Alarms, ALEC, Vue, Geomap, FeatherDS

Since last time, we worked on migrating configs to the database, documentation improvements, the Twin API, SNMP metadata, Maven, the Zabbix adapter, alarms in Sentinel, JAXB processing, Karaf, Collectd, Alarmd and ALEC collections, the Vue geomap, and the new FeatherDS UI.

Github Project Updates

Internals, APIs, and Documentation
  • Dmitri, Pushkar, Shankar, and Upendra worked on loading JMX, notification, Trapd, VMware, WMI, and XMP configurations into the database.
  • Mark and Ronny worked on some documentation updates and improvements,
    including building OpenNMS from source and Kafka producer config.
  • Chandra fixed some issues in Twin API communication found in Horizon 29.
  • Dustin finished adding some retry logic to the Twin API.
  • I fixed a bug in the snmp-metadata-adapter-configuration.xml processing so that it would
    accept multiple <config> blocks.
  • Jesse did some work classifying our Maven build structure.
  • I worked on improving some smoke test flappers.
  • Yang Li did some more work on the Zabbix adapter.
  • Mark Bordelon did more work on alarm-processing support in Sentinel.
  • Patrick did more work on using the new config management API for handling Karaf config.
  • Christian enhanced hardware discovery events to include some extra metadata metadata.
  • Freddy worked on converting some JAXB code to use EclipseLink rather than MOXY.
  • Stefan did some more work on Karaf bundle refresh.
  • I fixed some non-root bugs found in Horizon 29.0.0.
  • Yang Li worked on some threading improvements to Collectd.
  • Marcel worked on refactoring some reporting and topology provider docs.
  • Chandra worked on adding tracing to the Twin API.
  • Dino added some new collections and graphs for Alarmd and ALEC.
  • Bonnie worked on migrating some ResourceType documentation from the wiki to the docs.
Web, ReST, UI, and Helm
  • Jane worked on layout updates to the new Vue-based geomap.
  • Mike and Jesse continued to work on file editing in the new UI.
  • Tripti did more work on the new provisioning config UI and updating some code to use FeatherDS.
  • Jane and Farid worked on alarm coloring in the Vue geomap.
Contributors

Thanks to the following contributors for committing changes since last OOH:

  • Benjamin Reed
  • Bonnie Robinson
  • Chandra Gorantla
  • Christian Pape
  • Dino Yancey
  • Dmitri Herdt
  • Dustin Frisch
  • Freddy Chu
  • Jane Hou
  • Jerry Beuree
  • Jesse White
  • Marcel Fuhrmann
  • Mark Bordelon
  • Mark Mahacek
  • Mike Rose
  • Patrick Schweizer
  • Pushkar Suthar
  • Ronny Trommer
  • Shankar Suman
  • Stefan Wachter
  • Tikayat Mohanta
  • Tripti Bansal
  • Upendra Guggilam
  • Yang Li

The Wiki is Dead, Long Live the (Discourse) Wiki

As many of you know, the OpenNMS wiki has long been a bit of a mess.
A bunch of folks have been doing the hard work of migrating the useful bits to the Discourse.

At this point, the value of keeping the wiki around is lower than the value of closing it down, so we are going to finally do just that, on December 1st.

We'll keep an internal copy around in case we need to migrate anything else that got missed, so if you can think of something specific that really needs moving over, let us know.

The new location for general (non-versioned) configuration tips and other useful stuff in the Knowledge Base category of the OpenNMS Discourse.

Knowledge Base.

Discourse.

Tell your friends.

Release Roadmap

Completed Off-schedule Release: Horizon 29.0.1

Horizon 29.0.1 is a quick release outside of the normal schedule to address some bugs found in 29.0.0 mostly related to running as non-root, and Minion communication.

For a high-level overview of what has changed in Horizon 29, see What’s New in OpenNMS Horizon 29.

The codename for Horizon 29.0.1 is Emu.

Bug
  • Kafka topics should start with OpenNMS Instance ID for Twin (Issue NMS-13733)
  • opennms.spec file tries to find out if gid 1000 is used but doesn’t actually check hat (Issue NMS-13734)
  • Events from Hardware Inventory Provisioning Adapter and SNMP Metadata Provisioning Adapter cannot be distinguished (Issue NMS-13735)
  • Upgrade to 29: fix-permissions script fails changing ownership (Issue NMS-13736)
  • Minion user not authorized to read from topic OpenNMS.Twin.Sink (Issue NMS-13742)
  • opennms-plugin-provisioning-wsman-asset missing on Debian (Issue NMS-13747)
  • Upgrade to 29: "$RUNAS is not set" (Issue NMS-13748)
  • SNMP Metadata XSD does not allow multiple <config> elements (Issue NMS-13752)
Enhancement
  • Support multiple auth params for same SNMPV3 username (Issue NMS-13490)
  • Add retry for RPC calls (Issue NMS-13652)
  • Migrate Discovery settings from wiki into docs (Issue NMS-13730)

Upcoming December Releases

OpenNMS is on a monthly release schedule, with releases happening on the second Wednesday of the month.

The next OpenNMS release day is December 8th, 2021.

We currently expect a minor update to Horizon 29.

Next Horizon: 30 (Q2 2022)

The next major Horizon release will be Horizon 30.

Horizon 30 is currently expected to have the following features:

  • the start of a new Vue-based UI using the Feather Design System
  • thresholding support for Flow data
  • support for running OIA plugins on Minion and Sentinel
  • support for backing up router configuration files
Next Meridian: 2022 (Q1 2022)

The current expectation is that we will release Meridian 2022 in Q1 of next year. It will be based on Horizon 29 plus any bug fixes that happen between November and the Meridian release.

Disclaimer

Note that this is just based on current plans; dates, features, and releases can change or slip depending on how development goes.

The statements contained herein may contain certain forward-looking statements relating to The OpenNMS Group that are based on the beliefs of the Group’s management as well as assumptions made by and information currently available to the Group’s management. These forward-looking statements are, by their nature, subject to significant risks and uncertainties.

...We apologize for the excessive disclaimers. Those responsible have been sacked.

Mynd you, møøse bites Kan be pretti nasti...

We apologise again for the fault in the disclaimers. Those responsible for sacking the people who have just been sacked have been sacked.

Until Next Time…

If there’s anything you’d like me to talk about in a future OOH, or you just have a comment or criticism you’d like to share, don’t hesitate to say hi.

- Ben

Resolved Issues Since Last OOH

  • NMS-10536: Add a breaking change entry for telemetryd-configuration in the release notes
  • NMS-11769: Scheduled Weekly Outages Missing 'Day of the Week'
  • NMS-12111: Event and alarm templates fail with Elasticsearch 7.X
  • NMS-13419: CI: Don't publish artifacts until smoke tests have passed
  • NMS-13490: Support multiple auth params for same SNMPV3 username
  • NMS-13733: Kafka topics should start with OpenNMS Instance ID for Twin
  • NMS-13735: Events from Hardware Inventory Provisioning Adapter and SNMP Metadata Provisioning Adapter cannot be distinguished
  • NMS-13747: opennms-plugin-provisioning-wsman-asset missing on Debian
  • NMS-13748: Upgrade to 29: "$RUNAS is not set"
  • NMS-13752: SNMP Metadata XSD does not allow multiple <config> elements

by RangerRick at November 22, 2021 07:39 PM

OpenNMS Horizon 29.0.1 Released

Horizon 29.0.1 is a quick release outside of the normal schedule to address some bugs found in 29.0.0 mostly related to running as non-root, and Minion communication.

For a high-level overview of what has changed in Horizon 29, see What’s New in OpenNMS Horizon 29.

The codename for Horizon 29.0.1 is Emu.

Bug

  • Kafka topics should start with OpenNMS Instance ID for Twin (Issue NMS-13733)
  • opennms.spec file tries to find out if gid 1000 is used but doesn’t actually check hat (Issue NMS-13734)
  • Events from Hardware Inventory Provisioning Adapter and SNMP Metadata Provisioning Adapter cannot be distinguished (Issue NMS-13735)
  • Upgrade to 29: fix-permissions script fails changing ownership (Issue NMS-13736)
  • Minion user not authorized to read from topic OpenNMS.Twin.Sink (Issue NMS-13742)
  • opennms-plugin-provisioning-wsman-asset missing on Debian (Issue NMS-13747)
  • Upgrade to 29: "$RUNAS is not set" (Issue NMS-13748)
  • SNMP Metadata XSD does not allow multiple <config> elements (Issue NMS-13752)

Enhancement

  • Support multiple auth params for same SNMPV3 username (Issue NMS-13490)
  • Add retry for RPC calls (Issue NMS-13652)
  • Migrate Discovery settings from wiki into docs (Issue NMS-13730)

by RangerRick at November 22, 2021 02:22 PM

November 15, 2021

OpenNMS On the Horizon – Provisiond, Karaf, Enlinkd, LLDP, Config API, Docs, Sentinel, Twin API, Non-Root, Maven, Pollerd, IPv6, GeoIP, Flows, Azure, PostgreSQL, Kafka, Geomaps, FeatherDS, Vue, Helm

Since last time, we worked on Provisiond, Karaf, Enlinkd and LLDP, the config management API, documentation, Sentinel, the Twin API, running as non-root, Maven improvements, Pollerd, IPv6 in the GeoIP provisioning adapter, config validation, flows, Azure PostgreSQL support, Kafka, Geomaps, FeatherDS Vue UI, and Helm.

Github Project Updates

Internals, APIs, and Documentation
  • Christian fixed an NPE in provisioning
  • Stefan worked on some changes to bundle refresh in Karaf
  • Christian worked on a performance issue in enlinkd
  • Freddy cleaned up some test infrastructure in the config management branch
  • Mark worked on KSC report, Discovery, and SSL documentation
  • Mark Bordelon started implementing some event forwarding infrastructure for Sentinel
  • Chandra did more work on some Twin API improvements
  • Maxim worked on some Sentinel smoke test issues
  • I fixed a number of bugs in non-root support
  • Jerry and Jesse worked on some tools to map out Maven project components
  • Ronny updated the docs to note about time sync issues between devices
  • Stefan worked on some performance improvements to poller locking
  • Antonio did more work on LLDP enhancements in Enlinkd
  • Christian added IPv6 support to the GeoIP provisioning adapter
  • Freddy did more work on storing validation info in the DB rather than XSDs
  • Tikayat worked on migrating the WMI config to the config management API
  • Dustin made some cache improvements to flow code
  • Ronny updated the supported version docs for various 3rd-party tools
  • Yang fixed the installer to work with Azure user@host style PostgreSQL usernames
  • Pushkar worked on trapd-configuration.xml support in the config management API
  • Patrick worked on persisting Karaf configuration to the config management database
  • Sean contributed an update to Kafka dependencies 3.0.0
Web, ReST, UI, and Helm
  • Jane worked on UI updates to the vue geomap including transitioning to Feather
  • Farid did more work on showing alarm severity color on the vue geomap markers
  • Mike worked on showing logs in the new UI
  • Tripti, Mike, and Makarand worked on wrapping up the PoC for the new UI
  • Stefan added support for adding a prefix or suffix to Helm results
  • Stefan worked on support for multiple flow queries per panel in Helm
Contributors

Thanks to the following contributors for committing changes since last OOH:

  • Antonio Russo
  • Benjamin Reed
  • Chandra Gorantla
  • Christian Pape
  • Dustin Frisch
  • Farid Ahmad
  • Freddy Chu
  • Jane Hou
  • Jerry Beuree
  • Jesse White
  • Makarand Patil
  • Mark Bordelon
  • Mark Mahacek
  • Maxim Brener
  • Mike Rose
  • Patrick Schweizer
  • Pushkar Suthar
  • Ronny Trommer
  • Sean Torres
  • Stefan Wachter
  • Tikayat Mohanta
  • Tripti Bansal
  • Yang Li

Release Roadmap

Completed November 2021 Releases - Horizon 29.0.0, Meridians 2021.1.6, 2020.1.14, 2019.1.25

In November, we released updates to all OpenNMS Meridian versions under active support, and introduced a new major release of Horizon.

Horizon 29.0.0

Release 29.0.0 is the first in the Horizon 29 series, introducing running as non-root by default, optimizations to Minion communication, time-series improvements, support for Cortex for storing flow data, and more.

For a high-level overview of what has changed in Horizon 29, see What’s New in OpenNMS Horizon 29.

The codename for Horizon 29.0.0 is Turkey.

Meridian Point Releases

Meridian 2019.1.25 included a few small features updates and a number of bug fixes, including an XSS security issue in the notifications wizard.

Meridian 2020.1.14 added a fix for handling multiple authentication params in SNMPv3.

Meridian 2021.1.6 included an additional ReST fix, plus a number of documentation updates.

For a list of changes, see the release notes:

Upcoming December Releases

OpenNMS is on a monthly release schedule, with releases happening on the second Wednesday of the month.

The next OpenNMS release day is December 8th, 2021.

We currently expect a minor update to Horizon 29.

Next Horizon: 30 (Q1 2022)

The next major Horizon release will be Horizon 30.

Horizon 29 is currently expected to have the following features:

  • the start of a new Vue-based UI using the Feather Design System
  • thresholding support for Flow data
  • support for running OIA plugins on Minion and Sentinel
  • support for backing up router configuration files
Next Meridian: 2022 (Q1 2022)

The current expectation is that we will release Meridian 2022 in Q1 of next year. It will be based on Horizon 29 plus any bug fixes that happen between November and the Meridian release.

Disclaimer

Note that this is just based on current plans; dates, features, and releases can change or slip depending on how development goes.

The statements contained herein may contain certain forward-looking statements relating to The OpenNMS Group that are based on the beliefs of the Group’s management as well as assumptions made by and information currently available to the Group’s management. These forward-looking statements are, by their nature, subject to significant risks and uncertainties.

...We apologize for the excessive disclaimers. Those responsible have been sacked.

Mynd you, møøse bites Kan be pretti nasti...

We apologise again for the fault in the disclaimers. Those responsible for sacking the people who have just been sacked have been sacked.

Until Next Time…

If there’s anything you’d like me to talk about in a future OOH, or you just have a comment or criticism you’d like to share, don’t hesitate to say hi.

- Ben

Resolved Issues Since Last OOH

  • HELM-220: Decommission Helm on Bamboo
  • HELM-298: Allow to prefix / suffix label names of flow series / summaries
  • NMS-12177: Ubuntu /etc/init.d/opennms file
  • NMS-12349: Create some services for firewalld
  • NMS-12810: Update Provisioning chapter
  • NMS-13284: EvaluationMetrics.log is contaminated with non-related metrics.
  • NMS-13372: Provide ability to store aggregated flow data from Nephron in Cortex
  • NMS-13496: Reflected XSS in webapp notice wizard
  • NMS-13642: Update docs with Twin implementation
  • NMS-13652: Add retry for RPC calls
  • NMS-13715: Install script fails when using Azure PostgreSQL Services
  • NMS-13716: Upgrade Kafka components to 3.0.0
  • NMS-13720: Initial framework for new UI developed with Vue3 & FeatherDS
  • NMS-13721: Update Netty to 4.1.69
  • NMS-13724: Add hint for time sync on OpenNMS components
  • NMS-13725: invalid permissions in /var/opennms on fresh install
  • NMS-13726: JMS Twin doesn't work with minion user
  • NMS-13727: Remove reference to DHCP plugin from docs
  • NMS-13728: GeoIP Provisioning Adapter: SubnetUtils does not support IPv6
  • NMS-13730: Migrate Discovery settings from wiki into docs
  • NMS-13734: opennms.spec file tries to find out if gid 1000 is used but doesn't actually check hat
  • NMS-13736: Upgrade to 29: fix-permissions script fails changing ownership
  • NMS-13740: 28.1.1 deb package is missing opennms-snmp-metadata-provisioning-adapter-28.1.1.jar
  • NMS-13742: Minion user not authorized to read from topic OpenNMS.Twin.Sink
  • OIA-16: Time series persistence strategy

by RangerRick at November 15, 2021 09:53 PM

November 10, 2021

November 2021 Releases – Horizon 29.0.0, Meridians 2021.1.6, 2020.1.14, 2019.1.25

In November, we released updates to all OpenNMS Meridian versions under active support, and introduced a new major release of Horizon.

Horizon 29.0.0

Release 29.0.0 is the first in the Horizon 29 series, introducing running as non-root by default, optimizations to Minion communication, time-series improvements, support for Cortex for storing flow data, and more.

For a high-level overview of what has changed in Horizon 29, see What’s New in OpenNMS Horizon 29.

The codename for Horizon 29.0.0 is Turkey.

Meridian Point Releases

Meridian 2019.1.25 included a few small features updates and a number of bug fixes, including an XSS security issue in the notifications wizard.

Meridian 2020.1.14 added a fix for handling multiple authentication params in SNMPv3.

Meridian 2021.1.6 included an additional ReST fix, plus a number of documentation updates.

For a list of changes, see the release notes:

by RangerRick at November 10, 2021 08:12 PM

November 08, 2021

OpenNMS On the Horizon – Horizon 29, Zabbix, Karaf, Twin API, Documentation, Config API, SNMPv3, macOS, Schemas, gRPC, PostgreSQL, SQS, Minion, REST, JavaMail, GeoIP, LLDP, Healthcheck, Geomaps, Vue, featherDS

Since last time, we prepped for Horizon 29 and worked on Zabbix agent support, test fixes, Karaf, the Twin API, documentation, the config management API, SNMPv3 settings, macOS Monterey fixes, schema handling, gRPC, PostgreSQL, SQS, Minion, REST, JavaMail TLS, GeoIP provisioning, Enlinkd LLDP, healthcheck, the web config editor, vue Geomaps, and the new featherDS UI.

Github Project Updates

Internals, APIs, and Documentation
  • Yang Li and Jesse did some more work on Zabbix agent support.
  • I forked the release-29.x branch in preparation for the upcoming Horizon 29.
  • Dustin cleaned up some Karaf shell code for the Twin API.
  • David Schlenk made ping less demonic 😈
  • Maxim worked on config API updates.
  • Christian worked on wrapping up support for multiple SNMPv3 settings per user.
  • Christian fixed a bug in starting OpenNMS on macOS Monterey.
  • Freddy made some improvements to config API schema handling.
  • Chandra cleaned up some gRPC/Karaf service code.
  • I updated H29 to support PostgreSQL versions through 14.
  • Dustin removed the last vestiges of SQS support.
  • David Schlenk's changes to update JavaMail to 1.6 (for better TLS support) were merged to Horizon 29.
  • Christian worked on wrapping up his GeoIP provisioning adapter.
  • Antonio worked on some updates to Enlinkd LLDP support.
  • Sean worked on bumping the Kafka test dependencies to v3.
  • Chandra did more work on Twin API patch (incremental update) support.
  • Patrick worked on moving the datasources config to the new config manager.
  • Chandra added healthcheck support for the Kafka twin subscriber.
Web, ReST, UI, and Helm
  • Freddy did more work on the config ReST API.
  • Mike continued to work on the config editor UI.
  • Tripti worked on some updates to the UI code.
  • The first proof-of-concept of the new featherDS Vue UI has been merged to develop.
  • Stefan removed unneccesary REST client code from the Minion.
  • Farid worked on some alarm code in the new Geomaps.
  • Jane worked on some visual improvements to the new Geomaps.
Contributors

Thanks to the following contributors for committing changes since last OOH:

  • Antonio Russo
  • Benjamin Reed
  • Chandra Gorantla
  • Christian Pape
  • David Schlenk
  • Dustin Frisch
  • Farid Ahmad
  • Freddy Chu
  • Jane Hou
  • Jesse White
  • Maxim Brener
  • Mike Rose
  • Patrick Schweizer
  • Sean Torres
  • Stefan Wachter
  • Tripti Bansal
  • Yang Li

Reminder: Breaking Changes Coming in Horizon 29

With Horizon 29 slated for release this week, here is one last reminder to note some changes that are coming.

Along with a bunch of bug fixes and enhancements, we have a couple of things that are changing significantly that it's worth noting.

  1. OpenNMS will run as non-root by default.
    However, because it is possible to have a significant number of resources
    writing files into the $OPENNMS_HOME/share directory, we will not automatically
    fix ownership of those files on upgrade, because it could take an indeterminate
    amount of time to run chown on the entire shared data tree.

    Be prepared for some downtime while upgrading.

  2. Minion Communication Changes
    If you are using gRPC or Kafka for Minion communication, you will need to perform
    some additional configuration with the introduction of the new Twin API.

    If you are using SQS for Minion communication, it will no longer be supported as of Horizon 29.

  3. Time-Series Metadata Changes
    Resource level string attributes are now also stored via the plugin in the respective time series database.
    The timeseries_meta table which previously stored this metadata has been removed.
    There is no migration; string values are generally updated on the next poll.

Release Roadmap

Upcoming December Releases

OpenNMS is on a monthly release schedule, with releases happening on the second Wednesday of the month.

The next OpenNMS release day is December 8th, 2021.

We currently expect a minor update to Horizon 29.

Next Horizon: 29 (Q4 2021)

The next major Horizon release will be Horizon 29.

Horizon 29 will be a new release branch for Horizon, introducing a ton of bug fixes and cleanups, plus a number of new features:

  • running as non-root by default
  • the Minion's communication has been refactored to get rid of out-of-band ReST calls to the OpenNMS core
  • persistence of flows to Cortex
  • many improvements and optimizations to Nephron, flow processing, and flow classification
  • a number of other improvements to polling, metadata handling, and validation
  • Enlinkd support for TIMETRA-LLDP-MIB-capable devices
Next Meridian: 2022 (Q1 2022)

The current expectation is that we will release Meridian 2022 in Q1 of next year. It will be based on Horizon 29 plus any bug fixes that happen between November and the Meridian release.

Disclaimer

Note that this is just based on current plans; dates, features, and releases can change or slip depending on how development goes.

The statements contained herein may contain certain forward-looking statements relating to The OpenNMS Group that are based on the beliefs of the Group’s management as well as assumptions made by and information currently available to the Group’s management. These forward-looking statements are, by their nature, subject to significant risks and uncertainties.

...We apologize for the excessive disclaimers. Those responsible have been sacked.

Mynd you, møøse bites Kan be pretti nasti...

We apologise again for the fault in the disclaimers. Those responsible for sacking the people who have just been sacked have been sacked.

Until Next Time…

If there’s anything you’d like me to talk about in a future OOH, or you just have a comment or criticism you’d like to share, don’t hesitate to say hi.

- Ben

Resolved Issues Since Last OOH

  • NMS-1652: Data Collection Retries not really Retries
  • NMS-12717: Prometheus collector won't process untyped metrics
  • NMS-13283: The node and interface counters of the Evaluation Layer are incorrect
  • NMS-13402: Integrate Object replication with Trapd (for SNMPV3 Users)
  • NMS-13488: Add Karaf Command to add query and publish Twin Objects
  • NMS-13576: Support partial updates to Twin API
  • NMS-13598: Add version support for Twin Object retrieval
  • NMS-13636: Components that use JavaMail unable to use TLS 1.2+
  • NMS-13637: Discover LLDP topology on devices running MikroTik RouterOS
  • NMS-13640: Drop SQS support
  • NMS-13641: Remove Rest Client / OpenNMS Rest Health Checks on Minion
  • NMS-13663: Add Health Check for Twin on Minion
  • NMS-13701: Add Twin feature/strategy to conf.d/smoke test
  • NMS-13704: GeoIP Provisioning Adapter
  • NMS-13714: Allow PostgreSQL 14
  • NMS-13717: SNMP Metadata Provisioning Adapter: wrong line in debian/rules
  • NMS-13719: NPE when synchronizing requisition with existing nodes in database

by RangerRick at November 08, 2021 07:40 PM

November 01, 2021

OpenNMS On the Horizon – Config Manager, Zabbix, Enlinkd, MikroTik, Twin API, SNMP, Docs, IFTTT, Flows, Vue UI, Geomaps

Since last time, we worked on the config manager API schemas, imports, validation, and editing, a proof-of-concept Zabbix agent plugin, Enlinkd optimization and MikroTik router support, the Twin API, SNMP improvements, documentation, IFTTT SSL handling, Flows, startup, related events, the featherDS Vue UI, and Vue geomaps.

Github Project Updates

Internals, APIs, and Documentation
  • Freddy worked on exposing an OpenAPI URL with config manager schemas.
  • Jesse and Yang Li worked on a plugin for interacting with the Zabbix agent.
  • Antonio worked on discovering topology on MikroTik routers.
  • Upendra updated the config manager to import trapd-configuration.xml.
  • Chandra did more improvements to the gRPC Twin implementation.
  • Shankar updated the config manager to import enlinkd-configuration.xml.
  • Chandra changed the SNMP API to use the full trap OID even if the sub-id is 0.
  • Dustin worked on wrapping up the JMS and in-memory implementations of the Twin API.
  • Patrick reworked some of the config API implementation for managing types and validation.
  • Chandra simplified some response handling in the core Twin API.
  • Christian optimized some bridge node handling in Enlinkd.
  • Tikayat updated the config manager to import discovery-configuration.xml.
  • Bonnie worked on a glossary of terms for the docs.
  • Stefan updated the documentation for Cortex persistence.
  • David Schlenk contributed a fix to honor START_TIMEOUT in systemd mode.
  • Patrick started to implement .cfg importing into the config API.
  • Chandra worked on supporting "patch" changes in Twin API communication.
  • Chandra added node label and location to protobuf node metadata.
  • Christian wrapped up his SSL handling changes for IFTTT.
  • Christian fixed an issue with connecting to the local JVM.
  • Dustin started to work on adding thresholding support to flow data.
  • Marcel continued working on daemon reload documentation.
  • Stefan did more work on flow document optimizations.
  • David Schlenk contributed a fix to the "related events" UI when no metadata matches.
Web, ReST, UI, and Helm
  • Mike and Sagar continued work on the new featherDS Vue UI, including UX improvements, validation, and a GUI file editor.
  • Jane worked on autosizing and other UX improvements in the new Vue geomaps.
  • Jesse worked on exposing certain config files over ReST.
Contributors

Thanks to the following contributors for committing changes since last OOH:

  • Antonio Russo
  • Benjamin Reed
  • Bonnie Robinson
  • Chandra Gorantla
  • Christian Pape
  • David Schlenk
  • Dustin Frisch
  • Freddy Chu
  • Jane Hou
  • Jesse White
  • Marcel Fuhrmann
  • Mark Mahacek
  • Maxim Brener
  • Mike Rose
  • Patrick Schweizer
  • Sagar Salunkhe
  • Shankar Suman
  • Stefan Wachter
  • Tikayat Mohanta
  • Tripti Bansal
  • Upendra Guggilam
  • Yang Li

Reminder: Breaking Changes Coming in Horizon 29

With Horizon 29 slated for next month, I wanted to take a moment to note some changes that are coming.

Along with a bunch of bug fixes and enhancements, we have a couple of things that are changing significantly that it's worth noting.

  1. OpenNMS will run as non-root by default.
    However, because it is possible to have a significant number of resources
    writing files into the $OPENNMS_HOME/share directory, we will not automatically
    fix ownership of those files on upgrade, because it could take an indeterminate
    amount of time to run chown on the entire shared data tree.

    Be prepared for some downtime while upgrading.

  2. Amazon SQS support for communicating with Minion will be removed.
    RPC communication and the handling of configuration are changing significantly
    enough that we would need to rewrite the SQS component and we don't believe
    it to be in wide deployment, compared to using gRPC or Kafka.

  3. Time-Series Metadata Changes
    Resource level string attributes are now also stored via the plugin in the respective time series database.
    The timeseries_meta table which previously stored this metadata has been removed.
    There is no migration; string values are generally updated on the next poll.

Release Roadmap

Upcoming November Releases

OpenNMS is on a monthly release schedule, with releases happening on the second Wednesday of the month.

The next OpenNMS release day is November 10th, 2021.

We currently expect the first release in the Horizon 29 series, as well as updates to Meridians 2019 through 2021.

Next Horizon: 29 (Q4 2021)

The next major Horizon release will be Horizon 29.

Horizon 29 will be a new release branch for Horizon, introducing a ton of bug fixes and cleanups, plus a number of new features:

  • running as non-root by default
  • the Minion's communication has been refactored to get rid of out-of-band ReST calls to the OpenNMS core
  • persistence of flows to Cortex
  • many improvements and optimizations to Nephron, flow processing, and flow classification
  • a number of other improvements to polling, metadata handling, and validation
  • Enlinkd support for TIMETRA-LLDP-MIB-capable devices
Next Meridian: 2022 (Q1 2022)

The current expectation is that we will release Meridian 2022 in Q1 of next year. It will be based on Horizon 29 plus any bug fixes that happen between November and the Meridian release.

Disclaimer

Note that this is just based on current plans; dates, features, and releases can change or slip depending on how development goes.

The statements contained herein may contain certain forward-looking statements relating to The OpenNMS Group that are based on the beliefs of the Group’s management as well as assumptions made by and information currently available to the Group’s management. These forward-looking statements are, by their nature, subject to significant risks and uncertainties.

...We apologize for the excessive disclaimers. Those responsible have been sacked.

Mynd you, møøse bites Kan be pretti nasti...

We apologise again for the fault in the disclaimers. Those responsible for sacking the people who have just been sacked have been sacked.

Until Next Time…

If there’s anything you’d like me to talk about in a future OOH, or you just have a comment or criticism you’d like to share, don’t hesitate to say hi.

- Ben

Resolved Issues Since Last OOH

  • NMS-2510: RRD creation for JMX data fails
  • NMS-3171: HttpMonitor doesn't check JSON responses for response-text
  • NMS-3336: provisiond : snmpinterfaces not created
  • NMS-3736: Resource Graphs and custom time period error while refreshing
  • NMS-3848: Reasons Missing From nodeLostService events
  • NMS-12611: Documentation for reloadable daemons
  • NMS-12778: Incorporate node related information to events and alarms topic in opennms-kafka-producer feature
  • NMS-13377: Nephron: Get rid of convo_key and grouped_by_key
  • NMS-13437: The Info ReST endpoint is not showing the services status
  • NMS-13487: Grpc IPC and Twin should be able to run from the same port
  • NMS-13490: Support multiple auth params for same SNMPV3 username
  • NMS-13501: IFTTT integration not working anymore
  • NMS-13593: Discovery LLDP Topology for devices supporting TIMETRA-LLDP-MIB
  • NMS-13622: Topologies menu
  • NMS-13627: Move IFTTT integration topic under Alarms
  • NMS-13633: geo-map: "

    " in column "LOG MESSAGE"

  • NMS-13634: geo-map: Adjust to column width
  • NMS-13635: Documentation for the new feature persisting flows in Cortex
  • NMS-13639: geo-map: Add count to the Alarms and Nodes tab name
  • NMS-13660: Nodes with complex hardware configuration are not correctly rendered
  • NMS-13661: automation cleanUpRpStatusChanges that references removed action with same name remains in default vacuumd-configuration.xml configuration
  • NMS-13662: Implement auto-labeling of GitHub Pull Requests
  • NMS-13664: ALEC in distributed mode doesn't start on Sentinel
  • NMS-13670: property name importer.adapter.dns.reverse.level is incorrect in commented out example
  • NMS-13688: Check doc source for wiki links
  • NMS-13700: Create Release Notes for Horizon 29
  • NMS-13702: START_TIMEOUT ignored when run from systemd
  • NMS-13703: macOS Monterey: older OpenNMS branches do not start anymore
  • NMS-13705: related events box in alarm detail shows all events when alarm has no node / interface / service / ifindex

by RangerRick at November 01, 2021 07:57 PM

October 25, 2021

OpenNMS On the Horizon – Docs, Config Management, IFTTT, CI, Twin API, Router Config Backup, Pollerd, Catheter, Nephron, FeatherDS UI, Geomaps, Kafka, GRPC

Since last time, we worked on docs, the configuration management API, IFTTT, CI, the Twin API, router config backup, poller performance, Catheter and Nephron, and the new UI and geomaps.

Github Project Updates

Internals, APIs, and Documentation
  • Bonnie and Mark continued their work on cleaning up and rearranging the admin guide docs.
  • Patrick, Tikayat, and Shankar did more work on the new configuration backend.
  • Christian did some SSL-related bug fixes to the IFTTT integration.
  • I did more work cleaning up CircleCI build issues.
  • Chandra worked on making the Twin API reuse the existing GRPC IPC port and server.
  • Stefan worked on wrapping up his changes to make health-check calls asynchronous.
  • Stefan documented the Cortex integration for Nephron.
  • Stefan cleaned up some extra dependencies in the Minion client.
  • Chandra worked on updating the Twin API to support incremental/partial updates.
  • Marcel worked on daemon reload docs.
  • Chandra, Maxim, Jesse, and Freddy worked on a prototype to back up router configs.
  • Stefan worked on some performance improvements to the poller.
  • I released updated Catheter and Nephron packages.
  • Dustin worked on the Kafka implementation of the Twin API.
Web, ReST, UI, and Helm
  • Sagar did more work on provisiond configuration editing in the new UI.
  • Jane continued her work on implementing the vue-based geomap.
  • Freddy did more work on the configuration ReST API.
Contributors

Thanks to the following contributors for committing changes since last OOH:

  • Benjamin Reed
  • Bonnie Robinson
  • Chandra Gorantla
  • Christian Pape
  • Dustin Frisch
  • Freddy Chu
  • Jane Hou
  • Jesse White
  • Marcel Fuhrmann
  • Mark Mahacek
  • Maxim Brener
  • Patrick Schweizer
  • Sagar Salunkhe
  • Shankar Suman
  • Stefan Wachter
  • Tikayat Mohanta
  • Tripti Bansal

Breaking Changes Coming in Horizon 29

With Horizon 29 slated for next month, I wanted to take a moment to note some changes that are coming.

Along with a bunch of bug fixes and enhancements, we have a couple of things that are changing significantly that it's worth noting.

  1. OpenNMS will run as non-root by default.
    However, because it is possible to have a significant number of resources
    writing files into the $OPENNMS_HOME/share directory, we will not automatically
    fix ownership of those files on upgrade, because it could take an indeterminate
    amount of time to run chown on the entire shared data tree.

    Be prepared for some downtime while upgrading.

  2. Amazon SQS support for communicating with Minion will be removed.
    RPC communication and the handling of configuration are changing significantly
    enough that we would need to rewrite the SQS component and we don't believe
    it to be in wide deployment, compared to using gRPC or Kafka.

Release Roadmap

Upcoming November Releases

OpenNMS is on a monthly release schedule, with releases happening on the second Wednesday of the month.

The next OpenNMS release day is November 10th, 2021.

We currently expect the first release in the Horizon 29 series, as well as a Meridian 2021 update.

Next Horizon: 29 (Q4 2021)

The next major Horizon release will be Horizon 29.

The current roadmap for Horizon 29 includes the following goals:

  • running as non-root by default
  • refactor the Minion's communication to get rid of out-of-band ReST calls to the OpenNMS core
  • add support for persistence of flows to Cortex
Next Meridian: 2022 (Q1 2022)

The current expectation is that we will release Meridian 2022 in Q1 of next year. It will be based on Horizon 29 plus any bug fixes that happen between November and the Meridian release.

Disclaimer

Note that this is just based on current plans; dates, features, and releases can change or slip depending on how development goes.

The statements contained herein may contain certain forward-looking statements relating to The OpenNMS Group that are based on the beliefs of the Group’s management as well as assumptions made by and information currently available to the Group’s management. These forward-looking statements are, by their nature, subject to significant risks and uncertainties.

...We apologize for the excessive disclaimers. Those responsible have been sacked.

Mynd you, møøse bites Kan be pretti nasti...

We apologise again for the fault in the disclaimers. Those responsible for sacking the people who have just been sacked have been sacked.

Until Next Time…

If there’s anything you’d like me to talk about in a future OOH, or you just have a comment or criticism you’d like to share, don’t hesitate to say hi.

- Ben

Resolved Issues Since Last OOH

  • NMS-4951: Provisiond never generates nodeCategoryMembershipChanged events
  • NMS-13463: Implement Kafka broker for Object replication ( Twin)
  • NMS-13542: Geo-Map: implement the Acknowlege/Unackowlege... on Alarm grid page
  • NMS-13590: The implementation of HealthCheck.performAsyncHealthCheck is not async
  • NMS-13595: Geo-Map: move map center to selected node while double click the row in the Node grid
  • NMS-13620: geo-map: swap the position of "Alarms" and "Nodes" tab and fix typo "label"
  • NMS-13623: Move Admin Web UI section under Horizon Administration
  • NMS-13625: Move "search" topic under "Administrative Web Interface"
  • NMS-13626: Move Enabling RMI to Horizon Administration section
  • NMS-13628: Move system properties under Horizon Administration
  • NMS-13630: geo-map: Have default sort column
  • NMS-13631: geo-map: disable the hidden filter beside the column name
  • NMS-13655: Lock contention when processing large volume of REST API requests
  • NMS-13666: Handle Publisher Restart for Grpc
  • NMS-13687: Fix JtiTelemetryIT smoke test

by RangerRick at October 25, 2021 07:02 PM

October 18, 2021

OpenNMS On the Horizon – Docs, CI, Health Check, Twin API, LLDP, Config API, TLSv1.3, SNMP, Karaf, Time-Series, GeoIP, Flows, Web UI, Geomaps, ReST

Since last time, we worked on docs, CI automation, health check, the Twin API, LLDP in Enlinkd, the new config api, TLSv1.3 support, SNMP metadata handling, SNMPv3 user settings, Karaf 4.3, time-series processing, user code performance, trapoid handling, GeoIP provisioning, flow templates, web redirects, the new feather UI, geomaps, and ReST.

Github Project Updates

Internals, APIs, and Documentation
  • Mark continued to work on refactoring provisioning documentation.
  • I did a bunch of work cleaning up CircleCI stuff to use newer/recommended ubuntu images for tests.
  • Stefan did more work on improvements to the health-check core.
  • Stefan continued working on changes to optimize flow documents.
  • Chandra worked on optimizations in the Twin API.
  • Jesse worked on updating Enlinkd/topology documentation.
  • Antonio worked on some updates to Enlinkd LLDP handling.
  • Freddy continued his work on the config management backend.
  • Dustin updated some backend API code to use TLSv1.3.
  • Patrick did more work on loading existing configs into the database.
  • Christian did more work on refactoring and improving hardware metadata handling for SNMP.
  • Chandra worked on adding JMS support to the Twin API.
  • Dustin added a Kafka implementation for Twin IPC.
  • Jesse worked on supporting multiple SNMPv3 settings per user.
  • Yang Li wrapped up his work updating the embedded Karaf to 4.3.
  • Alejandro worked on some fixes to time-series processing.
  • Jesse fixed a locking performance issue accessing user info.
  • Chandra did some more work on a trapoid handling bug.
  • Christian worked on a GeoIP provisioning adapter.
  • Christian updated flow option template handling to be thread-safe.
  • Bonnie made some updates to the search documentation.
Web, ReST, UI, and Helm
  • Upendra worked on cleaning up redirect handling in some web controller code.
  • Mike did more work on updating the UI proof-of-concept to FeatherDS.
  • Tripti worked on notification support in the new UI.
  • Jane worked on sorting improvements in the Vue geomap.
  • Sagar worked on more configuration editing improvements in the new UI.
  • Christian fixed the V1 monitoring location ReST API sorting defaults to match V2.
  • Farid worked on updating the Vue geomap to use the AwesomeMarker library for map marker improvements.
Contributors

Thanks to the following contributors for committing changes since last OOH:

  • Alejandro Galue
  • Antonio Russo
  • Benjamin Reed
  • Bonnie Robinson
  • Chandra Gorantla
  • Christian Pape
  • Dino Yancey
  • Dustin Frisch
  • Farid Ahmad
  • Freddy Chu
  • Jane Hou
  • Jesse White
  • Mark Mahacek
  • Mike Rose
  • Patrick Schweizer
  • Sagar Salunkhe
  • Stefan Wachter
  • Tripti Bansal
  • Upendra Guggilam

Breaking Changes in Horizon 29

With Horizon 29 slated for next month, I wanted to take a moment to note some changes that are coming.

Along with a bunch of bug fixes and enhancements, we have a couple of things that are changing significantly that it's worth noting.

  1. OpenNMS will run as non-root by default.
    However, because it is possible to have a significant number of resources
    writing files into the $OPENNMS_HOME/share directory, we will not automatically
    fix ownership of those files on upgrade, because it could take an indeterminate
    amount of time to run chown on the entire shared data tree.

    Be prepared for some downtime while upgrading.

  2. Amazon SQS support for communicating with Minion will be removed.
    RPC communication and the handling of configuration are changing significantly
    enough that we would need to rewrite the SQS component and we don't believe
    it to be in wide deployment, compared to using gRPC or Kafka.

Release Roadmap

Completed October 2021 Releases - Horizon 28.1.1, Meridians 2021.1.5, 2020.1.13, 2019.1.24

In October, we released updates to all OpenNMS Meridian versions under active support, as well as an update for Horizon 28.

Horizon 28.1.1

Release 28.1.1 contains a number of bug fixes and enhancements, including web UI, Minion, Docker, and documentation improvements.

For a high-level overview of what has changed in Horizon 28, see What’s New in OpenNMS Horizon 28.

The codename for Horizon 28.1.1 is Mikaela Banes.

Meridian Point Releases

Meridians 2019 and 2020 included some fixes in how Docker containers are generated, plus an enhancement to queries used by Helm to support more fields in queries.

Meridian 2021.1.5 also contains a number of other bug fixes and enhancements, including web UI and documentation improvements.

For a list of changes, see the release notes:

Upcoming November Releases

OpenNMS is on a monthly release schedule, with releases happening on the second Wednesday of the month.

The next OpenNMS release day is November 10th, 2021.

We currently expect the first release in the Horizon 29 series, as well as a Meridian 2021 update.

Next Horizon: 29 (Q4 2021)

The next major Horizon release will be Horizon 29.

The current roadmap for Horizon 29 includes the following goals:

  • running as non-root by default
  • refactor the Minion's communication to get rid of out-of-band ReST calls to the OpenNMS core
  • add support for persistence of flows to Cortex
Next Meridian: 2022 (Q? 2022)

With Meridian 2021 recently out, we do not yet have a specific timeline for Meridian 2022.

Expect it to include -- at the very least -- the JDK11 requirement and flow aggregation improvements from Horizon 28.
Ideally it will contain work going into Horizons 29 (and probably 30) if our timeline holds. 😅

Disclaimer

Note that this is just based on current plans; dates, features, and releases can change or slip depending on how development goes.

The statements contained herein may contain certain forward-looking statements relating to The OpenNMS Group that are based on the beliefs of the Group’s management as well as assumptions made by and information currently available to the Group’s management. These forward-looking statements are, by their nature, subject to significant risks and uncertainties.

...We apologize for the excessive disclaimers. Those responsible have been sacked.

Mynd you, møøse bites Kan be pretti nasti...

We apologise again for the fault in the disclaimers. Those responsible for sacking the people who have just been sacked have been sacked.

Until Next Time…

If there’s anything you’d like me to talk about in a future OOH, or you just have a comment or criticism you’d like to share, don’t hesitate to say hi.

- Ben

Resolved Issues Since Last OOH

  • NMS-12999: Update adapters documentation
  • NMS-13316: Location dropdown on Add Node does not sort/filter
  • NMS-13461: Implement ActiveMQ broker for Object replication ( Twin)
  • NMS-13501: IFTTT integration not working anymore
  • NMS-13539: Minion stops processing flows with "Invalid packet: null" until restart
  • NMS-13565: Upgrade Karaf to v4.3.2
  • NMS-13594: Provide basic implementation for patch support for Twin
  • NMS-13607: Migrate Import Handlers documentation to Reference
  • NMS-13619: Show Link State when viewing links on the Enlinkd topology maps
  • NMS-13648: Hardware information not displayed for some devices (SnmpMetadataProvisioningAdapter)
  • NMS-13657: Clean unused data in srv001.txt and srv002.txt

by RangerRick at October 18, 2021 07:28 PM

October 14, 2021

October 2021 Releases – Horizon 28.1.1, Meridians 2021.1.5, 2020.1.13, 2019.1.24

In October, we released updates to all OpenNMS Meridian versions under active support, as well as an update for Horizon 28.

Note: Breaking Changes Coming in Horizon 29

We are currently planning on releasing Horizon 29 next month.

Along with a bunch of bug fixes and enhancements, we have a couple of things that are changing significantly that it's worth noting.

  1. OpenNMS will run as non-root by default.
    However, because it is possible to have a significant number of resources
    writing files into the $OPENNMS_HOME/share directory, we will not automatically
    fix ownership of those files on upgrade, because it could take an indeterminate
    amount of time to run chown on the entire shared data tree.

    Be prepared for some downtime while upgrading.

  2. Amazon SQS support for communicating with Minion will be removed.
    RPC communication and the handling of configuration are changing significantly
    enough that we would need to rewrite the SQS component and we don't believe
    it to be in wide deployment, compared to using gRPC or Kafka.

Horizon 28.1.1

Release 28.1.1 contains a number of bug fixes and enhancements, including web UI, Minion, Docker, and documentation improvements.

For a high-level overview of what has changed in Horizon 28, see What’s New in OpenNMS Horizon 28.

The codename for Horizon 28.1.1 is Mikaela Banes.

Meridian Point Releases

Meridians 2019 and 2020 included some fixes in how Docker containers are generated, plus an enhancement to queries used by Helm to support more fields in queries.

Meridian 2021.1.5 also contains a number of other bug fixes and enhancements, including web UI and documentation improvements.

For a list of changes, see the release notes:

by RangerRick at October 14, 2021 05:14 PM

October 12, 2021

OpenNMS On the Horizon – Karaf, Flows, Minion, Docker, Non-Root, Health Check, Config Management, Scriptd, SNMP, JMX, Twin API, IFTTT, Traps, Enlinkd, Provisioning, Geomaps, FeatherDS UI, OpenAPI

Since last time, we worked on documentation, Karaf, the classification engine, the Minion, Docker, running as non-root, health check, config management, CircleCI, Scriptd, SNMP, JMX, the Twin API, IFTTT, flows, traps, Enlinkd, requisitions, Provisiond, Geomaps, the Vue/FeatherDS UI, and OpenAPI ReST updates.

Github Project Updates

Internals, APIs, and Documentation
  • Mark, Bonnie, and Marcel continued to work on refactoring and cleaning up a bunch of documentation, plus adding missing data types and plugins.
  • Yang worked no wrapping up updating our embedded Karaf to 4.3.
  • Stefan did a bit more work on improving performance of classification engine updates.
  • I fixed how minion docker image versions are generated to be more useful in snapshot builds.
  • I fixed a few bugs in setup when running as non-root.
  • Stefan updated the health-check Karaf CLI to support querying by tag.
  • Patrick, Tikayat, Shankar, and Freddy continued to work on the config management backend.
  • Stefan worked on caching/passive health checks and making them asynchronous.
  • I worked on updating some of our CircleCI infrastructure.
  • Alejandro fixed the Scriptd example to match current APIs.
  • Christian worked on additional ways to collect hardware entities from SNMP.
  • Christian fixed an issue with JMX counting in SNMP.
  • Chandra worked on Karaf tools for dealing with the Twin API.
  • Christian updated the IFTTT integration to use the TrustManager.
  • Alejandro fixed a bug in timeseries evaluation.
  • Chandra worked on the JMX twin implementation plus refactoring.
  • Christian fixed some thread safety issues in flow option handling.
  • Chandra worked on some V1 trap handling fixes.
  • Jasper Vandemalle fixed a bunch of typos and such in the docs.
  • Antonio worked on Enlinkd support for TIMETETRA-LLDP-MIB.
  • Stefan did some optimizations for flow data.
  • Chandra worked on updating the Twin API for supporting passing only changes down the wire.
Web, ReST, UI, and Helm
  • Sagar, Jesse, and Maxim worked on requisition handling in the Vue UI.
  • Jane, Farid, and I did more work on the port of the geomap to Vue.
  • Tripti worked on editing provisiond config in the Vue UI.
  • Pushkar and Upendra added OpenAPI docs for the Event, IfService, and Minion ReST services.
  • Mike updated the Vue proof-of-concept to use FeatherDS for UI.
Contributors

Thanks to the following contributors for committing changes since last OOH:

  • Alejandro Galue
  • Antonio Russo
  • Benjamin Reed
  • Bonnie Robinson
  • Chandra Gorantla
  • Christian Pape
  • Farid Ahmad
  • Freddy Chu
  • Jane Hou
  • Jasper Vandemalle
  • Jesse White
  • Marcel Fuhrmann
  • Mark Mahacek
  • Maxim Brener
  • Mike Rose
  • Patrick Schweizer
  • Pushkar Suthar
  • Sagar Salunkhe
  • Shankar Suman
  • Stefan Wachter
  • Tikayat Mohanta
  • Tripti Bansal
  • Upendra Guggilam
  • Yang Li

Release Roadmap

Upcoming October Releases

OpenNMS is on a monthly release schedule, with releases happening on the second Wednesday of the month.

The next OpenNMS release day is October 13th, 2021.

We currently expect a Horizon 28 release, as well as all supported Meridians.

Next Horizon: 29 (Q4 2021)

The next major Horizon release will be Horizon 29.

The current roadmap for Horizon 29 includes the following goals:

  • running as non-root by default
  • refactor the Minion's communication to get rid of out-of-band ReST calls to the OpenNMS core
  • add support for persistence of flows to Cortex
  • start the groundwork for replacing the topology UI with a pure-javascript version
Next Meridian: 2022 (Q? 2022)

With Meridian 2021 recently out, we do not yet have a specific timeline for Meridian 2022.

Expect it to include -- at the very least -- the JDK11 requirement and flow aggregation improvements from Horizon 28.
Ideally it will contain work going into Horizons 29 (and probably 30) if our timeline holds. 😅

Disclaimer

Note that this is just based on current plans; dates, features, and releases can change or slip depending on how development goes.

The statements contained herein may contain certain forward-looking statements relating to The OpenNMS Group that are based on the beliefs of the Group’s management as well as assumptions made by and information currently available to the Group’s management. These forward-looking statements are, by their nature, subject to significant risks and uncertainties.

...We apologize for the excessive disclaimers. Those responsible have been sacked.

Mynd you, møøse bites Kan be pretti nasti...

We apologise again for the fault in the disclaimers. Those responsible for sacking the people who have just been sacked have been sacked.

Until Next Time…

If there’s anything you’d like me to talk about in a future OOH, or you just have a comment or criticism you’d like to share, don’t hesitate to say hi.

- Ben

Resolved Issues Since Last OOH

  • NMS-10476: Document data types in collectd
  • NMS-12034: non-root user:group file permissions
  • NMS-13271: Fix example configuration for Scriptd
  • NMS-13458: Nephron: Document Cortex related functionality in Confluence
  • NMS-13489: SNMPv3 traps are not counted correctly in JMX metrics
  • NMS-13510: Merge the Operations/Operations documentation section into Operations/Administration
  • NMS-13514: Geo-map: investigate leaflet marker cluster in vue3
  • NMS-13521: Add OpenAPI docs for EventRestService
  • NMS-13524: Move monitors docs to the Reference section
  • NMS-13525: Move detectors to reference section
  • NMS-13526: Move collectors to reference section
  • NMS-13527: Move telemetryd (streaming telemetry) to reference section
  • NMS-13529: Move ticketing docs to reference section
  • NMS-13547: Minion: Health ReST API: Lightweight/passive health check for broker/OpenNMS
  • NMS-13562: Move provisioning policies to the reference section
  • NMS-13575: Implement HW inventory Provisioning adapter API to support Juniper HW
  • NMS-13577: Optimize ip address handling in flow classification engine
  • NMS-13578: Nephron: Remove FlowSummaryData
  • NMS-13580: optimize repeated reloads of the flow classification engine
  • NMS-13586: Add full trapoid for Snmp V1
  • NMS-13587: Signed Minion container bleeding image shows revision as meridian-foundation-2021.1.4-1-487
  • NMS-13591: Meridian Minion images do not include release
  • NMS-13592: Add 'tag' argument to health-check command
  • NMS-13604: Research on Display different colors on map base on alarm severity
  • NMS-13609: Horizon release-28.x builds fail with a certificate error
  • NMS-13611: Geolocator Doc Clarification

by RangerRick at October 12, 2021 03:11 PM

September 27, 2021

OpenNMS On the Horizon – Config Management, Docs, Karaf, SNMP Metadata, Minion, JMS, Twin API, ReST, Vue, Geomaps, Flows

Since last time, we worked more on the config management API and importer, thresholding and monitor docs, updating Karaf to 4.3, SNMP metadata provisioning, Minion health check, JMS in the twin API, ReST cleanups and docs, Vue geomap and UI PoC, and flow processing.

Github Project Updates

Internals, APIs, and Documentation
  • Freddy and Tikayat did more work on the config management API.
  • Bonnie worked on some cleanup of the thresholding docs.
  • Jesse and Yang Li did some more work on updating our embedded Karaf to 4.3.
  • Christian worked on a provisioning adapter for processing SNMP metadata.
  • Stefan worked on improving the Minion health check.
  • Patrick continued his work on import/validation and upgrading XML files to the database.
  • Chandra added JMS support to the twin API.
  • Jesse worked on a Karaf interface to the config management API.
  • Mark worked on cleaning up/splitting up monitors in the reference docs.
  • Stefan worked on some performance improvements to flow processing.
Web, ReST, UI, and Helm
  • Sonukumar worked on cleaning up some of our Spring ReST API annotations.
  • Farid and I did some work on marker clusters in the new vue geomap API.
  • Upendra did more work on adding OpenAPI annotations to our ReST interfaces.
  • Stefan wrapped up some work on the flow deep dive dashboard.
  • Tripti did more work on the new vue UI.
  • Jane worked on implementing more features/parity in the vue goemap.
Contributors

Thanks to the following contributors for committing changes since last OOH:

  • Benjamin Reed
  • Bonnie Robinson
  • Chandra Gorantla
  • Christian Pape
  • Farid Ahmad
  • Freddy Chu
  • Jane Hou
  • Jesse White
  • Marcel Fuhrmann
  • Mark Mahacek
  • Patrick Schweizer
  • Sagar Salunkhe
  • Shankar Suman
  • Sonukumar Gupta
  • Stefan Wachter
  • Tikayat Mohanta
  • Tripti Bansal
  • Upendra Guggilam
  • Yang Li

Release Roadmap

Upcoming October Releases

OpenNMS is on a monthly release schedule, with releases happening on the second Wednesday of the month.

The next OpenNMS release day is October 13th, 2021.

We currently expect a Horizon 28 release, as well as all supported Meridians.

Next Horizon: 29 (Q4 2021)

The next major Horizon release will be Horizon 29.

The current roadmap for Horizon 29 includes the following goals:

  • running as non-root by default
  • refactor the Minion's communication to get rid of out-of-band ReST calls to the OpenNMS core
  • add support for persistence of flows to Cortex
  • start the groundwork for replacing the topology UI with a pure-javascript version
Next Meridian: 2022 (Q? 2022)

With Meridian 2021 recently out, we do not yet have a specific timeline for Meridian 2022.

Expect it to include -- at the very least -- the JDK11 requirement and flow aggregation improvements from Horizon 28.
Ideally it will contain work going into Horizons 29 (and probably 30) if our timeline holds. 😅

Disclaimer

Note that this is just based on current plans; dates, features, and releases can change or slip depending on how development goes.

The statements contained herein may contain certain forward-looking statements relating to The OpenNMS Group that are based on the beliefs of the Group’s management as well as assumptions made by and information currently available to the Group’s management. These forward-looking statements are, by their nature, subject to significant risks and uncertainties.

...We apologize for the excessive disclaimers. Those responsible have been sacked.

Mynd you, møøse bites Kan be pretti nasti...

We apologise again for the fault in the disclaimers. Those responsible for sacking the people who have just been sacked have been sacked.

Until Next Time…

If there’s anything you’d like me to talk about in a future OOH, or you just have a comment or criticism you’d like to share, don’t hesitate to say hi.

- Ben

Resolved Issues Since Last OOH

  • HELM-295: Add a flow deep dive dashboard that gets its data from Cortex
  • NMS-13374: Implement to show aggregation display on Grafana using data from Cortex
  • NMS-13475: Split thresholding file into smaller files
  • NMS-13505: Geo-Map: customize the filter for the severity in alarm page
  • NMS-13530: Fix Spring @RequestMapping to use explicit method types
  • NMS-13566: Some of the tests of ClassificationRulePageIT are flaky
  • NMS-13567: Publish Minion image for Meridian to DockerHub
  • NMS-13568: Backport docker content trust for signed images to meridian 2021
  • NMS-13573: Backport confd support for minion config

by RangerRick at September 27, 2021 04:31 PM

September 23, 2021

OpenNMS joins Hacktoberfest 2021

hacktoberfest 2021 logo

There will be just one Hacktoberfest 2021 and it is coming soon!

The OpenNMS community will participate and we are looking for contributors who want to join us in October.

Hacktoberfest is an annual, month-long celebration of open source software driven by Digital Ocean. During this event everyone can support open source by contributing changes, and earn some limited-edition swag.

We would like to invite you to participate and contribute to the OpenNMS project. There are many ways to contribute: you can work on code or documentation. Generally speaking, any pull request in our GitHub repositories qualifies.

Where to contribute

Our software is developed under AGPLv3 on GitHub. You are welcome to contribute to any repository in this organization. The procedure on how we manage and track issues and deal with pull requests is described in our how to contribute guide in our Discourse forum. You will also find information on how to connect with people in our community for further questions and help.

You can freely create an account in our JIRA. We have collected some issues that are reasonable candidates to claim for the event. The filter is called Hacktoberfest - Quickwin. Claim a ticket by assigning it to your user name and click the "Start Progress" button.

If you have any further questions, please don't hesitate to ping us on Mattermost.

Hack the planet!

by Ronny at September 23, 2021 02:30 PM

September 20, 2021

OpenNMS On the Horizon – Docs, Cortex, Flows, Tests, Twin API, Trapd, Docker, Karaf, Config Management, Vue

Since last time, we worked on updated provisioning, datacollection, event, and monitor/detector docs, logging improvements, Cortex support, flow model updates, flow classification engine improvements, smoke tests, SNMP trap counts, twin API implementation for Trapd, DCT in foundation 2021, Karaf 4.3.3, config management, Vue UI, Vue geomap, ReST mappings, and OpenAPI docs.

Github Project Updates

Internals, APIs, and Documentation
  • Mark continued to work on datacollection documentation.
  • Bonnie added documentation for the send-event.pl tool.
  • Christian worked on some fixes for logging storms.
  • Chandra made some changes to Kafka producer node generation to improve performance.
  • Christian cleaned up some handling of flow options data in some situations.
  • Stefan worked on some optimizations/simplification of the Cortex Nephron code,
    as well as some fixes to a flapping test.
  • Stefan worked on improvements to the flow classification engine.
  • Patrick continued his work on converting provisiond-configuration.xml to be in the database.
  • I reworked the smoke test build to put "flaky" tests into a separate build to ease restarts.
  • Christian fixed a bug in how JMX tracks SNMP trap counts.
  • Dustin worked on using the twin API for Trapd configuration.
  • Stefan remode some unnecessary/redundant fields from the flow summary
    and flow summary data model.
  • I worked on backporting our Docker Content Trust implementation for Minion to foundation-2021.
  • Yang Li worked on updating our embedded Karaf to 4.3.3.
  • Freddy did some work on the config management test framework.
  • Marcel did more doc updates for provisioning, collection, and HTTP-related monitors/detectors.
Web, ReST, UI, and Helm
  • Sagar, Tripti, Shankar and Maxim worked on the new Vue-based UI and backend.
  • Jane did more work on the Vue geomap.
  • Sonukumar worked on fixing some of our @RequestMapping annotations on ReST calls.
  • Sonukumar added some OpenAPI docs for the alarm ReST service.
Contributors

Thanks to the following contributors for committing changes since last OOH:

  • Benjamin Reed
  • Bonnie Robinson
  • Chandra Gorantla
  • Christian Pape
  • Dustin Frisch
  • Freddy Chu
  • Jane Hou
  • Jesse White
  • Marcel Fuhrmann
  • Mark Mahacek
  • Maxim Brener
  • Mike Rose
  • Patrick Schweizer
  • Sagar Salunkhe
  • Shankar Suman
  • Sonukumar Gupta
  • Stefan Wachter
  • Tripti Bansal
  • Yang Li

Release Roadmap

Upcoming October Releases

OpenNMS is on a monthly release schedule, with releases happening on the second Wednesday of the month.

The next OpenNMS release day is October 13th, 2021.

We currently expect a Horizon 28 release, as well as Meridian 2021 update.

Next Horizon: 29 (Q4 2021)

The next major Horizon release will be Horizon 29.

The current roadmap for Horizon 29 includes the following goals:

  • running as non-root by default
  • refactor the Minion's communication to get rid of out-of-band ReST calls to the OpenNMS core
  • add support for persistence of flows to Cortex
  • start the groundwork for replacing the topology UI with a pure-javascript version
Next Meridian: 2022 (Q? 2022)

With Meridian 2021 recently out, we do not yet have a specific timeline for Meridian 2022.

Expect it to include -- at the very least -- the JDK11 requirement and flow aggregation improvements from Horizon 28.
Ideally it will contain work going into Horizons 29 (and probably 30) if our timeline holds. 😅

Disclaimer

Note that this is just based on current plans; dates, features, and releases can change or slip depending on how development goes.

The statements contained herein may contain certain forward-looking statements relating to The OpenNMS Group that are based on the beliefs of the Group’s management as well as assumptions made by and information currently available to the Group’s management. These forward-looking statements are, by their nature, subject to significant risks and uncertainties.

...We apologize for the excessive disclaimers. Those responsible have been sacked.

Mynd you, møøse bites Kan be pretti nasti...

We apologise again for the fault in the disclaimers. Those responsible for sacking the people who have just been sacked have been sacked.

Until Next Time…

If there’s anything you’d like me to talk about in a future OOH, or you just have a comment or criticism you’d like to share, don’t hesitate to say hi.

- Ben

Resolved Issues Since Last OOH

  • NMS-13428: Strings with URL arguments are truncated in the eventdescr field
  • NMS-13467: Nephron: Test if pane accumulation has a positive effect on performance
  • NMS-13512: Web-based SNMP config UI does not pass through proxy-host if a value is provided
  • NMS-13539: Minion stops processing flows with "Invalid packet: null" until restart
  • NMS-13540: Add search term highlight functionality in documentation
  • NMS-13545: Nephron: Remove unnecessary fields from FlowSummary / FlowSummaryData
  • NMS-13546: Nephron: FlowAnalyzerIT flaps on Flink 1.13
  • NMS-13571: Nephron: RandomFlowIT.testRatesWithClockSkew is still flaky

by RangerRick at September 20, 2021 07:20 PM

September 13, 2021

OpenNMS On the Horizon – Docs, trapOid, Nephron, Cortex, Karaf, Flow Classification, Config Manager API, ReST, Vue UI and Geomaps

Since last time, we worked on documentation, trapoid/hwEntity handling, Nephron and Cortex, Karaf 4.3, classification rules, config manager upgrade and ReST API, and vue-based UI and geomaps.

Github Project Updates

Internals, APIs, and Documentation
  • Bonnie worked on updates to the admin documentation.
  • Chandra did some wrapping up of the work on trapoid/hwentity handling.
  • Stefan did more work on cleanups to flow handling in Nephron as part of his Cortex work.
  • Jesse worked on updating our embedded Karaf to 4.3.
  • Stefan updated the classification rule tree processing to be asynchronous.
  • Patrick worked on updating XML-based provisiond configs to be pulled into the database.
  • Marcel did more work on cleaning up daemon reload docs.
  • Mark worked on updating the datacollection type documentation.
  • I cleaned up the build/trees on a couple of older projects.
  • I removed the outdated opennms-tools project from the source tree.
  • Stefan did more work on tuning memory vs. correctness in Nephron processing.
  • Freddy worked on fixing some smoke tests.
Web, ReST, UI, and Helm
  • I finished the addition of missing search properties in the model ReST APIs used by Helm.
  • Sagar, Jesse, and Tripti worked on the new Vue-based UI proof-of-concept.
  • Jane worked more on filling out the vue geomap implementation.
  • Tikayat continued the work on updating OpenAPI docs.
  • Freddy worked on implemeting the ReST config manager API.
Contributors

Thanks to the following contributors for committing changes since last OOH:

  • Benjamin Reed
  • Bonnie Robinson
  • Chandra Gorantla
  • Christian Pape
  • Freddy Chu
  • Jane Hou
  • Jesse White
  • Marcel Fuhrmann
  • Mark Mahacek
  • Patrick Schweizer
  • Sagar Salunkhe
  • Stefan Wachter
  • Tikayat Mohanta
  • Tripti Bansal

Release Roadmap

Completed September 2021 Releases - Horizon 28.1.0, Meridians 2021.1.4, 2020.1.12, 2019.1.23

In September, we released updates to all OpenNMS Meridian versions under active support, as well as an update for Horizon 28.

Horizon 28.1.0

Release 28.1.0 contains a bunch of bug fixes and enhancements, including a dependency update related to a CVE.

Note that we bumped the minor version on the release because of the changes made in NMS-13479 — in order to optimize the flow classification processing, some significant changes were made behind the scenes. There shouldn’t be any change from a user perspective, but we bumped the version just in case.

The codename for Horizon 28.1.0 is Bumblebee

For a high-level overview of what has changed in Horizon 28, see What’s New in OpenNMS Horizon 28.

Meridian Point Releases

All Meridian releases this month contained minor security updates, so it is recommended that you upgrade.

2021.1.4 adds a fix for additional node metadata showing in syslog events, plus documentation improvements.

For a list of changes, see the release notes:

Upcoming October Releases

OpenNMS is on a monthly release schedule, with releases happening on the second Wednesday of the month.

The next OpenNMS release day is October 13th, 2021.

We currently expect a Horizon 28 release, as well as Meridian 2021 update.

Next Horizon: 29 (Q4 2021)

The next major Horizon release will be Horizon 29.

The current roadmap for Horizon 29 includes the following goals:

  • running as non-root by default
  • refactor the Minion's communication to get rid of out-of-band ReST calls to the OpenNMS core
  • add support for persistence of flows to Cortex
  • start the groundwork for replacing the topology UI with a pure-javascript version
Next Meridian: 2022 (Q? 2022)

With Meridian 2021 recently out, we do not yet have a specific timeline for Meridian 2022.

Expect it to include -- at the very least -- the JDK11 requirement and flow aggregation improvements from Horizon 28.
Ideally it will contain work going into Horizons 29 (and probably 30) if our timeline holds. 😅

Disclaimer

Note that this is just based on current plans; dates, features, and releases can change or slip depending on how development goes.

The statements contained herein may contain certain forward-looking statements relating to The OpenNMS Group that are based on the beliefs of the Group’s management as well as assumptions made by and information currently available to the Group’s management. These forward-looking statements are, by their nature, subject to significant risks and uncertainties.

...We apologize for the excessive disclaimers. Those responsible have been sacked.

Mynd you, møøse bites Kan be pretti nasti...

We apologise again for the fault in the disclaimers. Those responsible for sacking the people who have just been sacked have been sacked.

Until Next Time…

If there’s anything you’d like me to talk about in a future OOH, or you just have a comment or criticism you’d like to share, don’t hesitate to say hi.

- Ben

Resolved Issues Since Last OOH

  • NMS-13256: Kafka Producer - Enabling causes Trap Processing to halt
  • NMS-13373: Provide the ability in Nephron to write to Cortex
  • NMS-13453: Nephron: CortexIo GC global state
  • NMS-13479: Review classification rules in the flow pipeline
  • NMS-13503: Geo-Map: Convert vuex module code to typescript
  • NMS-13516: Update "Develop Documentation" section to describe table formatting
  • NMS-13519: Installing opennms-plugin-protocol-dhcp fails
  • NMS-13535: Nephron: Support running on Flink 1.13
  • NMS-13541: Geo-Map: Convert the nodes, alarms grid and map page to typescript and use vue SFC
  • NMS-13552: Add JVM option to the minion startup script
  • NMS-13563: delete the opennms-tools directory

by RangerRick at September 13, 2021 07:04 PM

September 08, 2021

September 2021 Releases – Horizon 28.1.0, Meridians 2021.1.4, 2020.1.12, 2019.1.23

In September, we released updates to all OpenNMS Meridian versions under active support, as well as an update for Horizon 28.

Horizon 28.1.0

Release 28.1.0 contains a bunch of bug fixes and enhancements, including a dependency update related to a CVE.

Note that we bumped the minor version on the release because of the changes made in NMS-13479 — in order to optimize the flow classification processing, some significant changes were made behind the scenes. There shouldn’t be any change from a user perspective, but we bumped the version just in case.

The codename for Horizon 28.1.0 is Bumblebee

For a high-level overview of what has changed in Horizon 28, see What’s New in OpenNMS Horizon 28.

Meridian Point Releases

All Meridian releases this month contained minor security updates, so it is recommended that you upgrade.

2021.1.4 adds a fix for additional node metadata showing in syslog events, plus documentation improvements.

For a list of changes, see the release notes:

by RangerRick at September 08, 2021 09:49 PM

September 07, 2021

OpenNMS On the Horizon – Config API, OIA, Time-Series, Netflow, Telemetryd, Flows, Traps, WSman, Docs, Syslog, Kafka, UI, ReST, Vue, Geomaps, Cortex, Helm, OpenAPI

Sorry for the missing OOH last week, I was on vacation.

Since last time, we worked on the config API, OIA, the time-series API, Netflow debugging, Telemetryd config, the flow classification rule parser, trap OID handling, WSman config validation, documentation, syslog hostname resolution, asynchronous node processing in Kafka, UI cleanups, opennms.js, ReST fixes and updates, Vue gomaps and UI proof-of-concept, Cortex flows in Helm, and OpenAPI documentation.

Github Project Updates

Internals, APIs, and Documentation
  • Freddy and Patrick continued the work on the new configuration API.
  • Chandra updated OIA to build with JDK 11 by default.
  • Patrick continued his work on improvements to the time-series API.
  • Chandra did more work updating our Guava dependency.
  • Christian worked on some improved debugging in the netflow parser.
  • Chritian fixed an issue with handling extraneous whitespace in the telemetry config.
  • Stefan reworked the classification rule parser for performance.
  • Chandra worked on optimizing the loading of the HwEntity tree.
  • Chandra did more work on adding the full trap OID to the list of parameters.
  • David added support for validation of the WSman config.
  • Mark worked on more Provisiond doc updates.
  • Chandra did more work on properly resolving hostnames for incoming Syslog messages.
  • Marcel did a bunch of updates in the daemon reference docs.
  • Bonnie did more work on structure cleanup in the docs.
  • Chandra worked on updating the Kafka producer to process nodes asynchronously.
Web, ReST, UI, and Helm
  • Jeff worked on cleanup of inputs in the path outage page.
  • I released an updated version of opennms.js that supports new entities in the entity datasource.
  • I did more work updating the search properties ReST API to support more properties.
  • Jane continued to work on the new Vue-based geomaps.
  • Sagar, Tripti, and Mike worked on the Vue-based UI PoC.
  • Stefan made some updates to the Cortex version of the flow deep dive dashboard.
  • Tikayat, Sonukumar, Shankar, and Upendra worked on adding OpenAPI documentation for some of the ReST services.
  • Christian updated the service status page to show parsed patterns.
  • Yang Li did more work on ReST APIs to support the new Vue UI.
Contributors

Thanks to the following contributors for committing changes since last OOH:

  • Benjamin Reed
  • Bonnie Robinson
  • Chandra Gorantla
  • Christian Pape
  • David Schlenk
  • Freddy Chu
  • Jane Hou
  • Jeff Gehlbach
  • Marcel Fuhrmann
  • Mark Mahacek
  • Maxim Brener
  • Mike Rose
  • Patrick Schweizer
  • Ronny Trommer
  • Sagar Salunkhe
  • Shankar Suman
  • Sonukumar Gupta
  • Stefan Wachter
  • Tikayat Mohanta
  • Tripti Bansal
  • Upendra Guggilam
  • Yang Li

Release Roadmap

September Releases

OpenNMS is on a monthly release schedule, with releases happening on the second Wednesday of the month.

The next OpenNMS release day is September 8th, 2021.

We currently expect a Horizon 28.0.3 release and updated Meridians 2019 through 2021.

Next Horizon: 29 (Q4 2021)

The next major Horizon release will be Horizon 29.

The current roadmap for Horizon 29 includes the following goals:

  • running as non-root by default
  • refactor the Minion's communication to get rid of out-of-band ReST calls to the OpenNMS core
  • add support for persistence of flows to Cortex
  • start the groundwork for replacing the topology UI with a pure-javascript version
Next Meridian: 2022 (Q? 2022)

With Meridian 2021 recently out, we do not yet have a specific timeline for Meridian 2022.

Expect it to include -- at the very least -- the JDK11 requirement and flow aggregation improvements from Horizon 28.
Ideally it will contain work going into Horizons 29 (and probably 30) if our timeline holds. 😅

Disclaimer

Note that this is just based on current plans; dates, features, and releases can change or slip depending on how development goes.

The statements contained herein may contain certain forward-looking statements relating to The OpenNMS Group that are based on the beliefs of the Group’s management as well as assumptions made by and information currently available to the Group’s management. These forward-looking statements are, by their nature, subject to significant risks and uncertainties.

...We apologize for the excessive disclaimers. Those responsible have been sacked.

Mynd you, møøse bites Kan be pretti nasti...

We apologise again for the fault in the disclaimers. Those responsible for sacking the people who have just been sacked have been sacked.

Until Next Time…

If there’s anything you’d like me to talk about in a future OOH, or you just have a comment or criticism you’d like to share, don’t hesitate to say hi.

- Ben

Resolved Issues Since Last OOH

  • HELM-188: Entity DS does not fetch SNMP Primary IP or ifIndex for Nodes
  • HELM-228: Add IP- and SNMP-interface, ifService, outage support to Helm Entity DS
  • NMS-13422: Add the full trap oid for v2 snmp event
  • NMS-13446: Update Provisiond Docs
  • NMS-13455: Geo-map: work with Ben designing RESTful API for Geo-map page
  • NMS-13468: validate wsman-config.xml
  • NMS-13473: Migrate VMware config from wiki to docs
  • NMS-13477: Trailing whitespace breaks flow listener config
  • NMS-13480: Enhance exception handling for parse error in flows
  • NMS-13506: Geo Map: make use of modules for vuex store so that the code can be easily integrated into larger project
  • NMS-13509: Bump Apache Ant version to 1.10.11 (CVE-2021-36373, CVE-2021-36374)
  • NMS-13511: Use Karaf shell commands to secure Minion SSH Karaf access
  • NMS-13515: Reformat tables (again)
  • NMS-13517: Service Parameters box misses Poller Patterns
  • NMS-13518: missing fields in search autocomplete
  • NMS-13533: geo-map: initiate geo-map typescript project
  • NMS-13536: Update abuse e-mail address in CONTRIBUTING.md of OpenNMS repo
  • OIA-20: Integration API should be able to compile on JDK11

by RangerRick at September 07, 2021 09:12 PM

September 02, 2021

How to: Contribute to OpenNMS

Submitting issues, fixing bugs, contributing features, enhancements, and extensions, writing documentation, or reporting security issues are all valuable ways that our community helps make OpenNMS a better monitoring platform.

OpenNMS uses Jira to manage issue tracking and development. Once you have a Jira account and have signed the OpenNMS Contribution Agreement (OCA), you can start contributing. The basic workflow is as follows:

  • Identify the issue
  • Create a Jira ticket
  • Develop, develop, develop
  • Submit the patch to GitHub
  • Create a pull request (PR)
  • PR review by another developer/community member
  • Update patch based on review
  • Approve and merge PR

CircleCI, our continuous integration system, takes over, checking code for compile errors, running tests, and building and publishing all the packages for a release.

Learn more about how you can contribute in this Discourse article.

Jira-GitHub development workflow

by Bonnie Robinson at September 02, 2021 06:51 PM

August 24, 2021

v2.3.0: build: OpenNMS.js 2.3.0

This release adds support for querying SNMP interfaces, monitored services, and outages.

by RangerRick at August 24, 2021 03:33 PM

August 23, 2021

OpenNMS.js v2.2.0

This release bumps a bunch of dependencies, plus it adds support for the api/v2/ipinterfaces API.

by RangerRick at August 23, 2021 09:03 PM

OpenNMS.js v2.1.1

This is a rerelease of 2.1.0 with a fix for documentation generation.

by RangerRick at August 23, 2021 09:03 PM

OpenNMS On the Horizon – Elasticsearch, Docs, Syslog, Flows, Cortex, Time-Series, Config Management, gRPC, Liquibase, Vue, Helm

Since last time, we worked on Elasticsearch bulk updating, tons of documentation improvements, syslog message processing, flow classification, Cortex in Nephron, time-series tag handling, the new config management API, gRPC support in the twin API, tests, internal stats, Liquibase, Vue UI and geomap, scheduled outages, and Helm.

Github Project Updates

Internals, APIs, and Documentation
  • Dustin did more work on bulk updating in Elasticsearch
  • Mark did more work on provisioning doc cleanups
  • I did a couple of dependency updates
  • Chandra worked on fixing syslog message hostname resolution
  • Stefan worked on improvements to the flow classification engine
  • Stefan continued his work on Cortex support in Nephron
  • Patrick did some work on improving tag handling in the time-series API
  • Freddy did more work on handling schemas and validation in the new config management API
  • Chandra worked on the gRPC implementation for the new twin API
  • Chandra fixed some timing issues in OpenConfig tests
  • Ronny updated the Minion docs to show how to configure SSL on the Karaf CLI
  • Yang Li worked on providing some additional information in the MBean stats collector
  • Marcel worked on cleaning up and rearranging the demon reload code
  • Patrick worked on moving to Liquibase 4 and using it for implementing config management updates
  • Bonnie and Mark did more work on table cleanups in the docs
  • Christian added some extra debug logging to the telemetry listeners
Web, ReST, UI, and Helm
  • Mike, Yang Li, Jesse, Sagar, and Tripti worked on the Vue PoC UI
  • Jane did more work on the Vue geomap
  • I added IP interface, SNMP interface, service, and outage support to the Helm entity datasource
  • Christian worked on some input validation in the web UI
  • Christian fixed a bug where you could create the same scheduled outage multiple times
  • Stefan added a Cortex-based flow deep-dive dashboard to Helm
Contributors

Thanks to the following contributors for committing changes since last OOH:

  • Benjamin Reed
  • Bonnie Robinson
  • Chandra Gorantla
  • Christian Pape
  • Dustin Frisch
  • Freddy Chu
  • Jane Hou
  • Jesse White
  • Marcel Fuhrmann
  • Mark Mahacek
  • Mike Rose
  • Patrick Schweizer
  • Ronny Trommer
  • Sagar Salunkhe
  • Stefan Wachter
  • Tripti Bansal
  • Yang Li

Release Roadmap

September Releases

OpenNMS is on a monthly release schedule, with releases happening on the second Wednesday of the month.

The next OpenNMS release day is September 8th, 2021.

We currently expect a Horizon 28.0.3 release.

Next Horizon: 29 (Q4 2021)

The next major Horizon release will be Horizon 29.

The current roadmap for Horizon 29 includes the following goals:

  • running as non-root by default
  • refactor the Minion's communication to get rid of out-of-band ReST calls to the OpenNMS core
  • add support for persistence of flows to Cortex
  • start the groundwork for replacing the topology UI with a pure-javascript version
Next Meridian: 2022 (Q? 2022)

With Meridian 2021 recently out, we do not yet have a specific timeline for Meridian 2022.

Expect it to include -- at the very least -- the JDK11 requirement and flow aggregation improvements from Horizon 28.
Ideally it will contain work going into Horizons 29 (and probably 30) if our timeline holds. 😅

Disclaimer

Note that this is just based on current plans; dates, features, and releases can change or slip depending on how development goes.

The statements contained herein may contain certain forward-looking statements relating to The OpenNMS Group that are based on the beliefs of the Group’s management as well as assumptions made by and information currently available to the Group’s management. These forward-looking statements are, by their nature, subject to significant risks and uncertainties.

...We apologize for the excessive disclaimers. Those responsible have been sacked.

Mynd you, møøse bites Kan be pretti nasti...

We apologise again for the fault in the disclaimers. Those responsible for sacking the people who have just been sacked have been sacked.

Until Next Time…

If there’s anything you’d like me to talk about in a future OOH, or you just have a comment or criticism you’d like to share, don’t hesitate to say hi.

- Ben

Resolved Issues Since Last OOH

  • NMS-845: Notification/Outage Notes
  • NMS-5350: Add comment field to discovery range
  • NMS-8968: OpenNMS Admin Guide HostResourceSwRunMonitor service-name not exact match string
  • NMS-13219: No warning message thrown when more than one Duplicate entry time applied during Outage creation
  • NMS-13366: Migrate VMware instructions from Wiki to Docs
  • NMS-13440: Update table formatting in detectors section of docs
  • NMS-13460: Implement gRPC broker for Object replication (Twin)
  • NMS-13471: GeoMap: Investigate the Vue3 reactivity in geomap page to sync the map, nodes and alarms subpages.
  • NMS-13472: Update table formatting in docs.
  • NMS-13482: Migrate foreign source content from Discourse to docs
  • NMS-13485: Syslog messages missing nodelabel, location, and interface
  • NMS-13502: Geo-Map: Nodes, Alrarm Grid and Leaflet map need to listen to the change of the Monitored Nodes

by RangerRick at August 23, 2021 07:28 PM

August 19, 2021

New Docs Part 2: The Gory Details

Continuous improvement is at the heart of Agile methodology: always striving to make changes that advance a project or team towards better results. This philosophy applies not just to code, but to documentation as well.

In a recent blog, we introduced our new rebranded documentation, with enhanced content and functionality. Complex projects, particularly open-source ones, benefit from effective easy-to-access documentation for improved user experience. They can also benefit from a “docs as code” approach, where, among other things, documentation builds are integrated with those of the software.

Technical implementation: how we got here

Since 2002, OpenNMS has treated docs like source code. Initially we used DocBook as the format for content creation, moving to AsciiDoc in 2015. AsciiDoc was extremely feature rich, and it was easy to integrate into our Java Maven pipeline, generated simple static single page HTML, and came with cascading style sheets (CSS). To generate the output, we ran a simple mvn install command in the docs directory.

This strategy grew challenging when we added Helm (our data visualization project) to the mix. Single-page HTML was cumbersome, especially in large docs. We split the docs into Developers, Admin, and Users sections, then gathered them under a single page. Ben Reed wrote a UI and integrated it into our CircleCI pipeline and release process.

As we added even more projects, we needed a solution that would allow for versioned docs, integrated into the release process, pulled from different GitHub repositories to a single location, all with the same format. Antora, made by the group behind AsciiDoc, addressed a lot of the issues we faced. Antora does not use a single page, handles docs from multiple individual versioned projects, uses AsciiDoc, and has a clear separation between the UI content assembly and content.

Search functionality

As part of our documentation upgrade, we explored several options to add search functionality to the documentation, eventually settling on Lunr, a JavaScript search index, because of its ease of implementation. We already had a big project simply migrating our existing documentation set to Antora (Agile=incremental improvements!), so went with a solution that quickly gave us basic search functionality.

In a single page HTML document you can easily use your browser search, but with Antora-built docs we don’t have this feature anymore. We started with the Antora Lunr integration. We create a search index at build time and ship it along with the page, and all the search is done in the browser.

Challenge 1: syntax updates

Unfortunately, the heading syntax required for Antora generation was slightly different from what we had been using. Because we also updated some of the content while we migrated to Antora, we couldn’t do a simple search and replace for the headings. Doing this manually (for the most part) on such a big documentation set was time-consuming.

Challenge 2: build integration

We had to refactor our CI/CD pipeline in CircleCI a bit. For all docs, we now build from a single docs repository. At this point, CircleCI had no webhooks to trigger a build and publish the docs to our website. We had to find a workaround with nightly scheduled build jobs. As the content grows, we can still build everything in under 10 minutes. However, we did notice that build jobs started to fail infrequently and ran out of memory. We gradually increased our build machines from a medium size (2CPU 4GB) to a larger machine (4CPU 8GB) over time to keep the jobs reliably running.

And of course, we needed to decide what to do with the old (pre-Antora) documentation set. We created an archive of the old documentation that users can access from the “Archived Docs” menu on the new documentation site.

Challenge 3: search functionality

Unfortunately, by design, the Lunr search creates one large index file during the build process. This takes up a lot of memory and may cause the build to time out. It also causes storage problems, since the project bundle is significantly larger than we would like. We are exploring other options to address this issue.

We might face some challenges here with the size of the index we need to ship. Going forward, we may investigate external search index providers like Algolia, which has a lot of adoption in the Antora community.

Challenge 4: search engine optimization (SEO)

Changing our docs website to docs.opennms.com would affect our SEO. To avoid delivering too many 404s, we set up redirects to the docs.opennms.com entry page, but in the end, you have to break eggs to make an omelet.

Next steps

Now that we have migrated to Antora, not only will we continue to update the docs to describe new features, we also plan to update existing documentation to correct errors, restructure/reorganize content to make it even easier for users to find the answers they need, and improve search functionality. What we are missing right now is also a “latest” or “current” floating tag. We have to reference docs in external links with a specific version number, which is addressed in the roadmap in Antora 3.0.

Thanks to the community

Kudos to the AsciiDoc and Antora community for developing these great tools, and for the excellent documentation, support, and forums. Our implementation was much easier because of this support.

How to contribute

Don’t forget that you can contribute to the OpenNMS documentation. For information on how to help, see Write and Build Documentation, join our Write the Docs channel on Mattermost, or join discussions on Discourse.

Thanks to Ronny Trommer for describing the technical side of our migration to Antora and our documentation creation process.

Under the Hood

The content on docs.opennms.com is driven by an Antora playbook in a GitHub repository named for the website: "docs.opennms.com". The playbook describes how to assemble, style, and publish the content. It runs in CircleCI and updates the docs nightly.

We pull in a UI bundle that defines the layout and how you use the docs. Each OpenNMS project has its own repository, and within that repo there is a docs directory where the documentation for that project lives. The Antora playbook has a reference to the docs git repository for each of the projects and pulls that source content in during build time.

When we make a release, we tag it with a version number in the content’s repository (for example, “1.0.2”). The docs/antora.yml file drives the version numbering in the docs, similar to the version number in a pom.xml.

With the next release, we get another version number, set it in the antora.yml, and on a CircleCI docs build Antora fetches only tags starting with v and generates the content from those tags.

by Bonnie Robinson at August 19, 2021 04:30 PM

August 16, 2021

OpenNMS On the Horizon – Syslog, DNS, Docs, Flows, Config Management, IFTTT, Vue UIs, Discovery ReST, Helm

Since last time, we worked on syslog DNS hostname resolution, provisioning docs, flapping tests, flow classification performance, config management, the IFTTT plugin, flow processing, form validation, Vue geomaps and UI proofs-of-concept, discovery config ReST APIs, and Helm ipInterface improvements.

Github Project Updates

Internals, APIs, and Documentation
  • Chandra worked on a fix and performance improvement for issues resolving hostnames for syslog messages.
  • Mark did more work on updated provisioning documentation.
  • I worked on fixing a few flapping tests.
  • Stefan implemented an improved decision tree for doing flow classification.
  • Freddy continued his work on implementing the new configuration management API.
  • Christian worked on fixing broken triggers in the IFTTT plugin.
  • Christian fixed a bug in flow processing when both the option and data record contain FIRST_SWITCHED or LAST_SWITCHED.
Web, ReST, UI, and Helm
  • Jeff did some work on cleaning up inputs on a few forms.
  • Jane worked on wrapping up her proof-of-concept Vue UI for geomaps.
  • Jesse and Mike continued the work on a proof-of-concept new OpenNMS UI using Vue.
  • Yang Li continued his work on expanding ReST APIs for the discovery and provisioning process.
  • I worked on adding ipinterface querying to the Helm entity datasource.
Contributors

Thanks to the following contributors for committing changes since last OOH:

  • Benjamin Reed
  • Chandra Gorantla
  • Christian Pape
  • Dustin Frisch
  • Freddy Chu
  • Jane Hou
  • Jeff Gehlbach
  • Jesse White
  • Mark Mahacek
  • Mike Rose
  • Patrick Schweizer
  • Stefan Wachter
  • Yang Li

Help Shape the Future of OpenNMS

As you may or may not have noticed from the commit messages in previous OOHs, we're starting to look into (finally!) reworking our UI beyond just the reskinning and tweaking we've done in the past.

Part of this involves actually bringing in folks who can help us do that. 😃

Chris Geyer joined the team as a UX Designer earlier this year, and he asked me to include this in OOH to make sure everyone sees it:

The OpenNMS community is central to what we do, and our product team wants to hear from you. Please fill out this quick survey so we can learn about you and your answers will help improve the experience of using OpenNMS going forward.

You can also sign up to volunteer to provide feedback on work in progress so that we can design new ideas that can help your network operations thrive.

Thanks in advance for your help!

https://www.opennms.com/opennms-user-survey/

I'm looking forward to starting to see some of this work come together, it's been a long time coming.

Release Roadmap

August Releases

In August, we released updates to all OpenNMS Meridian versions under active support, as well as an update to Horizon 28.
This is the final Meridian 2018 release, as it has reached end-of-life.

Horizon 28.0.2

Release 28.0.2 contains a bunch of bug fixes and enhancements, as well as some fixes for XSS issues and a Jetty CVE.

The codename for Horizon 28.0.2 is Soundwave.

For a high-level overview of what has changed in Horizon 28, see What’s New in OpenNMS Horizon 28.

A Note About Meridian 2018 and End of Life

This release marks 3 years of Meridian 2018, initially launched in September of 2018, so it is officially at its end of life as a supported release.
If you haven't already upgraded, consider this our strong encouragement to do so. :D

Additionally, here is the EOL schedule for the newer Meridian releases:

  • Meridian 2019 will expire in October of 2022
  • Meridian 2020 will expire in September of 2023
  • Meridian 2021 will expire in April of 2024
Meridian Point Releases

All Meridian releases this month contained security updates, so it is recommended that you upgrade.

Additionally, 2020.1.11 adds a fix for a potential OOM on the Minion if off-heap storage is enabled for forwarding.

On top of that, 2021.1.3 adds documentation fixes, and a performance enhancement to the node cache used when processing flows.

For a list of changes, see the release notes:

September Releases

OpenNMS is on a monthly release schedule, with releases happening on the second Wednesday of the month.

The next OpenNMS release day is September 8th, 2021.

We currently expect a Horizon 28.0.3 release.

Next Horizon: 29 (Q4 2021)

The next major Horizon release will be Horizon 29.

The current roadmap for Horizon 29 includes the following goals:

  • running as non-root by default
  • refactor the Minion's communication to get rid of out-of-band ReST calls to the OpenNMS core
  • add support for persistence of flows to Cortex
  • start the groundwork for replacing the topology UI with a pure-javascript version
Next Meridian: 2022 (Q? 2022)

With Meridian 2021 recently out, we do not yet have a specific timeline for Meridian 2022.

Expect it to include -- at the very least -- the JDK11 requirement and flow aggregation improvements from Horizon 28.
Ideally it will contain work going into Horizons 29 (and probably 30) if our timeline holds. 😅

Disclaimer

Note that this is just based on current plans; dates, features, and releases can change or slip depending on how development goes.

The statements contained herein may contain certain forward-looking statements relating to The OpenNMS Group that are based on the beliefs of the Group’s management as well as assumptions made by and information currently available to the Group’s management. These forward-looking statements are, by their nature, subject to significant risks and uncertainties.

...We apologize for the excessive disclaimers. Those responsible have been sacked.

Mynd you, møøse bites Kan be pretti nasti...

We apologise again for the fault in the disclaimers. Those responsible for sacking the people who have just been sacked have been sacked.

Until Next Time…

If there’s anything you’d like me to talk about in a future OOH, or you just have a comment or criticism you’d like to share, don’t hesitate to say hi.

- Ben

Resolved Issues Since Last OOH

  • NMS-7241: Enhance geographical map to work with openstreetmap offline map
  • NMS-13282: Nephron RandomFlowIT flaps in CircleCI
  • NMS-13422: Add the full trap oid for v2 snmp event
  • NMS-13436: Docker not able to access etc overlay as non-root
  • NMS-13451: GeoMap: Temporary use existing OpenNMS RESTful APIs to get some real data
  • NMS-13454: Geo-map: use Vuex to manage nodes info retrieved from OpenNMS
  • NMS-13462: Implement In-memory broker for Object replication ( Twin)
  • NMS-13478: Changes to review bulk indexing with raw flow data
  • NMS-13481: Optimize node cache refresh to be non-blocking to flow data
  • NMS-13486: Minions > v27.0.0 stop processing flows after apprx 5 minutes
  • NMS-13501: IFTTT integration not working anymore

by RangerRick at August 16, 2021 05:45 PM

August 11, 2021

August 2021 Releases – Horizon 28.0.2, Meridians 2021.1.3, 2020.1.11, 2019.1.22, 2018.1.31

In August, we released updates to all OpenNMS Meridian versions under active support, as well as an update to Horizon 28. This is the final Meridian 2018 release, as it has reached end-of-life.

Horizon 28.0.2

Release 28.0.2 contains a bunch of bug fixes and enhancements, as well as some fixes for XSS issues and a Jetty CVE.

The codename for Horizon 28.0.2 is Soundwave.

For a high-level overview of what has changed in Horizon 28, see What’s New in OpenNMS Horizon 28.

A Note About Meridian 2018 and End of Life

This release marks 3 years of Meridian 2018, initially launched in September of 2018, so it is officially at its end of life as a supported release.
If you haven't already upgraded, consider this our strong encouragement to do so. :D

Additionally, here is the EOL schedule for the newer Meridian releases:

  • Meridian 2019 will expire in October of 2022
  • Meridian 2020 will expire in September of 2023
  • Meridian 2021 will expire in April of 2024

Meridian Point Releases

All Meridian releases this month contained security updates, so it is recommended that you upgrade.

Additionally, 2020.1.11 adds a fix for a potential OOM on the Minion if off-heap storage is enabled for forwarding.

On top of that, 2021.1.3 adds documentation fixes, and a performance enhancement to the node cache used when processing flows.

For a list of changes, see the release notes:

by RangerRick at August 11, 2021 08:59 PM

August 09, 2021

OpenNMS On the Horizon – Docs, Nephron, Flows, Config Management, Cortex, Twin API, gRPC, Trapd, Non-Root, Vue, Maps, Web

Since last time, we did more work on documentation, Nephron and flows, config management, Cortex, the Twin API, Trapd, running as non-root, Vue Geomaps, and web input handling.

Also, Tarus Balog − the original project steward of OpenNMS and a co-founder of The OpenNMS Group − announced his departure this morning. The network monitoring landscape would not be the same without you, and we wish you luck on your next act.

Github Project Updates

Internals, APIs, and Documentation
  • Bonnie and Mark did more work on various cleanups in topology and provisioning-related documentation.
  • Bonnie and Mark continued their work on doc table formatting cleanups.
  • Stefan merged his fixes to flapping Nephron tests.
  • Freddy continued his work on the new config management API.
  • Chandra worked on diagnosing a bug in flow processing.
  • Stefan continued his work on Cortex flow aggregation and labeling.
  • Yang Li continued his work on config management APIs.
  • Chandra worked on a gRPC implementation of the new Twin synchronization API.
  • Dustin started working on implementing Trapd config support for the Twin API.
  • Dustin created an in-memory implementation of the Twin API.
  • I did more work on trying to wrap up run-as-non-root issues.
Web, ReST, UI, and Helm
  • Jane continued her work on building a proof-of-concept geomap in Vue.
  • Jeff updated the notice wizard to handle input better.
Contributors

Thanks to the following contributors for committing changes since last OOH:

  • Benjamin Reed
  • Bonnie Robinson
  • Chandra Gorantla
  • Dustin Frisch
  • Freddy Chu
  • Jane Hou
  • Jeff Gehlbach
  • Mark Mahacek
  • Patrick Schweizer
  • Stefan Wachter
  • Yang Li

Release Roadmap

August Releases

OpenNMS is on a monthly release schedule, with releases happening on the second Wednesday of the month.

The next OpenNMS release day is August 11th, 2021.

We currently expect a Horizon 28.0.2 release, plus updates to all supported Meridian releases.

Next Horizon: 29 (Q4 2021)

The next major Horizon release will be Horizon 29.

The current roadmap for Horizon 29 includes the following goals:

  • running as non-root by default
  • refactor the Minion's communication to get rid of out-of-band ReST calls to the OpenNMS core
  • add support for persistence of flows to Cortex
  • start the groundwork for replacing the topology UI with a pure-javascript version
Next Meridian: 2022 (Q? 2022)

With Meridian 2021 recently out, we do not yet have a specific timeline for Meridian 2022.

Expect it to include -- at the very least -- the JDK11 requirement and flow aggregation improvements from Horizon 28.
Ideally it will contain work going into Horizons 29 (and probably 30) if our timeline holds. 😅

Disclaimer

Note that this is just based on current plans; dates, features, and releases can change or slip depending on how development goes.

The statements contained herein may contain certain forward-looking statements relating to The OpenNMS Group that are based on the beliefs of the Group’s management as well as assumptions made by and information currently available to the Group’s management. These forward-looking statements are, by their nature, subject to significant risks and uncertainties.

...We apologize for the excessive disclaimers. Those responsible have been sacked.

Mynd you, møøse bites Kan be pretti nasti...

We apologise again for the fault in the disclaimers. Those responsible for sacking the people who have just been sacked have been sacked.

Until Next Time…

If there’s anything you’d like me to talk about in a future OOH, or you just have a comment or criticism you’d like to share, don’t hesitate to say hi.

- Ben

Resolved Issues Since Last OOH

  • NMS-1231: Change the webUI so it runs as a non-root user easily and reliably
  • NMS-11730: The Dev Documentation doesn't have information about the Hardware Inventory
  • NMS-11970: Create opennms user on install
  • NMS-11982: syslogd as non-root user
  • NMS-12005: opennms.service in non-root environment
  • NMS-12007: opennms init script "runas" setting
  • NMS-12026: TrapD won't run as non-root user
  • NMS-12978: Add missing Prometheus collectd example in our documenation
  • NMS-13370: Hardware Inventory Plugin needs docs
  • NMS-13457: Geo-map POC: Investigate using AG-Grid to display nodes list on the geo-map page
  • NMS-13459: Unable to create report on Horizon 28.0.1
  • NMS-13466: Nephron: add more tests

by RangerRick at August 09, 2021 07:10 PM

On Leaving OpenNMS

It is with mixed emotions that I am letting everyone know that I’m no longer associated with The OpenNMS Group.

Two years ago I was in a bad car accident. I suffered some major injuries which required 33 nights in the hospital, five surgeries and several months in physical therapy. What was surprising is that while I had always viewed myself as somewhat indispensable to the OpenNMS Project, it got along fine without me.

Also during this time, The OpenNMS Group was acquired. For fifteen years we had survived on the business plan of “spend less money than you earn”. While it ensured the longevity of the company and the project, it didn’t allow much room for us to pursue ideas because we had no way to fund them. We simply did not have the resources.

Since the acquisition, both the company and the project have grown substantially, and this was during a global pandemic. With OpenNMS in such a good place I began to think, for the first time in twenty years, about other options.

I started working with OpenNMS in September of 2001. I refer to my professional career before then as “Act I”, with my time at OpenNMS as “Act II”. I’m now ready to see what “Act III” has in store.

While I’m excited about the possibilities, I will miss working with the OpenNMS team. They are an amazing group of people, and it will be hard to replace the role they played in my life. I’m also eternally grateful to the OpenNMS Community, especially the guys in the Order of the Green Polo who kept the project alive when we were starting out. You are and always will be my friends.

When I was responsible for hiring at OpenNMS, I ended every offer letter with “Let’s go do great things”. I consider OpenNMS to be a “great thing” and I am eager to watch it thrive with its new investment, and I will always be proud of the small role I played in its success.

If you are doing great things and think I could contribute to your team, check out my profile on LinkedIn or Xing.

by Tarus at August 09, 2021 12:30 PM

August 05, 2021

How to: Store data with foreign sources

If you use Provisiond to populate all or part of your node database, you may want to define how data is stored so that it remains in the same directory even if a nodeID changes. Mark Mahacek, Senior Application Support Engineer at The OpenNMS Group, shares how to do this in Storing data with foreign sources on Discourse.

by Bonnie Robinson at August 05, 2021 03:00 PM

August 02, 2021

OpenNMS On the Horizon – Non-Root, Docs, Minion Replication, JDK11, Flows, Cortex, Config API, Elasticsearch, Discovery, ReST, Vue, Geomaps

Since last time, we worked on running as non-root, doc updates for provisioning and table formatting, the twin Minion replication API, JDK11 build cleanups, Cortex flow persist support, the new config API, bulk flow persisting in Elasticsearch, Discovery ReST APIs, Vue geomap and UI proof-of-concepts.

Github Project Updates

Internals, APIs, and Documentation
  • I fixed an issue with relaunching startup as opennms.
  • Mark did more work on his provisioning docs refresh.
  • Chandra did more work on the Twin object replication API.
  • Bonnie continued the work to clean up table formatting in the docs.
  • I did some more final cleanup on the IP interface primary type query issue.
  • I continued to work on diagnosing issues with run-as-non-root and Docker.
  • I fixed a couple of JDK11-related issues in the 28 branch.
  • Stefan did more work on Cortex support in Nephron.
  • Freddy did more work on the new config API implementation.
  • Dustin fixed an issue with reloading the interface node cache.
  • Dustin worked on bulk persisting support for Elasticsearch flows.
Web, ReST, UI, and Helm
  • Yang Li continued to work on new ReST APIs, for discovery and SNMP service detection.
  • Jane continued her work on the Vue-based geomap proof of concept.
  • Mike did more work on the Vue-based mockup UI.
Contributors

Thanks to the following contributors for committing changes since last OOH:

  • Benjamin Reed
  • Bonnie Robinson
  • Chandra Gorantla
  • Dustin Frisch
  • Freddy Chu
  • Jane Hou
  • Mark Mahacek
  • Mike Rose
  • Stefan Wachter
  • Yang Li

Release Roadmap

August Releases

OpenNMS is on a monthly release schedule, with releases happening on the second Wednesday of the month.

The next OpenNMS release day is August 11th, 2021.

We currently expect a Horizon 28.0.2 release, plus updates to all supported Meridian releases.

Next Horizon: 29 (Q4 2021)

The next major Horizon release will be Horizon 29.

The current roadmap for Horizon 29 includes the following goals:

  • running as non-root by default
  • refactor the Minion's communication to get rid of out-of-band ReST calls to the OpenNMS core
  • add support for persistence of flows to Cortex
  • start the groundwork for replacing the topology UI with a pure-javascript version
Next Meridian: 2022 (Q? 2022)

With Meridian 2021 recently out, we do not yet have a specific timeline for Meridian 2022.

Expect it to include -- at the very least -- the JDK11 requirement and flow aggregation improvements from Horizon 28.
Ideally it will contain work going into Horizons 29 (and probably 30) if our timeline holds. 😅

Disclaimer

Note that this is just based on current plans; dates, features, and releases can change or slip depending on how development goes.

The statements contained herein may contain certain forward-looking statements relating to The OpenNMS Group that are based on the beliefs of the Group’s management as well as assumptions made by and information currently available to the Group’s management. These forward-looking statements are, by their nature, subject to significant risks and uncertainties.

...We apologize for the excessive disclaimers. Those responsible have been sacked.

Mynd you, møøse bites Kan be pretti nasti...

We apologise again for the fault in the disclaimers. Those responsible for sacking the people who have just been sacked have been sacked.

Until Next Time…

If there’s anything you’d like me to talk about in a future OOH, or you just have a comment or criticism you’d like to share, don’t hesitate to say hi.

- Ben

Resolved Issues Since Last OOH

  • HELM-292: String values not available
  • NMS-8150: Add tip for Certificates which does not conform to algorithm constraints
  • NMS-8368: iplike installation fails during OpenNMS installation
  • NMS-8369: package installation misses installing jrrd2, referring non-existing wiki/web page
  • NMS-8553: Trapd
  • NMS-8560: SnmpPoller
  • NMS-8634: Document the /rest/graphs endpoint
  • NMS-9189: Link points to null page (404 error)
  • NMS-13354: OpenAPI spec fails validation
  • NMS-13401: Define Minion/OpenNMS Object replication Interfaces
  • NMS-13450: Geo-map POC: RESTful call to OpenNMS backend with basic auth
  • NMS-13456: Update table formatting in collectors section of docs
  • NMS-13469: Fix ipInterface PrimaryType Hibernate mapping

by RangerRick at August 02, 2021 04:56 PM

July 26, 2021

OpenNMS On the Horizon – Config Manager API, Docs, Non-Root, Twin API, Nephron, Vue Maps, Discovery ReST

Since last time, we worked on the new config API, more doc updates, non-root fixes, the new Twin API, Nephron, Vue geomaps, and a discovery ReST API.

Github Project Updates

Internals, APIs, and Documentation
  • Chandra worked on SNMP trap handling user config updates.
  • Bonnie updated documentation for the search panel.
  • Bonnie and Mark did more work on fixing up table formatting in the docs, plus data collection improvements.
  • I made some updates to the RUNAS changes in develop.
  • Stefan fixed a race condition in the sink dispatcher.
  • Chandra continued his work on a proof-of-concept API for disseminating config updates to Minions (called the "Twin API").
  • Mark continued his work on cleaning up provisioning docs.
  • I worked on some outstanding dependency updates.
  • Freddy continued to work on the new config manager API.
  • I worked on fixing some smoke test issues related to the recent default-localhost changes.
  • Stefan did some more work on the Nephron test framework and test fixes.
Web, ReST, UI, and Helm
  • Jane continued her work on a vue-based geomaps replacement proof-of-concept.
  • Yang Li worked on a simple discovery ReST service.
  • I continued to work on wrapping up my ReST fixes for querying nodes and interfaces by SNMP primary status.
Contributors

Thanks to the following contributors for committing changes since last OOH:

  • Benjamin Reed
  • Bonnie Robinson
  • Chandra Gorantla
  • Freddy Chu
  • Jane Hou
  • Mark Mahacek
  • Maxim Brener
  • Stefan Wachter
  • Yang Li

Release Roadmap

August Releases

OpenNMS is on a monthly release schedule, with releases happening on the second Wednesday of the month.

The next OpenNMS release day is August 11th, 2021.

We currently expect a Horizon 28.0.2 release, plus updates to all supported Meridian releases.

Next Horizon: 29 (Q4 2021)

The next major Horizon release will be Horizon 29.

The current roadmap for Horizon 29 includes the following goals:

  • running as non-root by default
  • refactor the Minion's communication to get rid of out-of-band ReST calls to the OpenNMS core
  • add support for persistence of flows to Cortex
  • start the groundwork for replacing the topology UI with a pure-javascript version
Next Meridian: 2022 (Q? 2022)

With Meridian 2021 recently out, we do not yet have a specific timeline for Meridian 2022.

Expect it to include -- at the very least -- the JDK11 requirement and flow aggregation improvements from Horizon 28.
Ideally it will contain work going into Horizons 29 (and probably 30) if our timeline holds. 😅

Disclaimer

Note that this is just based on current plans; dates, features, and releases can change or slip depending on how development goes.

The statements contained herein may contain certain forward-looking statements relating to The OpenNMS Group that are based on the beliefs of the Group’s management as well as assumptions made by and information currently available to the Group’s management. These forward-looking statements are, by their nature, subject to significant risks and uncertainties.

...We apologize for the excessive disclaimers. Those responsible have been sacked.

Mynd you, møøse bites Kan be pretti nasti...

We apologise again for the fault in the disclaimers. Those responsible for sacking the people who have just been sacked have been sacked.

Until Next Time…

If there’s anything you’d like me to talk about in a future OOH, or you just have a comment or criticism you’d like to share, don’t hesitate to say hi.

- Ben

Resolved Issues Since Last OOH

  • HELM-66: Documentation using Grafana templating with PM/FM datasources
  • NMS-10180: Gathering Documentation
  • NMS-11965: Automate copyright dates in docs
  • NMS-13375: Investigate the Conversations related performance with Cortex & large amount of data
  • NMS-13381: Implement RPC from minion to opennms
  • NMS-13403: Nephron: More than one FlowSummary per window/key
  • NMS-13405: OutOfMemory issue on Minion ( corner case related to Offheap)
  • NMS-13408: Document search panel
  • NMS-13424: Investigate integrate Leaflet with Vue3 for OpenNMS geo map
  • NMS-13431: Initiate Vue3 code for geo-map
  • NMS-13470: Relaunch of bin/opennms script as opennms user fails due to missing arguments

by RangerRick at July 26, 2021 04:02 PM

July 22, 2021

How to: Troubleshoot Minion Connectivity and Functions

The OpenNMS Minion includes useful, built-in commands to verify configuration and debug access to management agents.

In this Discourse article, Ronny Trommer, Community/Product Manager at The OpenNMS Group, shows how to test connectivity with the Minion, perform a health check, execute a remote ping to arbitrary FQDNs or IP addresses, execute remote DNS lookups, run SNMP commands from the core OpenNMS instance to a device behind a Minion in a remote network, and run a monitor through a Minion.

More information:

A Minion is a lightweight stateless service that lets OpenNMS communicate with devices and services in hard-to-reach locations. Minions are best suited for deployment at remote locations that the core OpenNMS server may not have direct access to. For more information on Minion, see the whitepaper and data sheet on the OpenNMS Resources web page.

by Bonnie Robinson at July 22, 2021 09:00 AM

July 19, 2021

OpenNMS On the Horizon – Docs, Non-Root, Time-Series, Telemetryd, Karaf, VMware, Docker, Vue

Since last time, we worked on more documentation, running as non-root, time-series API enhancements, a Telemetryd Karaf CLI, VMware script fixes, Docker Content Trust, and various Vue3 UI exploration.

Github Project Updates

Internals, APIs, and Documentation
  • Mark did more work on cleaning up various provisioning and detector documentation.
  • I worked on more fixes to the changes for running OpenNMS as non-root.
  • Patrick did more work on wrapping up his tag enhancements to the time-series API.
  • Bonnie updated a bunch of monitor docs and added docs on the search bar, plus other table formatting fixes.
  • Chandra did more work on his PoC of a state-sync API for Minion and OpenNMS communication.
  • Dustin wrapped up his code to add a Karaf CLI for examining Telemetryd.
  • Christian fixed a missing jar dependency in the VMware scripts.
  • I fixed an issue with Docker Content Trust signing not being triggered in certain build branches.
  • Marcel enhanced the Prometheus exporter docs.
  • I worked on bumping a number of our dependencies to newer versions.
Web, ReST, UI, and Helm
  • Mike and Freddy did more work on a Vue 3 PoC UI.
  • I continued my work on cleaning up the IP interface model to make it ReST queryable.
  • Jane continued her work exploring technology to be used in a Vue-based topology UI.
Contributors

Thanks to the following contributors for committing changes since last OOH:

  • Benjamin Reed
  • Bonnie Robinson
  • Chandra Gorantla
  • Christian Pape
  • Dustin Frisch
  • Freddy Chu
  • Jane Hou
  • Marcel Fuhrmann
  • Mark Mahacek
  • Mike Rose
  • Patrick Schweizer
  • Ronny Trommer
  • Stefan Wachter

Release Roadmap

July Releases

In July, we released updates to all OpenNMS Meridian versions under active support, as well as an update to Horizon 28.

Horizon 28.0.1

Release 28.0.1 contains a bunch of bug fixes and enhancements, plus a few security updates.

The codename for Horizon 28.0.1 is Optimus Prime.

For a high-level overview of what has changed in Horizon 28, see What’s New in OpenNMS Horizon 28.

Meridian Point Releases

All Meridian releases this month contained security updates, so it is recommended that you upgrade.

Starting in Meridian 2019, improvements to the Kafka provider were added, and Meridian 2021 includes a bunch of other small bug fixes and enhancements.

For a list of changes, see the release notes:

August Releases

OpenNMS is on a monthly release schedule, with releases happening on the second Wednesday of the month.

The next OpenNMS release day is August 11th, 2021.

We currently expect a Horizon 28.0.2 release, plus updates to Meridian 2021.

Next Horizon: 29 (Q4 2021)

The next major Horizon release will be Horizon 29.

The current roadmap for Horizon 29 includes the following goals:

  • running as non-root by default
  • refactor the Minion's communication to get rid of out-of-band ReST calls to the OpenNMS core
  • add support for persistence of flows to Cortex
  • start the groundwork for replacing the topology UI with a pure-javascript version
Next Meridian: 2022 (Q? 2022)

With Meridian 2021 recently out, we do not yet have a specific timeline for Meridian 2022.

Expect it to include -- at the very least -- the JDK11 requirement and flow aggregation improvements from Horizon 28.
Ideally it will contain work going into Horizons 29 (and probably 30) if our timeline holds. 😅

Disclaimer

Note that this is just based on current plans; dates, features, and releases can change or slip depending on how development goes.

The statements contained herein may contain certain forward-looking statements relating to The OpenNMS Group that are based on the beliefs of the Group’s management as well as assumptions made by and information currently available to the Group’s management. These forward-looking statements are, by their nature, subject to significant risks and uncertainties.

...We apologize for the excessive disclaimers. Those responsible have been sacked.

Mynd you, møøse bites Kan be pretti nasti...

We apologise again for the fault in the disclaimers. Those responsible for sacking the people who have just been sacked have been sacked.

Until Next Time…

If there’s anything you’d like me to talk about in a future OOH, or you just have a comment or criticism you’d like to share, don’t hesitate to say hi.

- Ben

Resolved Issues Since Last OOH

  • NMS-8050: Documentation for Cassandra/Newts doesn't mention how to setup cassandra
  • NMS-8230: Database Report section in Admin Guide seems not merged correctly
  • NMS-8662: Create documentation for filter criteria
  • NMS-9521: Reorder the sections in the admin guide for better flow
  • NMS-11774: Improve install guide with SELinux and Firewall
  • NMS-11786: Create performance data collection user documentation
  • NMS-11798: Add information to the WEB GUI in the building rules area for notifications
  • NMS-11895: Create documentation for Enhanced Linkd
  • NMS-11939: User documentation for Enhanced Linkd
  • NMS-12011: Document best practices for tuning Newts
  • NMS-12373: Admin guide still uses deprecated term "provisioning group" in places
  • NMS-13005: Create docs about Newts confd parameters
  • NMS-13356: TSS 2.0: Improved Tag handling
  • NMS-13364: Table formatting issue in new docs
  • NMS-13434: Upgrade Influxdb plubin to TSS2.0
  • NMS-13444: vmwareconfigbuilder and vmwarecimquery not working anymore
  • NMS-13448: Doc typos - improper character escaping

by RangerRick at July 19, 2021 04:38 PM

July 14, 2021

July 2021 Releases – Horizon 28.0.1, Meridians 2021.1.2, 2020.1.10, 2019.1.21, 2018.1.30

In July, we released updates to all OpenNMS Meridian versions under active support, as well as an update to Horizon 28.

Horizon 28.0.1

Release 28.0.1 contains a bunch of bug fixes and enhancements, plus a few security updates.

The codename for Horizon 28.0.1 is Optimus Prime.

For a high-level overview of what has changed in Horizon 28, see What’s New in OpenNMS Horizon 28.

Meridian Point Releases

All Meridian releases this month contained security updates, so it is recommended that you upgrade.

Starting in Meridian 2019, improvements to the Kafka provider were added, and Meridian 2021 includes a bunch of other small bug fixes and enhancements.

For a list of changes, see the release notes:

by RangerRick at July 14, 2021 09:00 AM

July 12, 2021

OpenNMS On the Horizon – Docs, Vue UI, Config API, JDK17, Time-Series, Docker, Kafka, Nephron, Catheter, Health Check, ReST

Since last time, we continued to work on documentation improvements and a new experimental Vue-based UI, plus the unified config API, JDK17 support, Time-Series API enhancements, Docker image improvements, Kafka CollectionSet enhancements, Nephron and Catheter, Health Check, and ReST query fixes.

Github Project Updates

Internals, APIs, and Documentation
  • Patrick worked on implementing reading the Vacuumd configuration in the new config API.
  • Patrick made some collection API updates to use regular matching.
  • I did more fiddling with OpenJDK 17 support.
  • Patrick worked on some more time-series API improvements.
  • Jian worked on documenting ActiveMQ tuning, plus some other documentation improvements.
  • Marcel added diffutils to the Horizon Docker image.
  • Ronny updated the docs for tuning Kafka.
  • Mark continued his work on improving Provisiond documentation, plus some other doc updates.
  • I worked on a number of bugfixes related to running OpenNMS as root.
  • Stefan worked on improvements to Nephron's handling of late and out-of-order data.
  • Bonnie has been working on making table layouts in the new documentation better.
  • Chandra worked on some fixes to the Kafka producer to split large collection sets into chunks.
  • Chandra also added some additional useful fields to the CollectionSet protobuf.
  • Ronny moved some dependencies to the base deployment Docker image so that updates download fewer changes.
  • Stefan worked on improvements to the Catheter test harness for Nephron.
Web, ReST, UI, and Helm
  • Jerry worked on a basic ReST server for the config API.
  • Jane made some improvements to the health check ReST API.
  • Mike worked on some more UI plumbing for the new Vue3 UI mockup, including sidebar changes and search.
  • I worked on fixing IP interface querying by SNMP primary type in the ReST interface.
Contributors

Thanks to the following contributors for committing changes since last OOH:

  • Benjamin Reed
  • Bonnie Robinson
  • Chandra Gorantla
  • Jane Hou
  • Jerry Beuree
  • Jesse White
  • Jian Yet Lee
  • Marcel Fuhrmann
  • Mark Mahacek
  • Mike Rose
  • Patrick Schweizer
  • Ronny Trommer
  • Stefan Wachter

Release Roadmap

Reminder: New Release Schedule

(Reposting from last OOH, in case you missed it.)

As this month shows, it turns out to be kind of a pain to come back from a holiday and immediately try to put out releases.

After looking at the calendar, where holidays lie, and what works best for fitting into sprints, we have decided to move the release day forward.

The new release schedule is: second Wednesday of the month.

This means the July releases move foward to Wednesday, July 14th.

July Releases

OpenNMS is on a monthly release schedule, with releases happening on the second Wednesday of the month.

The next OpenNMS release day is July 14th, 2021.

We currently expect a Horizon 28.0.1 release, plus updates for all supported Meridian releases.

Next Horizon: 29 (Q4 2021)

The next major Horizon release will be Horizon 29.

The current roadmap for Horizon 29 includes the following goals:

  • running as non-root by default
  • refactor the Minion's communication to get rid of out-of-band ReST calls to the OpenNMS core
  • add support for persistence of flows to Cortex
  • start the groundwork for replacing the topology UI with a pure-javascript version
Next Meridian: 2022 (Q? 2022)

With Meridian 2021 recently out, we do not yet have a specific timeline for Meridian 2022.

Expect it to include -- at the very least -- the JDK11 requirement and flow aggregation improvements from Horizon 28.
Ideally it will contain work going into Horizons 29 (and probably 30) if our timeline holds. 😅

Disclaimer

Note that this is just based on current plans; dates, features, and releases can change or slip depending on how development goes.

The statements contained herein may contain certain forward-looking statements relating to The OpenNMS Group that are based on the beliefs of the Group’s management as well as assumptions made by and information currently available to the Group’s management. These forward-looking statements are, by their nature, subject to significant risks and uncertainties.

...We apologize for the excessive disclaimers. Those responsible have been sacked.

Mynd you, møøse bites Kan be pretti nasti...

We apologise again for the fault in the disclaimers. Those responsible for sacking the people who have just been sacked have been sacked.

Until Next Time…

If there’s anything you’d like me to talk about in a future OOH, or you just have a comment or criticism you’d like to share, don’t hesitate to say hi.

- Ben

Resolved Issues Since Last OOH

  • NMS-13191: Improve usability and self-contained features of the Kafka Producer payload for metrics
  • NMS-13407: Limit CollectionSet size in Kafka Producer to less than 1MB.
  • NMS-13412: The PageSequenceMonitor keys host and virtual-host are confusing
  • NMS-13415: Installation with non-root user failes on CentOS 8
  • NMS-13417: Starting opennms with systemd as non-root fails with access denied for pid
  • NMS-13425: Docs: Add configuration example in tuning activemq
  • NMS-13426: Misc documentation fixes
  • NMS-13432: Remove remote repository dependencies during Minion OCI build
  • NMS-13433: Only publish Docker images when system tests are green

by RangerRick at July 12, 2021 05:39 PM

July 06, 2021

OpenNMS On the Horizon – Cortex, DCT, Minion, Nephron, Non-Root, IPLIKE, Flows, Vue, Helm, Docs, New Release Day

Since last time, we worked on Cortex flow export, Docker Content Trust signing for Minion, Nephron improvements, fixes for running as non-root, IPLIKE, default flow configs, a new Vue UI, and Helm, plus documentation for filter rules, firewall settings, host resource monitor, SNMP config ReST API, FTP and BSF detectors, ActiveMQ tuning, provisioning, and table formatting.

Github Project Updates

Internals, APIs, and Documentation
  • Stefan started laying the groundwork for exporting flows to Cortex time-series database.
  • Stefan and I wrapped up getting Docker Content Trust set up for Minion image deployment.
  • Bonnie worked on a buttload of filter rule docs (she's in Canada, so it's a metric buttload).
  • Ronny worked on some doc changes for firewall updates for non-root OpenNMS.
  • Mark worked on some doc fixes for the host resource monitor and SNMP config ReST API.
  • Stefan worked on some updates to Nephron to better-handle unaligned flow windows.
  • I did some bug fixes to the OpenNMS-as-non-root packaging.
  • Chandra worked on some optimizations to his enhancements to provide extra metadata in tha Kafka collection sets.
  • Stefan made more enhancements to his Nephron testing framework.
  • I updated the IPLIKE Debian packages to no longer symlink the .so file into the OpenNMS directory for no good reason.
  • Marcel did some updates to the FTP and BSF detector docs.
  • JianYet worked on some docs for ActiveMQ tuning.
  • Mark and Ronny did a bunch of provisioning doc updates.
  • Stefan updated the Minion RPM and Debian packages to have a default flow config. (The Docker image will use confd instead.)
  • Bonnie worked on cleaning up the table formatting in our Antora docs.
Web, ReST, UI, and Helm
  • Mike did more work on a Vue-based UI mockup.
  • I worked on Helm updates to fix some plugin validation errors.
Contributors

Thanks to the following contributors for committing changes since last OOH:

  • Benjamin Reed
  • Bonnie Robinson
  • Chandra Gorantla
  • Dustin Frisch
  • JianYet Lee
  • Marcel Fuhrmann
  • Mark Mahacek
  • Mike Rose
  • Ronny Trommer
  • Stefan Wachter

Release Roadmap

New Release Schedule

As this month shows, it turns out to be kind of a pain to come back from a holiday and immediately try to put out releases.

After looking at the calendar, where holidays lie, and what works best for fitting into sprints, we have decided to move the release day forward.

The new release schedule is: second Wednesday of the month.

This means the July releases move foward to Wednesday, July 14th.

July Releases

OpenNMS is on a monthly release schedule, with releases happening on the second Wednesday of the month.

The next OpenNMS release day is July 14th, 2021.

We currently expect a Horizon 28.0.1 release, plus updates for all supported Meridian releases.

Next Horizon: 29 (Q4 2021)

The next major Horizon release will be Horizon 29.

The current roadmap for Horizon 29 includes the following goals:

  • running as non-root by default
  • refactor the Minion's communication to get rid of out-of-band ReST calls to the OpenNMS core
  • add support for persistence of flows to Cortex
  • start the groundwork for replacing the topology UI with a pure-javascript version
Next Meridian: 2022 (Q? 2022)

With Meridian 2021 recently out, we do not yet have a specific timeline for Meridian 2022.

Expect it to include -- at the very least -- the JDK11 requirement and flow aggregation improvements from Horizon 28.
Ideally it will contain work going into Horizons 29 (and probably 30) if our timeline holds. 😅

Disclaimer

Note that this is just based on current plans; dates, features, and releases can change or slip depending on how development goes.

The statements contained herein may contain certain forward-looking statements relating to The OpenNMS Group that are based on the beliefs of the Group’s management as well as assumptions made by and information currently available to the Group’s management. These forward-looking statements are, by their nature, subject to significant risks and uncertainties.

...We apologize for the excessive disclaimers. Those responsible have been sacked.

Mynd you, møøse bites Kan be pretti nasti...

We apologise again for the fault in the disclaimers. Those responsible for sacking the people who have just been sacked have been sacked.

Until Next Time…

If there’s anything you’d like me to talk about in a future OOH, or you just have a comment or criticism you’d like to share, don’t hesitate to say hi.

- Ben

Resolved Issues Since Last OOH

  • NMS-10538: HostResourceSwRunMonitor: Fix SNMP OIDs in Documentation
  • NMS-10710: Move filter rule documentation to admin guide
  • NMS-13073: Create BSFDetector documenation
  • NMS-13265: Confd doesn't replace telemetryd config in etc
  • NMS-13318: Use DCT to secure the Minion image
  • NMS-13339: Create FtpDetector docs
  • NMS-13345: Setup DCT keys for the OpenNMS and OpenNMS-Forge organizations
  • NMS-13346: Add debug insight to session state in netflow parsers
  • NMS-13357: Lever regex for indexing of resource paths (resorceId)
  • NMS-13358: Move Resource Metadata Handling to TS
  • NMS-13359: Improved Visibility into Tags
  • NMS-13369: Add tags as query params to /health/probe Rest API
  • NMS-13393: Investigate Vue3 features
  • NMS-13394: Investigate Leaflet for OpenNMS geo-map
  • NMS-13413: Remove storing of string attributes at a resource path without a sample
  • NMS-13418: Fresh install requires to run fix-permissions script
  • NMS-13423: Upgrade Timescale plugin to TSS2.0
  • NMS-13429: Package diffutils is missing in Docker image

by RangerRick at July 06, 2021 03:54 PM

June 28, 2021

OpenNMS On the Horizon – Helm, Minion, Kafka, Karaf, Nephron, Non-Root, Metadata, Newts, Datastax, Vue3

Since last time, we updated Helm, Minion, and detector docs, Kafka event/alarm streams, time-series Karaf utilities, Nephron benchmarking, non-root OpenNMS, JVM startup options, Minion config schema publishing, metadata search support, Newts Datastax support, Vue3 UI prototyping, Minion health check, and Helm.

Github Project Updates

Internals, APIs, and Documentation
  • Bonnie updated documentation for Helm and the Flow Deep-Dive dashboard, the Minion deployment guide, and component filters.
  • Ronny worked on Minion installation doc updates.
  • Marcel made some updates to BsfDetector documentation.
  • Chandra worked on adding more node fields to the event/alarm protobuf definition for kafka streams.
  • Patrick did more work on exposing time-series commands to the Karaf CLI.
  • Stefan continued his work on Nephron flow testing and benchmarking.
  • I did some more work on running OpenNMS as non-root.
  • I updated the opennms startup script to support setting JAVA_INITIAL_HEAP_SIZE in opennms.conf to override the JVM's default -Xms value.
  • I wrapped up my work to publish the minion config schema.
  • Christian worked on adding metadata support to the search API.
  • Mark added some extra documentation for Helm node filter and resource queries.
  • I worked on updating and fixing tests for Jeff's Datastax Newts branch.
Web, ReST, UI, and Helm
  • Mike and Maxim did more work on a basic Vue3 UI framework.
  • Jane continued to work on enhancing the Minion health check ReST API.
  • I fixed an issue in the Helm build preventing publication in the Grafana plugin registry.
Contributors

Thanks to the following contributors for committing changes since last OOH:

  • Benjamin Reed
  • Bonnie Robinson
  • Chandra Gorantla
  • Christian Pape
  • Dustin Frisch
  • Jane Hou
  • Jesse White
  • Marcel Fuhrmann
  • Mark Mahacek
  • Maxim Brener
  • Mike Rose
  • Patrick Schweizer
  • Ronny Trommer
  • Stefan Wachter

Release Roadmap

July Releases

OpenNMS is on a monthly release schedule, with releases happening on the first Tuesday of the month.

The next OpenNMS release day is July 6th, 2021.

We currently expect at least a Horizon 28.0.1 release, plus updates for all supported Meridian releases.

Next Horizon: 29 (Q4 2021)

The next major Horizon release will be Horizon 29.

The current roadmap for Horizon 29 includes the following goals:

  • running as non-root by default
  • refactor the Minion's communication to get rid of out-of-band ReST calls to the OpenNMS core
  • add support for persistence of flows to Cortex
  • start the groundwork for replacing the topology UI with a pure-javascript version
Next Meridian: 2022 (Q? 2022)

With Meridian 2021 recently out, we do not yet have a specific timeline for Meridian 2022.

Expect it to include -- at the very least -- the JDK11 requirement and flow aggregation improvements from Horizon 28.
Ideally it will contain work going into Horizons 29 (and probably 30) if our timeline holds. 😅

Disclaimer

Note that this is just based on current plans; dates, features, and releases can change or slip depending on how development goes.

The statements contained herein may contain certain forward-looking statements relating to The OpenNMS Group that are based on the beliefs of the Group’s management as well as assumptions made by and information currently available to the Group’s management. These forward-looking statements are, by their nature, subject to significant risks and uncertainties.

...We apologize for the excessive disclaimers. Those responsible have been sacked.

Mynd you, møøse bites Kan be pretti nasti...

We apologise again for the fault in the disclaimers. Those responsible for sacking the people who have just been sacked have been sacked.

Until Next Time…

If there’s anything you’d like me to talk about in a future OOH, or you just have a comment or criticism you’d like to share, don’t hesitate to say hi.

- Ben

Resolved Issues Since Last OOH

  • HELM-154: Introduce resourceFilter (similar to nodeFilter but for resources)
  • HELM-285: Document Flow Deep Dive Dashboard
  • HELM-287: Helm 7.1.0 package from github throws Modified Signature
  • HELM-290: Expand Performance Datasource variable query docs
  • NMS-8529: WebMonitor is not in admin documentation
  • NMS-10209: Add documentation for the Alarm Northbounders
  • NMS-10248: Add a template section for config files for collectors
  • NMS-10320: Document the Admin > Discovery web UI pages
  • NMS-10386: REST API Documentation for ack/unack alarms
  • NMS-11755: Newts installation is broken due to dependency issues on Debian
  • NMS-12778: Incorporate node related information to events and alarms topic in opennms-kafka-producer feature
  • NMS-13016: Allow OpenNMS Core service to run as non-root
  • NMS-13063: uei.opennms.org/internal/applicationChanged and /applicationCreated event definition is missing
  • NMS-13173: Add operator instructions for graphInvalidated
  • NMS-13251: Proofread Minion content in deployment guide
  • NMS-13285: Publish minion config schema
  • NMS-13294: Meridian installation guide is incomplete
  • NMS-13300: Evaluate the E rated Sonar cloud issues in WebApps
  • NMS-13314: Meta-Data cannot be deleted using UI
  • NMS-13323: Maven: external HTTP insecure URLs are blocked
  • NMS-13334: Update Develop Documentation Section of Developer Guide
  • NMS-13362: Implement Kafka Consumer for events (protobuf)
  • NMS-13367: Allow setting java heap minimum and maximum values in opennms.conf
  • NMS-13378: Search result view is not configurable

by RangerRick at June 28, 2021 08:37 PM

June 21, 2021

OpenNMS On the Horizon – Docs, Testing, Minion, Nephron, Non-Root, Time-Series, Karaf, Telemetryd OpenJDK 17, RPC, Vue3 UI

Since last time, we continued to work on improved documentation and testing, plus Minion startup, Nephron, running as non-root, Time-Series enhancements, a Karaf shell command for Telemetryd response time, OpenJDK 17 building, RPC handling of metadata, and a proof-of-concept for a vue3 web UI.

Github Project Updates

Internals, APIs, and Documentation
  • Bonnie worked on documentation for Helm, and Horizon development and images.
  • I worked on cleaning up some smoke tests.
  • Christian worked on some fixes to Minion startup to make it more testable.
  • Stefan worked on more improvements to the Nephron testing frameworks.
  • Ronny worked on cleaning up some installation docs.
  • I continued to work on updating Horizon to run as non-root by default.
  • Patrick and Jesse did more work on time-series improvements.
  • Ronnie did some doc updates for running as non-root.
  • Sean did some updates to test using newer SNMP4J.
  • Patrick did more work on metadata processing in the time-series API.
  • Dustin worked on adding a Karaf shell command for inspecting telemetryd.
  • Dustin did a little more work on his enhancement to store service status in response time resources.
  • I did some work on testing building/startup with OpenJDK 17.
  • Stefan worked on some other improvements to Nephron.
  • I worked on pushing the Minion confd schema to Cloudsmith for reference.
  • Christian worked on RPC interpolation of metadata.
Web, ReST, UI, and Helm
  • Jesse and Mike worked on some basic infrastructure for a vue3 based UI.
  • Christian fixed up the tests for his Metadata updates.
  • Jane did more work on ReST APIs for querying Minion health.
Contributors

Thanks to the following contributors for committing changes since last OOH:

  • Benjamin Reed
  • Bonnie Robinson
  • Christian Pape
  • Dustin Frisch
  • Jane Hou
  • Jesse White
  • Mike Rose
  • Patrick Schweizer
  • Ronny Trommer
  • Sean Torres
  • Stefan Wachter

Release Roadmap

July Releases

OpenNMS is on a monthly release schedule, with releases happening on the first Tuesday of the month.

The next OpenNMS release day is July 6th, 2021.

We currently expect at least a Horizon 28.0.1 release, plus updates for all supported Meridian releases.

Next Horizon: 29 (Q4 2021)

The next major Horizon release will be Horizon 29.

The current roadmap for Horizon 29 includes the following goals:

  • running as non-root by default
  • refactor the Minion's communication to get rid of out-of-band ReST calls to the OpenNMS core
  • add support for persistence of flows to Cortex
  • start the groundwork for replacing the topology UI with a pure-javascript version
Next Meridian: 2022 (Q? 2022)

With Meridian 2021 recently out, we do not yet have a specific timeline for Meridian 2022.

Expect it to include -- at the very least -- the JDK11 requirement and flow aggregation improvements from Horizon 28.
Ideally it will contain work going into Horizons 29 (and probably 30) if our timeline holds. 😅

Disclaimer

Note that this is just based on current plans; dates, features, and releases can change or slip depending on how development goes.

The statements contained herein may contain certain forward-looking statements relating to The OpenNMS Group that are based on the beliefs of the Group’s management as well as assumptions made by and information currently available to the Group’s management. These forward-looking statements are, by their nature, subject to significant risks and uncertainties.

...We apologize for the excessive disclaimers. Those responsible have been sacked.

Mynd you, møøse bites Kan be pretti nasti...

We apologise again for the fault in the disclaimers. Those responsible for sacking the people who have just been sacked have been sacked.

Until Next Time…

If there’s anything you’d like me to talk about in a future OOH, or you just have a comment or criticism you’d like to share, don’t hesitate to say hi.

- Ben

Resolved Issues Since Last OOH

  • NMS-10584: Table Formatting Issue in SNMP Configuration API Docs
  • NMS-11790: Add Node ID reference to noticeWizard
  • NMS-12132: Describe on a high level what a Minion is
  • NMS-12469: Remove outdated standalone Minion documentation
  • NMS-12567: Online documentation links in snapshot builds are invalid
  • NMS-12620: OpenNMS won't start after upgrade: error hidden!
  • NMS-12765: Document v2 REST API
  • NMS-13176: Nephron: add benchmark launcher
  • NMS-13257: PageSequenceMonitor not accepting metadata in element
  • NMS-13297: Evaluate and identify areas of improvements in OpenNMS side to address Minion low bandwidth scenario
  • NMS-13301: Evaluate sonar cloud issues in the webapis
  • NMS-13312: Health-check: provide restful api to query health for different tags
  • NMS-13326: Nephron: Reduce Memory Churn
  • NMS-13338: Create DnsDetector docs
  • NMS-13340: Create HostResourceSWRunDetector docs
  • NMS-13371: Update images chapter in docs remove two chapters

by RangerRick at June 21, 2021 05:29 PM

June 16, 2021

Order of the Green Polo: Requiescat In Pace

One of the first “group chat” technologies I was ever exposed to was Internet Relay Chat (IRC). This allowed a group of people to get together in areas called “channels” to discuss pretty much anything they felt like discussing. The service had to be hosted somewhere, and for most open source projects that was Freenode.

You might have seen that recently Freenode was taken over by new management, and the policies this new management implemented didn’t sit well with most Freenode users. In the grand open source tradition, most everyone left and went to other IRC servers, most notably Libera Chat.

In May of 2002 when I became the sole maintainer of OpenNMS, there was exactly one person who was dedicated full time to the project – me. What kept me going was the community I found on IRC, in both the #opennms channel and the local Linux users group channel, #trilug.

It was the people on IRC who supported me until I could grow the business to the point of bringing on more people. I still have strong friendships with many of them.

I was reminded of those early days as we migrated #opennms to Libera Chat. At the moment there are only 12 members logged in, and most of those are olde skoool OpenNMS people. I haven’t used IRC much since we switched to Mattermost (we host a server at chat.opennms.com) and with it a “bridge” to bring IRC conversations into the main Mattermost channel. Most people moved to use Mattermost as their primary client, but of course there were a few holdouts (Hi Alex!).

While I was reminiscing, I was also reminded of the Order of the Green Polo (OGP). When David, Matt and I started The OpenNMS Group in 2004, interest in OpenNMS was growing, and there was a core of those folks on IRC who were very active in contributing to the project. I was trying to think of someway to recognize them.

At that time, business casual, at least for men, consisted of a polo shirt and khaki slacks. Vendors often gifted polo shirts with their logos/logotypes on them to clients, and a number of open source projects sold them to raise money. We sold a white one and a black one, and I thought, hey, perhaps I can pick another color and use that to identify the special contributors to OpenNMS.

Green has always been associated with OpenNMS. In network monitoring, green symbolizes that everything is awesome. We even named one of our professional services products the “Greenlight Project“. Plus I really like green as a color.

Then the question became “what shade of green?” For some reason I thought of Tiger Woods who, by this time, late 2004, had won the prestigious Masters golf tournament three times (and would again the next spring). The winner of that tournament gets a “hunter green” jacket, and so I decided that hunter green would be the color.

Also, for some unknown reason, I saw an article about a British knighthood called “The Order of the Garter“. I combined the two and thus “The Order of the Green Polo” was born.

It was awesome.

People who had been active in contributing to OpenNMS became even more active when I recognized them with the OGP honor. They contributed code and helped us with supporting our community, as well as adding a lot to the direction of the project. We started having annual developer conferences called “Dev-Jam” and OGP members got to attend for free so we could spend some face to face time with each other. I considered these men in the OGP to be my brothers.

As OpenNMS grew, we looked to the OGP for recruitment. It was through the OGP that Alejandro came to the US from Venezuela and now leads our support and services team (if OpenNMS went away tomorrow, getting him and his spouse here would have made it all worth it). When you hired an OGP member, you were basically paying them to do something they wanted to do for free. Think of is as like eating an ice cream sundae and finding money at the bottom.

But that growth was actually something that lead to the decline of the OGP. When we hired everyone that wanted a job with us, the role of the OGP declined. Dev-Jam was open to anyone, but it was mandatory for OpenNMS employees. Not all employees were OGP even though they were full-time contributors, so there was often pressure to induct new employees into the Order. And, most importantly, as we aged many OGP members moved on to other things. Hey, it happens, and it doesn’t reflect poorly on their past contributions.

We had a special mailing list for the OGP, but instead of discussing OpenNMS governance it basically became a “happy birthday” list (speaking of which, Happy Birthday Antonio!). When OpenNMS was acquired by NantHealth, we had to merge our mail systems and in the process the OGP list was deactivated. I don’t think many people noticed.

Recently it was brought to my attention that associating OpenNMS with the Masters golf tournament through the OGP could have negative connotations. The Masters is hosted by the Augusta National Golf Club and there have been controversies around their membership policies and views on race. It was suggested that we rename the OGP to something else.

One quick solution would be to just change the shade of green to, perhaps, a “stoplight” green. But this got me to thinking that the same logic used to associate the color with racism could apply to the whole “Order of” as well, since that was based on a British knighthood which, much like Augusta, is mainly all male. Plus the British don’t have the best track record when it comes to colonialism, etc.

I think it is time for something totally new, so I’ve decided to retire the Order of the Green Polo. The members of the OGP are all male, and I’m extremely excited that as we’ve grown our company and project we have been able to greatly improve our diversity, and I would love to come up with something that can embrace everyone who has a love of OpenNMS and wants to contribute to it, be that through code, documentation, the community, &tc.

OpenNMS has changed greatly over the past two decades, and it has become harder to contribute to a project that has grown exponentially in complexity. As part of my role as the Chief Evangelist of OpenNMS, I want to change that and come up with easier ways for people to improve the OpenNMS platform, and I need to come up with a new program to recognize those who contribute (and if you want to skip that part and get right to the job thingie, we’re hiring, but don’t skip that part).

To those of you who were in the Order of the Green Polo, thank you so much for helping us make OpenNMS what it is today. I’m not sure if it would exist without you. And even without the OGP mailing list, I plan to remember your birthdays.

by Tarus at June 16, 2021 04:02 PM

June 14, 2021

OpenNMS On the Horizon – Non-Root, Docs, Dependencies, Thresholding, Persisting, Time-Series, Metadata, Nephron, Minion, UI, Helm

Since last time, we worked on running as non-root, a bunch of doc updates, dependency updates, threshold validation, collection set persisting, time-series API and metadata, Nephron, Minion health check, UI improvements, and Helm dashboards.

Github Project Updates

Internals, APIs, and Documentation
  • I continued to work on making OpenNMS run as non-root by default.
  • Marcel did some more detector documentation updates.
  • Bonnie worked on updating the development documentation introduction.
  • David Schlenk updated WMI dependencies.
  • Chandra updated threshold values to go through some basic validation at the XSD level.
  • Chandra worked on bumping our Newts dependency to the latest version.
  • I updated a few dependencies to their latest versions. (Apache Httpclient, logback-classic, thanks Dependabot!)
  • Jesse fixed an issue where collection sets with null or blank labels would throw an error, rather than just not persisting.
  • Patrick worked on an update to the time-series API to allow using regular expressions for indexing resource paths, as well as publishing some metadata to the TSDB rather than PostgreSQL.
  • I worked on publishing extra build metadata to the minion-config-schema.yml during builds.
  • Stefan did more work on Nephron testing and benchmarking.
Web, ReST, UI, and Helm
  • Jane and Chandra worked on some additional features for the Minion health check ReST service.
  • Christian updated the service web UI to show the effective (interpolated) values of metadata parameters.
  • Mark's Helm update to include a welcome dashboard was merged.
  • Mark updated the notification web UI to note that nodeid and foreignid can be referenced in notifications.
  • Bonnie updated the OpenNMS and Helm docs to note what is necessary to use the grafana-image-renderer with Helm's docker image.
  • Bonnie worked on documentation for the flow deep-dive Helm dashboard.
Contributors

Thanks to the following contributors for committing changes since last OOH:

  • Benjamin Reed
  • Bonnie Robinson
  • Chandra Gorantla
  • Christian Pape
  • David Schlenk
  • Dustin Frisch
  • Jane Hou
  • Jesse White
  • Jian Yet Lee
  • Marcel Fuhrmann
  • Mark Mahacek
  • Patrick Schweizer
  • Stefan Wachter
  • bigbigtitus

Release Roadmap

July Releases

OpenNMS is on a monthly release schedule, with releases happening on the first Tuesday of the month.

The next OpenNMS release day is July 6th, 2021.

We currently expect at least a Horizon 28.0.1 release, plus updates for all supported Meridian releases.

Next Horizon: 29 (Q4 2021)

The next major Horizon release will be Horizon 29.

The current roadmap for Horizon 29 includes the following goals:

  • running as non-root by default
  • refactor the Minion's communication to get rid of out-of-band ReST calls to the OpenNMS core
  • add support for persistence of flows to Cortex
  • start the groundwork for replacing the topology UI with a pure-javascript version
Next Meridian: 2022 (Q? 2022)

With Meridian 2021 recently out, we do not yet have a specific timeline for Meridian 2022.

Expect it to include -- at the very least -- the JDK11 requirement and flow aggregation improvements from Horizon 28.
Ideally it will contain work going into Horizons 29 (and probably 30) if our timeline holds. 😅

Disclaimer

Note that this is just based on current plans; dates, features, and releases can change or slip depending on how development goes.

The statements contained herein may contain certain forward-looking statements relating to The OpenNMS Group that are based on the beliefs of the Group’s management as well as assumptions made by and information currently available to the Group’s management. These forward-looking statements are, by their nature, subject to significant risks and uncertainties.

...We apologize for the excessive disclaimers. Those responsible have been sacked.

Mynd you, møøse bites Kan be pretti nasti...

We apologise again for the fault in the disclaimers. Those responsible for sacking the people who have just been sacked have been sacked.

Until Next Time…

If there’s anything you’d like me to talk about in a future OOH, or you just have a comment or criticism you’d like to share, don’t hesitate to say hi.

- Ben

Resolved Issues Since Last OOH

  • HELM-265: Cannot use grafana-image-renderer with Helm's Docker image
  • HELM-277: Helm Flow Dashboard updates
  • HELM-281: Create a Welcome dashboard for new Helm users
  • NMS-11764: SNMP collection failing for "interface label is null or blank"
  • NMS-12689: Add Validation for Metadata in Thresholds
  • NMS-12899: Document how collected data are stored by default
  • NMS-12900: Problems in Helm documentation
  • NMS-12997: Document RestAPI/PRIS process
  • NMS-13045: SnmpInterfacePoller
  • NMS-13097: Document missing Rest API
  • NMS-13179: Show effective values of service test parameters with meta data
  • NMS-13200: Update docs page
  • NMS-13226: Remove the opennms-docs RPM/DEB package for local installation
  • NMS-13315: Check if Docker Content Trust and Docker Registry Proxies play together nicely
  • NMS-13320: update WMI dependencies
  • NMS-13324: Persist monitor status in RRD
  • NMS-13330: Add out-of-band monitoring content to main user documentation
  • NMS-13335: Update Introduction
  • NMS-13347: Minion container v28.0.0 refuse to start
  • NMS-13348: Navbar in our new documentation can't be used on smaller screens
  • NMS-13355: Default Debian instructions don't work on a minimal install
  • NMS-13360: CVE-2020-13956: Update commons-httpclient to 4.5.13
  • NMS-13361: CVE-2017-5929: bump logback-classic version to latest
  • NMS-13365: Small visual fix for the service.jsp changes made in NMS-13179

by RangerRick at June 14, 2021 03:39 PM

June 10, 2021

New docs: Where to find them, why they’re better, and how to contribute

If you look at the OpenNMS documentation, you’ll notice a change. Yes, it has a more polished appearance thanks to our new corporate branding, but it also has improved content and functionality as a result of our recent migration from AsciiDoctor to Antora for building the documentation.

Migrating the documentation was a huge undertaking (we’ll discuss the experience and challenges in a future blog), which required a new repository structure, syntax updates to almost every file, changes to our build environment, and a lot of tweaks along the way.

Old OpenNMS documentationrebranded documentation

All the docs in one place, search functionality

We’ve consolidated all the product documentation in one place at a new URL: docs.opennms.com. From here you can access the current version (and some older ones) of the documentation for all OpenNMS components: Horizon, Meridian, Helm, Alec, PRIS, and OpenNMS.js. The documentation also contains top-level menu links to other great sources of information about the project: training videos, community discussion forums, archived documentation, and OpenNMS support.

Built-in search functionality lets you search all the documentation to easily find the answers you need. We have restructured some of the content, most notably in the Horizon/Meridian documentation:

  • Release notes are now included within the core documentation
  • Updated installation guide content now under “Deployment” menu
  • Administration Guide now under “Operation”
  • New “Reference” section with glossary and miscellaneous configuration topics

How to contribute

With the migration complete, our next steps are to improve and update the documentation. We want to remove out-of-date content and update anything that is incorrect or unclear. We want to add documentation for project features that don’t have any. Anyone can write documentation for the project, and we welcome any kind of contribution. (And if you are obsessed with documentation, please consider joining Write the Docs, our Mattermost channel devoted to all things documentation.)

Note that there are different ways to contribute documentation, each suitable for different use cases:

  • Publish tutorials and how to articles in our knowledge base. For example, you want to describe how to use the Net-SNMP agent and the OpenNMS SNMP monitor to solve a special use case with OpenNMS. This is a great way to help other OpenNMS users who might have similar questions.

  • Contribute formal technical documentation related to the source code on GitHub.

  • Fix “quickwin-docs” Jira tickets in our documentation backlog. These are issues that should not take much time to address.

Technical documentation tips

File format for documentation is AsciiDoc, with the .adoc extension. For information on syntax, see Antora’s AsciiDoc Primer or look at how the existing .adoc files work.

Technical documentation should be accurate and concise. A good way to structure your contribution is as follows:

  • Descriptive heading for new topics (for example, “Create a Minion” or “SnmpCollector”)

  • Brief description of what you are documenting. If this is a new feature, include why it is important to users (for example, “This feature lets users validate and tune their business service hierarchies until they achieve the desired status propagation.”)

  • Steps to complete the procedure, or technical content such as parameters, configuration, and examples

Minimize the use of screenshots. Include them only to illustrate a concept that may be difficult to understand or something that is not easy to locate in the UI.

Where do I contribute technical documentation?

Log in to GitHub and locate the repository for the OpenNMS component for which you want to contribute documentation (for example, opennms, opennms-helm). Navigate to the /docs directory. Within this directory, you will find the /modules directory, that contains all the technical documentation associated with the source code in that repository. The /modules directory may have more nested directories to create a hierarchy for the content (component, subcomponents).

You will find .adoc files in the /pages directory or one of the subdirectories within the /pages directory. Images go in the /assets/images directory. The following is an example of the core OpenNMS docs repository:

For more information on how to contribute to OpenNMS documentation, including formatting conventions, tips and tricks, and cheat sheets, see Develop Documentation. (Note that the introduction to the Develop Documentation topic contains outdated information. We will update it with the content from this blog for the next release.)

Happy writing and thank you for contributing to OpenNMS documentation!

by Bonnie Robinson at June 10, 2021 01:50 PM

June 07, 2021

OpenNMS On the Horizon – Documentation, Flows and Nephron, Docker Container Trust, Thresholding, Metadata, Time-Series API, Minion Health Checks

Since last time, we did a bunch more documentation updates, plus worked on a number of bug fixes and instrumentation updates to flow processing and Nephron, Docker Container Trust, thresholding, metadata, the time-series API, and Minion health checks.

Github Project Updates

Internals, APIs, and Documentation
  • Mark worked on a few documentation fixes.
  • Dustin made the flow sampling interval configurable for flows missing it in their export.
  • Bonnie updated the reference docs with a number of cleanups and also added a section on the Prometheus JMX exporter.
  • Stefan continued to work on implementing Docker Container Trust for our minion images.
  • Marcel did more updates to detector documentation.
  • Chandra added some basic validation of threshold value in the thresholding XSD. It should match either a floating-point value, or a metadata text replacement.
  • Bonnie did a bunch more documentation updates including BSM, Minion Docker, confd, and more.
  • Patrick did some more work on storing string values in the time-series API.
  • Jane worked on categorizing health checks so that a subset(s) can be queried.
  • Stefan did some more work on instrumenting Nephron for performance tuning.
Web, ReST, UI, and Helm
  • Dustin updated the availability ReST service to supply up/down status.
  • Dustin updated the metadata ReST interface read-only, since metadata is intended to only be modified through requisitions.
  • Jane added OpenAPI docs to the health-check ReST service.
Contributors

Thanks to the following contributors for committing changes since last OOH:

  • Benjamin Reed
  • Bonnie Robinson
  • Chandra Gorantla
  • Christian Pape
  • Dustin Frisch
  • Jane Hou
  • Marcel Fuhrmann
  • Mark Mahacek
  • Patrick Schweizer
  • Stefan Wachter

June Releases

In June, we released updates to all OpenNMS Meridian versions under active support, and released the first iteration of OpenNMS Horizon 28.

Horizon 28.0.0

Release 28.0.0 is the first in the Horizon 28 series, introducing a requirement of Java 11, enhancements to flow aggregation to support DSCP ToS/QoS, and more.

The codename for Horizon 28.0.0 is Jazz.

For an overview of changes in OpenNMS Horizon 28, see What's New in OpenNMS Horizon 28

Meridian Point Releases

All Meridian releases this month contained just a few small bug fixes and enhancements. As always, it is strongly recommended that you update to the latest release.

For a list of changes, see the release notes:

Release Roadmap

July Releases

OpenNMS is on a monthly release schedule, with releases happening on the first Tuesday of the month.

The next OpenNMS release day is July 6th, 2021.

We currently expect at least a Horizon 28.0.1 release.

Next Horizon: 29 (Q4 2021)

The next major Horizon release will be Horizon 29.

The current roadmap for Horizon 29 includes the following goals:

  • running as non-root by default
  • refactor the Minion's communication to get rid of out-of-band ReST calls to the OpenNMS core
  • add support for persistence of flows to Cortex
  • start the groundwork for replacing the topology UI with a pure-javascript version
Next Meridian: 2022 (Q? 2022)

With Meridian 2021 recently out, we do not yet have a specific timeline for Meridian 2022.

Expect it to include -- at the very least -- the JDK11 requirement and flow aggregation improvements from Horizon 28.
Ideally it will contain work going into Horizons 29 (and probably 30) if our timeline holds. 😅

Disclaimer

Note that this is just based on current plans; dates, features, and releases can change or slip depending on how development goes.

The statements contained herein may contain certain forward-looking statements relating to The OpenNMS Group that are based on the beliefs of the Group’s management as well as assumptions made by and information currently available to the Group’s management. These forward-looking statements are, by their nature, subject to significant risks and uncertainties.

...We apologize for the excessive disclaimers. Those responsible have been sacked.

Mynd you, møøse bites Kan be pretti nasti...

We apologise again for the fault in the disclaimers. Those responsible for sacking the people who have just been sacked have been sacked.

Until Next Time…

If there’s anything you’d like me to talk about in a future OOH, or you just have a comment or criticism you’d like to share, don’t hesitate to say hi.

- Ben

Resolved Issues Since Last OOH

  • NMS-12876: Typo in Graphs: "File Descritors"
  • NMS-13238: Enhance Availability (RTC) data via REST with current service status
  • NMS-13260: Expand PageSequenceMonitor Documentation
  • NMS-13319: Provide OpenAPI doc to health-check REST API
  • NMS-13322: Backport 'NMS-13215: Fallback config for flow timeouts' to release-27.x
  • NMS-13344: Documentation Typos
  • NMS-13351: Release notes display issues

by RangerRick at June 07, 2021 03:23 PM

June 02, 2021

June 2021 Releases – Horizon 28.0.0, Meridians 2021.1.1, 2020.1.9, 2019.1.20, 2018.1.29

In June, we released updates to all OpenNMS Meridian versions under active support, and released the first iteration of OpenNMS Horizon 28.

Horizon 28.0.0

Release 28.0.0 is the first in the Horizon 28 series, introducing a requirement of Java 11, enhancements to flow aggregation to support DSCP ToS/QoS, and more.

The codename for Horizon 28.0.0 is Jazz.

For an overview of changes in OpenNMS Horizon 28, see What's New in OpenNMS Horizon 28

Meridian Point Releases

All Meridian releases this month contained just a few small bug fixes and enhancements. As always, it is strongly recommended that you update to the latest release.

For a list of changes, see the release notes:

by RangerRick at June 02, 2021 04:49 PM

June 01, 2021

OpenNMS On the Horizon – Docs, BouncyCastle SSL, Deps, Time-Series API, Minion, Nephron, Run As Non-Root, Helm, UI

Since last time, we did a ton of documentation updates, fixed the BouncyCastle SSL bug, updated some core dependencies, and made improvements in the time-series API, Minion health check, Nephron and flow processing, running as non-root, Helm, and the web UI.

Github Project Updates

Internals, APIs, and Documentation
  • Chandra and David fixed the bug with BouncyCastle causing TLS/SSL problems.
  • Patrick did more work on caching/performance improvements to the time-series API.
  • Jeff worked on some cleanups to Horizon/Meridian references in the documentation.
  • Mark made some improvements to the PSM and Prometheus collector docs.
  • Jane worked on creating a health check for checking Karaf bundle status.
  • Bonnie and Ronny did a bunch of work on improving the installation instructions.
  • Chandra continued to work on updating our Guava library to version 28.
  • Dustin worked on some additional flow debugging code.
  • Stefan did more work on tools for benchmarking flow processing performance.
  • Stefan worked on some improvements to Nephron to reduce garbage collection load.
  • I worked on changing OpenNMS to run as non-root by default.
  • Sean updated Kafka Components to 2.8.0.
  • Patrick worked on an enhancement to the time-series API to handle string properties.
  • Marcel worked on improving a bunch of detector documentation.
Web, ReST, UI, and Helm
  • Jane fixed the favicon to match the new branding.
  • Chandra and Jane worked on exposing health-check status over ReST on the Minion.
  • Mark made a "welcome" dashboard for Helm to ease getting started.
  • Christian did some CSRF improvements in a few web forms in the admin UI.
  • Mark worked on some other improvements to the flow deep dive dashboard in Helm.
  • Christian fixed a UI issue where some pages couldn't accept the alternate foreignSource:foreignId format when passing a node in.
Contributors

Thanks to the following contributors for committing changes since last OOH:

  • Benjamin Reed
  • Bonnie Robinson
  • Chandra Gorantla
  • Christian Pape
  • David Schlenk
  • Dustin Frisch
  • Jane Hou
  • Jeff Gehlbach
  • Marcel Fuhrmann
  • Mark Mahacek
  • Patrick Schweizer
  • Ronny Trommer
  • Sean Torres
  • Stefan Wachter

Release Roadmap

June Releases

The next OpenNMS release day is July 6th, 2021.

We currently expect at least a Horizon 28.0.1 release.

Next Horizon: 29 (Q? 2021)

The next major Horizon release will be Horizon 29.

Horizon 28 has just come out, and we are still firming up what our focus is going to be for the 29 cycle.

Next Meridian: 2022 (Q? 2022)

With Meridian 2021 recently out, we do not yet have a specific timeline for Meridian 2022.
Expect it to include, at the very least, the JDK11 requirement and flow aggregation improvements from Horizon 28.

Disclaimer

Note that this is just based on current plans; dates, features, and releases can change or slip depending on how development goes.

The statements contained herein may contain certain forward-looking statements relating to The OpenNMS Group that are based on the beliefs of the Group’s management as well as assumptions made by and information currently available to the Group’s management. These forward-looking statements are, by their nature, subject to significant risks and uncertainties.

...We apologize for the excessive disclaimers. Those responsible have been sacked.

Mynd you, møøse bites Kan be pretti nasti...

We apologise again for the fault in the disclaimers. Those responsible for sacking the people who have just been sacked have been sacked.

Until Next Time…

If there’s anything you’d like me to talk about in a future OOH, or you just have a comment or criticism you’d like to share, don’t hesitate to say hi.

- Ben

Resolved Issues Since Last OOH

  • HELM-203: Documentation Improvements
  • NMS-13111: BouncyCastle breaks SSL support in OpenNMS
  • NMS-13132: Nephron: derive aggregations for hosts and applications from the conversation aggregation
  • NMS-13158: IP interface link in Response Time graph page is broken
  • NMS-13250: Proofread Basic Horizon Deployment
  • NMS-13264: Upgrade Kafka components to 2.8.0
  • NMS-13267: Doc update for PrometheusCollector parameters
  • NMS-13274: Minion: A programmatic means of obtaining health (alternate to 'opennms:health-check')
  • NMS-13277: PoC for Docker Content Trust
  • NMS-13281: Mark OIA Implementation for Timeseries as experimental
  • NMS-13287: Got Access Denied when viewing On-Call Role schedule
  • NMS-13292: Favicon of OpenAPI page need to be updated
  • NMS-13294: Meridian installation guide is incomplete
  • NMS-13308: Validate query parameters in snmpInterfaces.jsp
  • NMS-13309: Validate name parameter in DestinationWizardServlet
  • NMS-13310: Replace FlowTimestampPolicy by shipped CustomTimestampPolicyWithLimitedDelay
  • NMS-13311: Support Rest API on Minion & Enable health-check REST feature
  • NMS-13321: Docs should refer to Horizon / Meridian conditionally
  • NMS-13329: CLONE - DOC Branding: Icon in tab is still the old one
  • NMS-13333: Enumeration of DSCP values returns only 10 values
  • NMS-13336: Update conventions for text formatting

by RangerRick at June 01, 2021 06:39 PM

May 24, 2021

OpenNMS On the Horizon – Nephron, DNS, Docs, SSL, Notifications, Time-Series, Helm, Topology, UI

Since last time, we worked on Nephron, DNS requisitions, documentation, SSL bugs, test flappers, notifications, time-series, Helm, topology, and UI updates.

Github Project Updates

Internals, APIs, and Documentation
  • Stefan worked on fixing a few Nephron bugs, as well as updating it to JDK11 and Flink 1.12.
  • Christian wrapped up some work on location-aware fixes for the DNS requisition provider.
  • Mark made some documentation fixes for the Prometheus collector, PageSequenceMonitor, and syslog config.
  • Chandra fixed an issue with BouncyCastle breaking some SSL-related operations.
  • I worked on fixing some test flappers.
  • Chandra wrapped up his fixes to notifications during scheduled outages.
  • Stefan reworked Nephron's pipeline processing to use built-in Kafka APIs for delay tracking.
  • Patrick worked on some improvements to cache handling in the Time-Series API.
Web, ReST, UI, and Helm
  • I fixed an issue in Helm where entity search queries would only return the first 1000 results.
  • Antonio added some test coverage for unresolvable topologies.
  • Jeff and Christian added some parameter validation improvements to the UI.
  • I released Helm 7.1.0, which includes the DSCP QoS/ToS improvements coming in Horizon 28.
  • Mark updated his flow dashboard improvements in Helm.
  • Jane fixed the outdated favicon in the UI.
Contributors

Thanks to the following contributors for committing changes since last OOH:

  • Antonio Russo
  • Benjamin Reed
  • Chandra Gorantla
  • Christian Pape
  • Jane Hou
  • Jeff Gehlbach
  • Mark Mahacek
  • Patrick Schweizer
  • Pierre Bouffard
  • Stefan Wachter

Release Roadmap

June Releases

The next OpenNMS release day is June 1st, 2021.

Barring complications, we expect the first Horizon 28 release, plus Meridian releases for 2018 and up.

Next Horizon: 28 (Q2 2021)

The next major Horizon release will be Horizon 28.

It will be the first OpenNMS release requiring JDK 11.

It will also contain a number of other improvements, plus a new feature for flows: DSCP QoS/ToS aggregation for nodes, plus a bunch of plumbing work to improve flow aggregation in general.

Next Meridian: 2022 (Q? 2022)

With Meridian 2021 out, we do not yet have a specific timeline for Meridian 2022.
Expect it to include, at the very least, the JDK11 requirement and flow aggregation improvements of Horizon 28.

Disclaimer

Note that this is just based on current plans; dates, features, and releases can change or slip depending on how development goes.

The statements contained herein may contain certain forward-looking statements relating to The OpenNMS Group that are based on the beliefs of the Group’s management as well as assumptions made by and information currently available to the Group’s management. These forward-looking statements are, by their nature, subject to significant risks and uncertainties.

...We apologize for the excessive disclaimers. Those responsible have been sacked.

Mynd you, møøse bites Kan be pretti nasti...

We apologise again for the fault in the disclaimers. Those responsible for sacking the people who have just been sacked have been sacked.

Until Next Time…

If there’s anything you’d like me to talk about in a future OOH, or you just have a comment or criticism you’d like to share, don’t hesitate to say hi.

- Ben

Resolved Issues Since Last OOH

  • HELM-253: Helm: create QoS filter dropdown to select QoS queue
  • HELM-254: Helm: create 'Total traffic by QOS tag grouped by Interface/Exporter' graph
  • HELM-255: Helm: create 'Top K applications by QOS/Interface/Exporter' graph
  • HELM-256: Helm: create 'Top K conversations by QOS/Interface/Exporter' graph
  • HELM-257: Helm: create 'Top K hosts by QOS/Interface/Exporter' graph
  • HELM-258: Helm: add filter to flow editor alowing to select a ToS
  • HELM-259: Helm: determine which information should be displayed in the ToS selection field
  • HELM-260: Allow multiple values for ToS/DSCP/ECN filters
  • HELM-274: Filter panel filter column did not return complete list
  • HELM-276: Flows and performance data source configuration is empty
  • HELM-278: Release Helm 7.1.0
  • IPL-37: Support for PostgreSQL 13
  • NMS-12357: BMP Support
  • NMS-12925: Visualize Netflow traffic by QoS
  • NMS-12947: Elastic Flow Repository: modify ReST API to support queries including QoS (aggregated and raw queries)
  • NMS-13086: Optimize flow queries in case no DSCP or ECN filter exists
  • NMS-13223: Incorrect reference to org.opennms.netmgt.syslog.cfg
  • NMS-13262: Nephron - Update Java and Flink
  • NMS-13266: Notifications received despite Schedule Outage applies
  • NMS-13272: minion-config-schema.yml java agent example as a string
  • NMS-13278: Location aware Requisitions from DNS
  • NMS-13296: Threat Modelling for DCT
  • NMS-13305: Unable to graph data from node_exporter stored in newts indexed by label

by RangerRick at May 24, 2021 04:51 PM

May 17, 2021

OpenNMS On the Horizon – Meridian 2021, DNS Requisitions, Docs, Newts, Nephron, Catheter, Smoke Tests, Minion, PRIS, Flows, Notifications, Helm

Since last time, we released Meridian 2021, plus worked on the DNS requisition handler, documentation, Newts, Nephron and Catheter, smoke tests, the Minion, PRIS, flows, notifications, and Helm.

Github Project Updates

Internals, APIs, and Documentation
  • Christian updated the DNS requisition URL handler to be location-aware.
  • Marcel did some more work on BSF detector documentation.
  • Chandra worked on bumping our guava dependency to match updated Newts.
  • Chandra and I worked on cleaning up some flapping tests.
  • Pierre worked on some updates to the Minion confd schema.
  • Bonnie did a bunch of doc updates to match newer style guides.
  • Christian updated PRIS to support setting metadata.
  • I did a bunch of small updates to Nephron and Catheter to clean up builds and release process.
  • Stefan fixed some NPE issues in missing aggregations for Elasticsearch flow queries.
  • Chandra worked on fixing notification behavior during a scheduled outage.
  • Jane worked on exposing the OpenNMS healthcheck on Minion through ReST.
Web, ReST, UI, and Helm
  • I made more preparations for the new Helm release.
  • Mark worked on some updated flow dashboards for Helm.
Contributors

Thanks to the following contributors for committing changes since last OOH:

  • Benjamin Reed
  • Bonnie Robinson
  • Chandra Gorantla
  • Christian Pape
  • Dustin Frisch
  • Jane Hou
  • Marcel Fuhrmann
  • Mark Mahacek
  • Pierre Bouffard
  • Ronny Trommer
  • Sean Torres
  • Stefan Wachter

May 2021 Releases - Horizon 27.2.0, Meridians 2021.1.0, 2020.1.8, 2019.1.19, and 2018.1.28

In May, we released updates to all OpenNMS Horizon and Meridian versions under active support, and released the first iteration of Meridian 2021.

Horizon 27.2.0

Horizon 27.2.0 is a release primarily targeting bug fixes, plus it includes our new branding refresh.

The codename for 27.2.0 is Magrathea.

For a high-level overview of what has changed in Horizon 27, see What’s New in OpenNMS Horizon 27.

For a complete list of changes in 27.2.0, see the detailed release notes.

Meridian Point Releases

Meridian 2018.1.28 was a tiny release, containing only an update to Apache Commons IO.

Meridian 2019.1.19 adds a backport of a number of browser security issues fixed the previous month in newer releases, plus a few other bug fixes.

Meridian 2020.1.8 contains all of those changes, plus a few other small bug fixes.

For a list of changes, see the release notes:

Meridian 2021

May also saw the release of Meridian 2021.1.0, the first in the 2021 series.

It is based on Horizon 27, which has proven to be one of our most solid series in quite a while. The most notable changes since Meridian 2020 (based on Horizon 26) are the removal of the legacy Remote Poller and the introduction of Application Perspective Monitoring, performing a similar set of functions using the Minion. Additionally, there are tons of bug fixes and other smaller feature improvements.

For an overview of what's changed since Meridian 2020, see the What's New section of the Meridian 2021 documentation.

Sharp readers will notice this is on our new docs.opennms.com site. We are in the process of moving projects from publishing to docs.opennms.org to the new Antora-based unified docs site.

Release Roadmap

June Releases

The next OpenNMS release day is June 1st, 2021.

Barring complications, we expect the first Horizon 28 release.

Next Horizon: 28 (Q2 2021)

The next major Horizon release will be Horizon 28.

It will be the first OpenNMS release requiring JDK 11.

It will also contain a number of other improvements, plus a new feature for flows: DSCP QoS/ToS aggregation for nodes, plus a bunch of plumbing work to improve flow aggregation in general.

Next Meridian: 2022 (Q? 2022)

With Meridian 2021 out, we do not yet have a specific timeline for Meridian 2022.
Expect it to include, at the very least, the JDK11 requirement and flow aggregation improvements of Horizon 28.

Disclaimer

Note that this is just based on current plans; dates, features, and releases can change or slip depending on how development goes.

The statements contained herein may contain certain forward-looking statements relating to The OpenNMS Group that are based on the beliefs of the Group’s management as well as assumptions made by and information currently available to the Group’s management. These forward-looking statements are, by their nature, subject to significant risks and uncertainties.

...We apologize for the excessive disclaimers. Those responsible have been sacked.

Mynd you, møøse bites Kan be pretti nasti...

We apologise again for the fault in the disclaimers. Those responsible for sacking the people who have just been sacked have been sacked.

Until Next Time…

If there’s anything you’d like me to talk about in a future OOH, or you just have a comment or criticism you’d like to share, don’t hesitate to say hi.

- Ben

Resolved Issues Since Last OOH

by RangerRick at May 17, 2021 04:21 PM

May 13, 2021

May 2021 Releases – Horizon 27.2.0, Meridians 2021.1.0, 2020.1.8, 2019.1.19, and 2018.1.28

In May, we released updates to all OpenNMS Horizon and Meridian versions under active support, and released the first iteration of Meridian 2021.

Horizon 27.2.0

Horizon 27.2.0 is a release primarily targeting bug fixes, plus it includes our new branding refresh.

The codename for 27.2.0 is Magrathea.

For a high-level overview of what has changed in Horizon 27, see What’s New in OpenNMS Horizon 27.

For a complete list of changes in 27.2.0, see the detailed release notes.

Meridian Point Releases

Meridian 2018.1.28 was a tiny release, containing only an update to Apache Commons IO.

Meridian 2019.1.19 adds a backport of a number of browser security issues fixed the previous month in newer releases, plus a few other bug fixes.

Meridian 2020.1.8 contains all of those changes, plus a few other small bug fixes.

For a list of changes, see the release notes:

Meridian 2021

May also saw the release of Meridian 2021.1.0, the first in the 2021 series.

It is based on Horizon 27, which has proven to be one of our most solid series in quite a while. The most notable changes since Meridian 2020 (based on Horizon 26) are the removal of the legacy Remote Poller and the introduction of Application Perspective Monitoring, performing a similar set of functions using the Minion. Additionally, there are tons of bug fixes and other smaller feature improvements.

For an overview of what's changed since Meridian 2020, see the What's New section of the Meridian 2021 documentation.

Sharp readers will notice this is on our new docs.opennms.com site. We are in the process of moving projects from publishing to docs.opennms.org to the new Antora-based unified docs site.

by RangerRick at May 13, 2021 03:20 PM

May 12, 2021

What’s Old Is New Again

Today we launched a new look for OpenNMS, a rebranding effort that has been going on for the better part of a year. It represents a lot more than just a new logo and new colors. While OpenNMS has been around for over two decades now, it is also quite different from when it started. A tremendous amount of work has gone into the project over the past couple of years, and if you looked at using it even just a short while ago you will be surprised at what has changed.

New OpenNMS Logo

One of the best analogies I can come up with to talk about the “new” OpenNMS concerns cars. I like cars, especially Mercedes, and when I was in college I usually drove an older Mercedes sedan. I enjoyed bringing them back to their former glory (and old, somewhat beaten down cars were all I could afford), and so I might start by redoing the brake system, overhauling the engine, etc.

When I would run out of money, which was often, sometimes I’d have to sell a car. Prospective buyers would often complain that the paint wasn’t perfect or there was an issue with the interior. I’d point out that you could hop in this car right now and drive it across the country and never worry about breaking down, but they seemed focused on how it looked. Cosmetics are usually the last thing you focus on during a restoration, but it tends to be the first thing people see.

This is very much like OpenNMS. For over a decade we’ve been focused on the internals of the platform, and luckily we are now in a position to focus on how it looks.

Please don’t misunderstand: application usability is important, much more important than, say, the paint job on a car, but in order to provide the best user experience we had to start by working under the hood.

For example, from the beginning OpenNMS has contained multiple “daemons” that control various aspects of the platform. Originally this was very monolithic, and thus any small change to one of them would often require restarting the whole application.

OpenNMS is now based on a Karaf runtime which provides a modular way of managing the various features within the application. It comes with a shell that can allow even non-Java programmers access to both high and low level parts of the platform, and to make changes without restarting the whole thing. Features can be enabled and disabled on the fly, and it is easy to test the behavior of OpenNMS against a particular device without having to set up a special test environment to pore through pages of logs.

Another great aspect of OpenNMS is that much of the internal messaging can now take place through a broker such as Kafka. While this increases the stability and flexibility of the platform, users can also create custom consumers for the huge amounts of information OpenNMS is able to collect. For very large networks this creates the option to use that data outside of the platform itself, giving end users a high level of custom observablity.

The monolithic nature of OpenNMS has also been improved. The addition of “Minions” to provide monitoring at the edge of the network creates numerous monitoring solutions where there was none before. You can now reach into isolated or private networks, or monitor the performance of applications from various locations seamlessly. The “Sentinel” project allows the various processes within OpenNMS to be spread out over multiple devices with the aim to have virtually unlimited scale.

APM Example World Map

And I haven’t even started on the ability of OpenNMS to monitor tremendous amounts of telemetry data and to analyze it with tools such as “Nephron” or our foray into artificial intelligence with ALEC.

So much has changed with OpenNMS, much of it recently, that it was time for that new coat of paint. It was time for people to both notice the new look of OpenNMS at the surface, and the new OpenNMS under the covers.

One thing that hasn’t changed is that OpenNMS is still 100% open source. All of these amazing features are available to anyone under an OSI approved open source license. Plus we leverage and integrate with best-in-class open source tools such as Grafana for visualization and Cassandra (using Newts) for storing time series data.

Our new logo is a stylized gyroscope. For centuries the gyroscope has represented a way to maintain orientation in the most chaotic of situations. In much the same way, OpenNMS helps you maintain the orientation of your IT infrastructure which, let’s admit it, plays a huge role in the success of your enterprise.

Where the car analogy falls apart is that while the paint job is usually the end of a restoration, this new look for OpenNMS is just the beginning of a new chapter in the history of the project. Our goal is to create a platform where monitoring just happens. We’re not there yet, but check out the latest OpenNMS and we hope you’ll agree we are getting closer.

by Tarus at May 12, 2021 03:46 PM

Not Your Dad’s OpenNMS

OpenNMS is an “old school open source project” in many ways. We’ve been around for 20 years, spent most of that time hacking on code, and our community feels like family.

Typical of early open source projects, marketing and branding haven’t always been a top priority at OpenNMS. We’ve always had a logo (a logotype, if you want to get pedantic) and our main color was vaguely kelly green, accented with black and white. Ulf the kiwi bird was our requisite animal mascot. The logo went through various iterations over the years but kept the same basic shape.

Why change? Truthfully, we’ve always wanted to put more thought into our brand. We wanted our visual identity to represent everything we love about OpenNMS:

  • Approachable: Has a welcoming culture of helpfulness. OpenNMS is open to everyone.
  • Reliable: Designed for large enterprises and service providers, OpenNMS monitors tens of thousands of devices from a single instance.
  • Adaptable: The flexible architecture of OpenNMS can be adapted, extended, and easily integrated to meet each organization’s requirements.
  • Mature: OpenNMS has been continuously improving and setting the standard for open-source monitoring platforms for over 20 years. It continues to evolve and refine.

With the support of our new parent company, NantHealth, we were able to engage with New Kind, a “focused team of experts in strategy, positioning, messaging, and visual identity for tech brands.” New Kind has done an amazing job guiding us through this process. They asked us all the right questions and worked with us collaboratively – they've got open source roots too, so they “get it.”

Together, we created the Open Gyroscope. Just like OpenNMS, the Open Gyroscope is made of multiple pieces working in harmony to show the way and help users stay the course. We drew inspiration from existing navigational themes in the current OpenNMS brand (Horizon, Meridian, Helm, etc.).

Our new color palette was inspired by open air and sea to reflect the calm and confidence we want users to feel that comes from knowing they can rely on OpenNMS. The vibrant accent colors add fun and excitement to the palette.

Even though we have a new face, we’re still the same OpenNMS. We’re still open source, still obsessively engineering our platform, and we’re still family.

We’re so excited to continue this journey with you.

-The team at The OpenNMS Group

 

P.S.
Ulf isn’t going anywhere – he's still in charge!

by Jess at May 12, 2021 04:52 AM

May 10, 2021

OpenNMS On the Horizon – Configuration, Poller, minion, Docs, Notifications, Newts, PRIS, Karaf, Selenium, Grafana

Since last time, we worked on configuration management, poller metrics, situations on the Minion, documentation, dependencies, notifications, Newts, Tests, PRIS, Java, Karaf, Selenium monitor, OpenNMS.js and Helm, UI fixes, and a UI refresh.

Github Project Updates

Internals, APIs, and Documentation
  • Jesse did some more proof-of-concept work for configuration management
  • Jesse added some metrics to the poller
  • Stefan fixed an issue with situation feedback config on the Minion
  • Bonnie made some updates to dynamic dashboard documentation
  • I bumped our commons-io dependency to 2.8.0
  • Christian updated the notification editor to support parameters
  • Chandra bumped Newts Guava dependency to 23
  • Chandra and I worked on a number of timing fixes for tests
  • Christian worked on some metadata-related additions to PRIS
  • Ronny updated some of our base images with newer java timezone data
  • Stefan fixed an issue with reloading configuration in Karaf
  • Craig did more work on modernizing our Selenium monitor
  • Ronny continued the work to wrap up the Antora documentation update
Web, ReST, UI, and Helm
  • I released OpenNMS.js 2.1.1; it is primarily dependency updates, and some plumbing support for flow ToS
  • Stefan and I worked on wrapping up my port of Helm to TypeScript
  • Christian fixed an issue in the graph UI sidebar
  • Christian fixed an error displaying error IDs (ironically) in the web UI
  • Jane did more work refreshing the look of the login and main page
Contributors

Thanks to the following contributors for committing changes since last OOH:

  • Benjamin Reed
  • Bonnie Robinson
  • Chandra Gorantla
  • Christian Pape
  • Craig Gallen
  • Dustin Frisch
  • Jane Hou
  • Jesse White
  • Ronny Trommer
  • Sean Torres
  • Stefan Wachter

Release Roadmap

May Releases

The next OpenNMS release day is May 11th, 2021.

Currently we expect a new Horizon 27 release, as well as Meridians 2019, 2020, and 2021.

Next Horizon: 28 (Q? 2021)

The next major Horizon release will be Horizon 28.

Horizon 28 will still be coming down the pipeline soon.
Currently, we hope for it to contain the move to building with JDK 11 (and, consequently, a requirement to only run on JDK 11 or higher), QoS flow aggergation, and some other improvements in the pipeline.

Next Meridian: 2021 (Q2 2021)

Meridian 2021 is on track for a release in the 2nd quarter of 2021. It is expected to be based on the Horizon 27 codebase, which means it will contain all of the bug fixes and new features introduced in Horizon 26 and 27.

Disclaimer

Note that this is just based on current plans; dates, features, and releases can change or slip depending on how development goes.

The statements contained herein may contain certain forward-looking statements relating to The OpenNMS Group that are based on the beliefs of the Group’s management as well as assumptions made by and information currently available to the Group’s management. These forward-looking statements are, by their nature, subject to significant risks and uncertainties.

...We apologize for the excessive disclaimers. Those responsible have been sacked.

Mynd you, møøse bites Kan be pretti nasti...

We apologise again for the fault in the disclaimers. Those responsible for sacking the people who have just been sacked have been sacked.

Until Next Time…

If there’s anything you’d like me to talk about in a future OOH, or you just have a comment or criticism you’d like to share, don’t hesitate to say hi.

- Ben

Resolved Issues Since Last OOH

  • HELM-266: Filter panel can not be created
  • HELM-267: Adding a query to a performance dashboard is empty
  • NMS-8581: Not possible to define notification parameters via "Configure notifications" UI
  • NMS-12497: Migrate OpenNMS core docs to Antora
  • NMS-12728: Measurement API: Trim DS name to 19 chars when using RRD
  • NMS-12766: Race condition on ALEC's config bundle after installation
  • NMS-12767: Race condition when enabling the Situations Feedback feature
  • NMS-13235: Issue with parsing sFlow
  • NMS-13237: Cleared alarms with closed ticket state not removed when using a hybrid approach
  • NMS-13259: Sidebar navigation on the graph results page is not working
  • NMS-13263: Change Horizon to new brand icon and update navbar theme color
  • NMS-13270: Update Horizon log in page to the new design
  • NMS-13275: Fix Foundation 2019 branch building
  • NMS-13276: Time zone is handled different on Minion container image based on Ubuntu

by RangerRick at May 10, 2021 09:24 PM

OpenNMS On the Horizon – Configuration, Poller, minion, Docs, Notifications, Newts, PRIS, Karaf, Selenium, Grafana

Since last time, we worked on configuration management, poller metrics, situations on the Minion, documentation, dependencies, notifications, Newts, Tests, PRIS, Java, Karaf, Selenium monitor, OpenNMS.js and Helm, UI fixes, and a UI refresh.

Github Project Updates

Internals, APIs, and Documentation
  • Jesse did some more proof-of-concept work for configuration management
  • Jesse added some metrics to the poller
  • Stefan fixed an issue with situation feedback config on the Minion
  • Bonnie made some updates to dynamic dashboard documentation
  • I bumped our commons-io dependency to 2.8.0
  • Christian updated the notification editor to support parameters
  • Chandra bumped Newts Guava dependency to 23
  • Chandra and I worked on a number of timing fixes for tests
  • Christian worked on some metadata-related additions to PRIS
  • Ronny updated some of our base images with newer java timezone data
  • Stefan fixed an issue with reloading configuration in Karaf
  • Craig did more work on modernizing our Selenium monitor
  • Ronny continued the work to wrap up the Antora documentation update
Web, ReST, UI, and Helm
  • I released OpenNMS.js 2.1.1; it is primarily dependency updates, and some plumbing support for flow ToS
  • Stefan and I worked on wrapping up my port of Helm to TypeScript
  • Christian fixed an issue in the graph UI sidebar
  • Christian fixed an error displaying error IDs (ironically) in the web UI
  • Jane did more work refreshing the look of the login and main page
Contributors

Thanks to the following contributors for committing changes since last OOH:

  • Benjamin Reed
  • Bonnie Robinson
  • Chandra Gorantla
  • Christian Pape
  • Craig Gallen
  • Dustin Frisch
  • Jane Hou
  • Jesse White
  • Ronny Trommer
  • Sean Torres
  • Stefan Wachter

Release Roadmap

May Releases

The next OpenNMS release day is May 11th, 2021.

Currently we expect a new Horizon 27 release, as well as Meridians 2019, 2020, and 2021.

Next Horizon: 28 (Q? 2021)

The next major Horizon release will be Horizon 28.

Horizon 28 will still be coming down the pipeline soon.
Currently, we hope for it to contain the move to building with JDK 11 (and, consequently, a requirement to only run on JDK 11 or higher), QoS flow aggergation, and some other improvements in the pipeline.

Next Meridian: 2021 (Q2 2021)

Meridian 2021 is on track for a release in the 2nd quarter of 2021. It is expected to be based on the Horizon 27 codebase, which means it will contain all of the bug fixes and new features introduced in Horizon 26 and 27.

Disclaimer

Note that this is just based on current plans; dates, features, and releases can change or slip depending on how development goes.

The statements contained herein may contain certain forward-looking statements relating to The OpenNMS Group that are based on the beliefs of the Group’s management as well as assumptions made by and information currently available to the Group’s management. These forward-looking statements are, by their nature, subject to significant risks and uncertainties.

...We apologize for the excessive disclaimers. Those responsible have been sacked.

Mynd you, møøse bites Kan be pretti nasti...

We apologise again for the fault in the disclaimers. Those responsible for sacking the people who have just been sacked have been sacked.

Until Next Time…

If there’s anything you’d like me to talk about in a future OOH, or you just have a comment or criticism you’d like to share, don’t hesitate to say hi.

- Ben

Resolved Issues Since Last OOH

  • HELM-266: Filter panel can not be created
  • HELM-267: Adding a query to a performance dashboard is empty
  • NMS-8581: Not possible to define notification parameters via "Configure notifications" UI
  • NMS-12497: Migrate OpenNMS core docs to Antora
  • NMS-12728: Measurement API: Trim DS name to 19 chars when using RRD
  • NMS-12766: Race condition on ALEC's config bundle after installation
  • NMS-12767: Race condition when enabling the Situations Feedback feature
  • NMS-13235: Issue with parsing sFlow
  • NMS-13237: Cleared alarms with closed ticket state not removed when using a hybrid approach
  • NMS-13259: Sidebar navigation on the graph results page is not working
  • NMS-13263: Change Horizon to new brand icon and update navbar theme color
  • NMS-13270: Update Horizon log in page to the new design
  • NMS-13275: Fix Foundation 2019 branch building
  • NMS-13276: Time zone is handled different on Minion container image based on Ubuntu

by RangerRick at May 10, 2021 09:23 PM

May 03, 2021

OpenNMS.js v2.1.0

This release adds support for some flow APIs coming in OpenNMS Horizon 28, as well as a documentation rework and tons of dependency updates.

by RangerRick at May 03, 2021 07:28 PM

OpenNMS On the Horizon – Selenium, VMware, BSF, Documentation, Nephron, Karaf, Minion, UI, Notifications, OpenNMS.js, Helm

Since last time, we worked on Selenium monitor, VMware, BSF and other documentation, Nephron, Karaf, Minion, UI layout, notifications, opennms.js, and Helm.

Github Project Updates

Internals, APIs, and Documentation
  • Ronny did some work on creating test docker images for the Selenium monitor rework
  • Christian made some fixes for timeout handling in the VMware code
  • Marcel did some work on BSF detector documentation
  • Chandra, Craig, and Jesse continued the work on making the Selenium monitor Minion-compatible
  • Stefan fixed some dependency issues with Nephron and Catheter
  • Stefan worked on a race condition in container startup
  • Chandra fixed the default Minion flow config
Web, ReST, UI, and Helm
  • Jane worked on modernizing some of the admin help page links
  • Jane worked on some new layout stuff for the login page
  • Christian worked on an update to support setting parameters in the notification config UI
  • I converted Helm to TypeScript and the new Grafana toolkit to solve a number of initialization and related bugs
  • I added some missing types to the opennms.js convenience API, DAO, and Model exports
Contributors

Thanks to the following contributors for committing changes since last OOH:

  • Benjamin Reed
  • Chandra Gorantla
  • Christian Pape
  • Craig Gallen
  • Dustin Frisch
  • Jane Hou
  • Jesse White
  • Marcel Fuhrmann
  • Ronny Trommer
  • Stefan Wachter

Release Roadmap

May Releases

The next OpenNMS release day is May 11th, 2021.

Currently we expect a new Horizon 27 release, as well as Meridians 2019, 2020, and 2021.

Next Horizon: 28 (Q? 2021)

The next major Horizon release will be Horizon 28.

Horizon 28 will still be coming down the pipeline soon.
Currently, we hope for it to contain the move to building with JDK 11 (and, consequently, a requirement to only run on JDK 11 or higher), QoS flow aggergation, and some other improvements in the pipeline.

Next Meridian: 2021 (Q2 2021)

Meridian 2021 is on track for a release in the 2nd quarter of 2021. It is expected to be based on the Horizon 27 codebase, which means it will contain all of the bug fixes and new features introduced in Horizon 26 and 27.

Disclaimer

Note that this is just based on current plans; dates, features, and releases can change or slip depending on how development goes.

The statements contained herein may contain certain forward-looking statements relating to The OpenNMS Group that are based on the beliefs of the Group’s management as well as assumptions made by and information currently available to the Group’s management. These forward-looking statements are, by their nature, subject to significant risks and uncertainties.

...We apologize for the excessive disclaimers. Those responsible have been sacked.

Mynd you, møøse bites Kan be pretti nasti...

We apologise again for the fault in the disclaimers. Those responsible for sacking the people who have just been sacked have been sacked.

Until Next Time…

If there’s anything you’d like me to talk about in a future OOH, or you just have a comment or criticism you’d like to share, don’t hesitate to say hi.

- Ben

Resolved Issues Since Last OOH

  • NMS-9966: nodelabel-host-name setting on HttpMonitor not applying
  • NMS-13090: Build prototype of configuration system for vacuumd config
  • NMS-13095: Replace ConfigTesterTest with something that uses the configservice
  • NMS-13096: Yang Vacuumd Configuration and Generation
  • NMS-13110: Shipped minion flow listener config does not create a working listener
  • NMS-13122: Intergate support for OSGI into configuration system
  • NMS-13225: Update Help page with doc links in the Web UI

by RangerRick at May 03, 2021 05:29 PM

OpenNMS On the Horizon – Selenium, VMware, BSF, Documentation, Nephron, Karaf, Minion, UI, Notifications, OpenNMS.js, Helm

Since last time, we worked on Selenium monitor, VMware, BSF and other documentation, Nephron, Karaf, Minion, UI layout, notifications, opennms.js, and Helm.

Github Project Updates

Internals, APIs, and Documentation
  • Ronny did some work on creating test docker images for the Selenium monitor rework
  • Christian made some fixes for timeout handling in the VMware code
  • Marcel did some work on BSF detector documentation
  • Chandra, Craig, and Jesse continued the work on making the Selenium monitor Minion-compatible
  • Stefan fixed some dependency issues with Nephron and Catheter
  • Stefan worked on a race condition in container startup
  • Chandra fixed the default Minion flow config
Web, ReST, UI, and Helm
  • Jane worked on modernizing some of the admin help page links
  • Jane worked on some new layout stuff for the login page
  • Christian worked on an update to support setting parameters in the notification config UI
  • I converted Helm to TypeScript and the new Grafana toolkit to solve a number of initialization and related bugs
  • I added some missing types to the opennms.js convenience API, DAO, and Model exports
Contributors

Thanks to the following contributors for committing changes since last OOH:

  • Benjamin Reed
  • Chandra Gorantla
  • Christian Pape
  • Craig Gallen
  • Dustin Frisch
  • Jane Hou
  • Jesse White
  • Marcel Fuhrmann
  • Ronny Trommer
  • Stefan Wachter

Release Roadmap

May Releases

The next OpenNMS release day is May 11th, 2021.

Currently we expect a new Horizon 27 release, as well as Meridians 2019, 2020, and 2021.

Next Horizon: 28 (Q? 2021)

The next major Horizon release will be Horizon 28.

Horizon 28 will still be coming down the pipeline soon.
Currently, we hope for it to contain the move to building with JDK 11 (and, consequently, a requirement to only run on JDK 11 or higher), QoS flow aggergation, and some other improvements in the pipeline.

Next Meridian: 2021 (Q2 2021)

Meridian 2021 is on track for a release in the 2nd quarter of 2021. It is expected to be based on the Horizon 27 codebase, which means it will contain all of the bug fixes and new features introduced in Horizon 26 and 27.

Disclaimer

Note that this is just based on current plans; dates, features, and releases can change or slip depending on how development goes.

The statements contained herein may contain certain forward-looking statements relating to The OpenNMS Group that are based on the beliefs of the Group’s management as well as assumptions made by and information currently available to the Group’s management. These forward-looking statements are, by their nature, subject to significant risks and uncertainties.

...We apologize for the excessive disclaimers. Those responsible have been sacked.

Mynd you, møøse bites Kan be pretti nasti...

We apologise again for the fault in the disclaimers. Those responsible for sacking the people who have just been sacked have been sacked.

Until Next Time…

If there’s anything you’d like me to talk about in a future OOH, or you just have a comment or criticism you’d like to share, don’t hesitate to say hi.

- Ben

Resolved Issues Since Last OOH

  • NMS-9966: nodelabel-host-name setting on HttpMonitor not applying
  • NMS-13090: Build prototype of configuration system for vacuumd config
  • NMS-13095: Replace ConfigTesterTest with something that uses the configservice
  • NMS-13096: Yang Vacuumd Configuration and Generation
  • NMS-13110: Shipped minion flow listener config does not create a working listener
  • NMS-13122: Intergate support for OSGI into configuration system
  • NMS-13225: Update Help page with doc links in the Web UI

by RangerRick at May 03, 2021 05:28 PM

April 26, 2021

OpenNMS On the Horizon – Kafka, Karaf, Newts, Time-Series, Nephron, Flows, Minion, BMP, Measurements API, Selenium Monitor, ReST, UI

In the last week we did a ton more bugfixing and enhancements related to Kafka, the Karaf CLI, Newts, Time-Series Metadata, Nephron, Flows, Minion, BMP, the measurements API, the Selenium monitor, ReST, and the web UI.

Github Project Updates

Internals, APIs, and Documentation
  • Bonnie updated the Kafka documentation to note settings that should be updated when using the Kafka producer and large network devices
  • Dino fixed up the stress-metrics help output
  • Bonnie worked on Newts installation instructions
  • Jesse added some tracking of cardinality metrics in the timeseries metadata
  • Stefan made some changes to the Nephron aggregation code for backwards-compatibility
  • Dustin worked on improvements to the telemetry integration tests
  • Bonnie cleaned up the Minion confd schema descriptions
  • Chandra fixed an issue with lag in the Minion Heartbeat handling
  • Jeff did a bit more work on Cassandra-related updates to Newts
  • Chandra fixed a few timing issues with BMP
  • Dustin fixed an issue with parsing extended sFlow
  • Dustin fixed a bug in handling truncated datasource names in the measurements API
  • Stefan worked on fixing a few more Nephron tests
  • Stefan fixed a problem with confd system properties not being set properly in Minion
  • Chandra worked on making the Selenium Monitor installable on the Minion
Web, ReST, UI, and Helm
  • I worked on bumping our Vaadin framework dependency to the latest version
  • Jane fixed an issue with the LLDP ReST API
  • Christian backported some of the UI fixes made in Horizon 27 to previous branches
  • Jane updated the web UI help page to point to the new docs and OpenAPI/Swagger UI
Contributors

Thanks to the following contributors for committing changes since last OOH:

  • Benjamin Reed
  • Bonnie Robinson
  • Chandra Gorantla
  • Christian Pape
  • Dino Yancey
  • Dustin Frisch
  • Jane Hou
  • Jeff Gehlbach
  • Jesse White
  • Marcel Fuhrmann
  • Ronny Trommer
  • Stefan Wachter

Release Roadmap

May Releases

The next OpenNMS release day is May 11th, 2021.

Currently we expect a new Horizon 27 release, as well as Meridians 2019 and 2020.

Next Horizon: 28 (Q? 2021)

The next major Horizon release will be Horizon 28.

Horizon 28 will still be coming down the pipeline soon.
Currently, we hope for it to contain the move to building with JDK 11 (and, consequently, a requirement to only run on JDK 11 or higher), QoS flow aggergation, and some other improvements in the pipeline.

Next Meridian: 2021 (Q2 2021)

Meridian 2021 is on track for a release in 2nd quarter of 2021. It is expected to be based on the Horizon 27.1 codebase, which means it will contain all of the bug fixes and new features introduced in Horizon 26 and 27.

Disclaimer

Note that this is just based on current plans; dates, features, and releases can change or slip depending on how development goes.

The statements contained herein may contain certain forward-looking statements relating to The OpenNMS Group that are based on the beliefs of the Group’s management as well as assumptions made by and information currently available to the Group’s management. These forward-looking statements are, by their nature, subject to significant risks and uncertainties.

...We apologize for the excessive disclaimers. Those responsible have been sacked.

Mynd you, møøse bites Kan be pretti nasti...

We apologise again for the fault in the disclaimers. Those responsible for sacking the people who have just been sacked have been sacked.

Until Next Time…

If there’s anything you’d like me to talk about in a future OOH, or you just have a comment or criticism you’d like to share, don’t hesitate to say hi.

- Ben

Resolved Issues Since Last OOH

  • HELM-273: Drift (ES): Trying to create too many buckets.
  • NMS-12500: Develop tree structure for docs
  • NMS-12945: Nephron: add additional aggregations to support QoS filtering in Helm
  • NMS-13039: Add a warning when enabling forwarding metrics through the Kafka Producer
  • NMS-13099: Nephron: Add additional aggregations for backwards compatibilty and optimized access
  • NMS-13100: Nephron: optimize aggregation calculation
  • NMS-13101: Setting Instance ID via minon-config.yaml doesn't work
  • NMS-13160: Web ui got stuck in 2020 :)
  • NMS-13184: Re-enable Kafka RPC Single Topic By Default
  • NMS-13224: Bmp Peer Up/Down Notification Message may be missed on OpenNMS/Sentinel
  • NMS-13232: Heartbeat topic lag with a large number of minions
  • NMS-13234: vmware integration connection pool not expiring connections
  • NMS-13242: Admin Guide Newts Instructions Incomplete
  • NMS-13247: Minion - Meridian Installation Documents Incorrect
  • NMS-13255: Provide documentation for context-sensitive help in UI form
  • NMS-13258: LLDP REST api miss local port info
  • NMS-13261: Update Vaadin dependencies

by RangerRick at April 26, 2021 07:27 PM

April 20, 2021

OpenNMS On the Horizon – Performance, Selenium, Time-Series Storage, Kafka, Minion, Documentation, Flow QoS/ToS, BMP, Cassandra, Newts, UI, Helm

In the last week we worked on performance improvements, the Selenium monitor, time-series storage and instrumentation, Kafka SSL, Minion config and heartbeat, documentation, flow QoS/ToS, BMP, cloud Cassandra for Newts, UI fixes, and Helm.

Github Project Updates

Internals, APIs, and Documentation
  • Chandra made an improvement to performance when checking salted passwords
  • Craig continued his work on modernizing the Selenium monitor
  • Patrick worked on some changes to the time-series storage API tests
  • Christian added support for SSL in Nephron's Kafka implementation
  • Bonnie made some improvements to the documentation for the Minion config schema
  • Marcel worked on documentation for the BSF detector
  • Stefan did more work on the new flow QoS/ToS support
  • Chandra fixed some timing issues in the BMP code when PeerUp messages are received before router initialization
  • Jeff made some Newts improvements to support cloud-hosted Cassandra
  • Chandra fixed an issue with lagging minion heartbeats
  • Jesse added more metrics to time-series instrumentation
Web, ReST, UI, and Helm
  • Christian backported some UI fixes to older Meridian branches
  • Stefan and I worked on porting our Helm build to use Grafana's new build toolkit (including finally converting some code to TypeScript)
Contributors

Thanks to the following contributors for committing changes since last OOH:

  • Benjamin Reed
  • Bonnie Robinson
  • Chandra Gorantla
  • Christian Pape
  • Craig Gallen
  • Dustin Frisch
  • Jeff Gehlbach
  • Jesse White
  • Marcel Fuhrmann
  • Patrick Schweizer
  • Stefan Wachter

April Releases

In April, we released updates to all OpenNMS versions under active support.

Horizon 27.1.1

Release 27.1.1 contains a few enhancements, as well as a number of bug fixes including some XSS and CSRF cleanups and a Jetty DoS CVE.

The codename for 27.1.1 is Infinite Improbability Drive.

For a high-level overview of what has changed in Horizon 27, see What’s New in OpenNMS Horizon 27.

For a complete list of changes in 27.1.1, see the detailed release notes.

Meridian Releases

Meridian 2018.1.27 was a small release, with just the Jetty CVE update and a new option for tuning Minion communication with OpenNMS.

Meridian 2019.1.18 added on top of that a number of other useful bug fixes including some cosmetic UI cleanups and a fix to Kafka producer resource naming.

Meridian 2020.1.7 contains all of those changes, plus a few other bug fixes and a performance improvement in the Kafka producer.

For a list of changes, see the release notes:

Release Roadmap

May Releases

The next OpenNMS release day is May 11th, 2021.

Currently we expect a new Horizon 27 release, as well as Meridians 2019 and 2020.

Next Horizon: 28 (Q? 2021)

The next major Horizon release will be Horizon 28.

Horizon 28 will still be coming down the pipeline soon.
Currently, we hope for it to contain the move to building with JDK 11 (and, consequently, a requirement to only run on JDK 11 or higher), QoS flow aggergation, and some other improvements in the pipeline.

Next Meridian: 2021 (Q2 2021)

Meridian 2021 is on track for a release in 2nd quarter of 2021. It is expected to be based on the Horizon 27.1 codebase, which means it will contain all of the bug fixes and new features introduced in Horizon 26 and 27.

Disclaimer

Note that this is just based on current plans; dates, features, and releases can change or slip depending on how development goes.

The statements contained herein may contain certain forward-looking statements relating to The OpenNMS Group that are based on the beliefs of the Group’s management as well as assumptions made by and information currently available to the Group’s management. These forward-looking statements are, by their nature, subject to significant risks and uncertainties.

...We apologize for the excessive disclaimers. Those responsible have been sacked.

Mynd you, møøse bites Kan be pretti nasti...

We apologise again for the fault in the disclaimers. Those responsible for sacking the people who have just been sacked have been sacked.

Until Next Time…

If there’s anything you’d like me to talk about in a future OOH, or you just have a comment or criticism you’d like to share, don’t hesitate to say hi.

- Ben

Resolved Issues Since Last OOH

  • NMS-11752: "Search/Filter Resources" on "Resource Graphs" not functioning as expected
  • NMS-12946: Nephron: examine what additional compute and storage load is implied by the new QoS-based aggregations
  • NMS-13114: Drift (ES): Trying to create too many buckets.
  • NMS-13188: Page not found on topology
  • NMS-13203: Nephron should support Kafka over TLS
  • NMS-13207: Poor PasswordEncryptor performance with large number of Minions
  • NMS-13215: Flows: Fallback config for flow timeouts
  • NMS-13220: Upgrade Karaf to 4.2.11
  • NMS-13228: Stored XSS reported 2021-03-31 (update summary after disclosure)
  • NMS-13231: Backport Security Issues from Last Month

by RangerRick at April 20, 2021 02:47 PM

April 14, 2021

How to: Set up Distributed Monitoring with OpenNMS

Large, distributed networks can be difficult to reach and monitor from a central location, with challenges like firewalls, network address translation (NAT) traversal, overlapping IP address ranges, and locked-down environments. The OpenNMS Minion component extends the reach of Horizon/Meridian, so you can monitor systems and networks that would otherwise be inaccessible, for optimal visibility into every area of your network.

Minions communicate with OpenNMS via an ActiveMQ or Apache Kafka message broker. Learn how to set up a simple OpenNMS Minion environment in these articles by Alejandro Galue, Senior Manager, Services and Support at The OpenNMS Group:

by Bonnie Robinson at April 14, 2021 04:27 PM

April 07, 2021

April 2021 Releases – Horizon 27.1.1, Meridians 2018.1.27, 2019.1.18, and 2020.1.7

In April, we released updates to all OpenNMS versions under active support.

Horizon 27.1.1

Release 27.1.1 contains a few enhancements, as well as a number of bug fixes including some XSS and CSRF cleanups and a Jetty DoS CVE.

The codename for 27.1.1 is Infinite Improbability Drive.

For a high-level overview of what has changed in Horizon 27, see What’s New in OpenNMS Horizon 27.

For a complete list of changes in 27.1.1, see the detailed release notes.

Meridian Releases

Meridian 2018.1.27 was a small release, with just the Jetty CVE update and a new option for tuning Minion communication with OpenNMS.

Meridian 2019.1.18 added on top of that a number of other useful bug fixes including some cosmetic UI cleanups and a fix to Kafka producer resource naming.

Meridian 2020.1.7 contains all of those changes, plus a few other bug fixes and a performance improvement in the Kafka producer.

For a list of changes, see the release notes:

by RangerRick at April 07, 2021 06:27 PM

April 06, 2021

OpenNMS On the Horizon – Nephron, Flows, Karaf, Antora, Ticketing, Alarms, Smoke Tests, Minion, Swagger, BSM, Jetty

In the last week we worked on Nephron and flows, Karaf, Antora documentation, ticketing and alarms, smoke tests, the Minion, Swagger UI for ReST, BSM editing, and Jetty TLS configs.

Github Project Updates

Internals, APIs, and Documentation
  • Stefan did more work on Nephron and flow improvements, plus his benchmarking tools
  • Jesse worked on updating our embedded Karaf to 4.2.11
  • Bonnie and Ronny continued to work on finalizing and improving the big Antora doc update
  • Dustin fixed an issue with timeout config for flows
  • Chandra fixed the default telemetry config
  • Chandra worked on a bunch of fixes and improvements to ticketing and alarms
  • Jesse and I worked on fixing up flapping smoke tests
  • Christian fixed an issue to handle alarm reduction keys better when multiple Minions are in the same location
Web, ReST, UI, and Helm
  • Jane worked on adding Swagger UI support for our ReST API
  • Christian fixed a bug editing BSM edges
  • Jeff tightened up the TLS settings for the default Jetty config
Contributors

Thanks to the following contributors for committing changes since last OOH:

  • Benjamin Reed
  • Bonnie Robinson
  • Chandra Gorantla
  • Christian Pape
  • Dustin Frisch
  • Jane Hou
  • Jeff Gehlbach
  • Jesse White
  • Marcel Fuhrmann
  • Ronny Trommer
  • Stefan Wachter

Release Roadmap

April Releases

The next OpenNMS release day is April 6th, 2021.

Currently we expect new bug fix releases for Horizon 27 and Meridians 2019 and 2020.

Next Horizon: 28 (Q? 2021)

The next major Horizon release will be Horizon 28.

Horizon 28 will still be coming down the pipeline soon.
Currently, we hope for it to contain the move to building with JDK 11 (and, consequently, a requirement to only run on JDK 11 or higher), QoS flow aggergation, and some other improvements in the pipeline.

Next Meridian: 2021 (Q2 2021)

Meridian 2021 is on track for a release in 2nd quarter of 2021. It is expected to be based on the Horizon 27.1 codebase, which means it will contain all of the bug fixes and new features introduced in Horizon 26 and 27.

Disclaimer

Note that this is just based on current plans; dates, features, and releases can change or slip depending on how development goes.

The statements contained herein may contain certain forward-looking statements relating to The OpenNMS Group that are based on the beliefs of the Group’s management as well as assumptions made by and information currently available to the Group’s management. These forward-looking statements are, by their nature, subject to significant risks and uncertainties.

...We apologize for the excessive disclaimers. Those responsible have been sacked.

Mynd you, møøse bites Kan be pretti nasti...

We apologise again for the fault in the disclaimers. Those responsible for sacking the people who have just been sacked have been sacked.

Until Next Time…

If there’s anything you’d like me to talk about in a future OOH, or you just have a comment or criticism you’d like to share, don’t hesitate to say hi.

- Ben

Resolved Issues Since Last OOH

  • HELM-270: Grafana dependency for Helm install
  • NMS-10188: Evaluate Swagger for REST API documentation
  • NMS-10256: Change Jetty default settings to eliminate TLS 1.0 and TLS 1.1 support
  • NMS-12670: Overview chapter
  • NMS-12697: Can't edit reductionKey in BSM
  • NMS-13028: Add WebDetector documentation
  • NMS-13074: Create Win32ServiceDetector documentation
  • NMS-13075: Create WmiDetector documenation
  • NMS-13076: Create BgpSessionDetector documentation
  • NMS-13187: Investigate using openAPI&Swagger to document v2 RESTful API
  • NMS-13189: The behavior of the Ticketing API differs from older versions.
  • NMS-13196: Editing a scheduled Grafana report resets the selected Grafana dashboard
  • NMS-13210: The %dpname% breaks the alarm life-cycle when having multiple minions per location
  • NMS-13227: Change Jetty default settings to exclude vulnerable cipher suites, expose client-initiated renegotiation

by RangerRick at April 06, 2021 05:47 PM