Skip to content
Search to learn about InterSystems products and solutions, career opportunities, and more.

ESG Technical Review: InterSystems IRIS

Enterprise Strategy Group

InterSystems IRIS: High Performance Data Management Software for Concurrent Data Ingestion and Real-time Queries

Date: June 2020
Author: Kerry Dolan, Senior IT Validation Analyst

Abstract

This report documents ESG’s validation of concurrent data ingestion and real-time query performance testing of various database management software products that demonstrates the ability of InterSystems IRIS data platform to ingest hundreds of millions of records and simultaneously execute millions of queries with microsecond performance, outperforming other traditional and in-memory products.

The Challenges

For many organizations, the ability to collect data and analyze it in real time is an essential task that drives revenue, improves visibility, informs strategy, and aids decision making. For example, applications focused on financial trading, IoT, fraud detection, and real-time personalization must ingest large amounts of data and analyze it immediately. The challenge is finding a database platform with sufficient horsepower to handle large-scale ingest and querying simultaneously without impeding performance. When ESG asked database and analytics professionals about technologies supporting data analytics, performance was among the topmost important capabilities.1

Enterprise Strategy Group chart showing top 10 most important capabilities for data analytics technologies

In-memory databases offer high performance but are expensive to scale and have hard memory limits that can affect reliability and cause restart delays. Traditional databases offer persistence and reliability but lack the high performance of in-memory databases. InterSystems IRIS can process both ingestion and query workloads simultaneously, with performance equal to or better than in-memory-only databases, without their limitations. InterSystems has published an open-source test to demonstrate this claim, which ESG is validating in this report.

The Solution: InterSystems IRIS

InterSystems IRIS is a data management software platform that was built for high performance, multi-workload processing at scale. As a multi-model DBMS, it provides native support for relational, object-oriented, document, key-value, and hierarchical data objects; in addition, it enables consistent high performance for both transactional and analytic workloads simultaneously. While a complete product description is beyond the scope of this report, some key functionality is described below.

  • An important feature that provides superior ingest performance is the multidimensional data engine in InterSystems IRIS that enables efficient, compact storage with a rich data structure, speeding data ingest, access, and updates while minimizing resource usage and disk consumption.
  • Real-time analytics performance is achieved by using a transactional-bitmap indexing schema that enables InterSystems IRIS to process complex queries quickly, including on real-time data, without searching the entire database.
  • InterSystems IRIS Enterprise Cache Protocol, an intelligent, distributed memory caching mechanism, enables it to execute sophisticated queries on very large data sets with high performance and reliability, including performing joins accessing distributed data, without making multiple data copies.

Other features include:

  • In-memory performance with built-in data persistence in a format optimized for rapid data access.
  • Built-in distributed caching layer with automatic and guaranteed consistency.
  • Full SQL support.
  • Deployment on-premises, in all major public clouds, and in hybrid environments, with a single API.

ESG Tested

ESG validated performance benefits of InterSystems IRIS using the company’s publicly available, customizable, open-source Speed Test benchmark kit.2 The benchmark was designed to measure concurrent real-time ingest and query performance. This is a common use case that financial services, fraud detection, IoT, and other applications face. For example, while financial services firms are executing thousands of trades, thousands of users are querying for order status, risk management, etc. Similarly, IoT sensor data comes in fast from the field and applications must perform immediate anomaly detection and other real-time calculations. When a database is stressed in this way, having to simultaneously ingest data and execute analytic queries can slow performance.

--continues--


1 - Source: ESG Master Survey Results, The State of Data Analytics, August 2019. 2 - https://github.com/intersystems-community/irisdemo-demo-htap.

 

RELATED TOPICS

Other Resources You Might Like

Oct 31, 2024
BLOOR Research Opinion Article
This article from UK Analyst Bloor Research recognises the capabilities and advantages of InterSystems IRIS data platform as an "innovative and powerful data management platform" and it’s Smart Data Fabric capabilities offering a market differentiator.
Oct 31, 2024
A Benchmarking System to Spark Companies to Action
Download the Report
Oct 25, 2024
Discover how Retrieval Augmented Generation (RAG) enhances AI accuracy by combining language models with real-time data retrieval, revolutionizing chatbots and search engines.
Oct 23, 2024
Market Note
This report explores how advancements in AI, including large language models and natural language processing, are revolutionizing every aspect of capital markets, from trading strategies to compliance and portfolio management.
Oct 22, 2024
Fact Sheet
Unified Data has the Power to Transform
Oct 22, 2024
ISG Research
This Ventana Research Buyers Guide: Data Platforms is an assessment of how well software providers’ offerings address enterprises’ requirements for data platforms software, evaluating software in seven key categories that are weighted to reflect buyers’ needs based on expertise and research.
Oct 16, 2024
Migration Options for Application & Solution Providers
Migrating InterSystems IRIS® and InterSystems IRIS for Health™ from on-premises to the cloud offers many advantages for Application Providers and Solution Providers. These advantages include simplified operations, access to flexible resources, and enhanced resilience. Companies no longer need to worry about the physical constraints and expenses associated with maintaining on-prem infrastructure, such as power and space requirements and expensive computer hardware.
Oct 16, 2024
TabbFORUM’s Market Structure Wave
In this edition of TabbFORUM’s Market Structure Wave video series, InterSystems Irene Galperin, Senior Advisor, Financial Services, discusses how firms in the capital markets have been investing and experimenting with AI, particularly most recently with the advent of ChatGPT. In this interview, conducted by TABB Group CEO Bruce Morris, Irene offers several use cases and explains that data is at the core of implementing AI, as data needs to be "high quality and consistent," essentially "AI-ready."
Oct 10, 2024
Get Your Data AI-Ready and Simplify Development and Deployment
Unleash the power of AI in healthcare with InterSystems solutions for seamless FHIR integration and development.
Oct 04, 2024
Product Fact Sheet
InterSystems Data Fabric Studio is an essential element of a modern data strategy required to enable growth, optimize business reporting, reduce risk, and support compliance for any firm in the financial services industry.

Take The Next Step

We’d love to talk. Fill in some details and we’ll be in touch.
*Required Fields
Highlighted fields are required
*Required Fields
Highlighted fields are required

By submitting your business contact information to InterSystems through this form, you acknowledge and agree that InterSystems may process this information, for the purpose of fulfilling your submission, through a system hosted in the United States, but maintained consistent with any applicable data protection laws.



** By selecting yes, you give consent to be contacted for news, updates and other marketing purposes related to existing and future InterSystems products and events. In addition, you consent to your business contact information being entered into our CRM solution that is hosted in the United States, but maintained consistent with applicable data protection laws.