Kx kdb+ is a high-performance column-store database with a built-in expressive query and programming language, q. Used as a central repository to store time-series data within an enterprise, kdb+ supports real-time analysis of billions of records and fast access to terabytes of historical data. With extreme scalability and high performance, kdb+ is widely adopted by financial institutions around the world.
By using fast, scalable, external disk systems with massively parallel access to data, researchers can perform analysis against much larger datasets than they can by batching large data sets through memory. Visionary hedge funds, proprietary trading firms, and other financial institutions have been changing their infrastructure to take advantage of parallelism so as to analyze more positions faster and to develop more effective trading and risk management strategies that can be deployed in less time.
A parallel file system offers several advantages over a single, direct-attached file system. When it is used in conjunction with the in-memory database kdb+, the advantages are:
A recent STAC-M3 benchmark analysis for DDN, Intel, and Kx showed the combined solution provided up to 500% faster results than any other storage solution on the market, including SSD-direct attached storage or all flash arrays; 50% better latency characteristics on IO intensive workloads; and unmatched bandwidth, latency, and runtime for large scale workflows.