Streams

Overview

The fundamental structure of our data handling system consists of raw block streams, transaction streams, and account streams to be added soon. Each component is meticulously designed to optimize data retrieval and ensure efficient resource utilization.

Blocks

Raw block streams serve as the bedrock for our data architecture. Blocks are organized in approximately 256MB batches. This organization facilitates targeted data retrieval by segregating data into yearly, monthly, and daily segments, thereby optimizing read operations and minimizing input/output resource strain.

Transactions

Our transaction streams evolve from the raw block streams and are categorized into numerous channels. This segregation helps in isolating specific data types, such as oracles, transactions with incomplete states, and others, to reduce false matches and increase rescan speeds during data extraction. As our system evolves, we anticipate the introduction of additional channels to address specific data retrieval needs with precision. Check out channels for details.

Accounts

In development...