Skip to content
ClickHouse Docs
ClickHouse DocsClickHouse Docs
49.6kGet Started

system.dropped_tables_parts

View as MarkdownEdit this pageReport an issueSet up docs MCP

Description

Contains information about parts of MergeTree dropped tables from system.dropped_tables

The schema of this table is the same as system.parts

Columns

  • partition (String) — Partition identifier (string representation derived from the table partition key expression).

  • name (String) — Name of the data part. The part naming structure can be used to determine many aspects of the data, ingest, and merge patterns. The part naming format is the following:

    <partition_id>_<minimum_block_number>_<maximum_block_number>_<level>_<data_version>
    • Definitions:
      • partition_id - identifies the partition key
      • minimum_block_number - identifies the minimum block number in the part. ClickHouse always merges continuous blocks
      • maximum_block_number - identifies the maximum block number in the part
      • level - incremented by one with each additional merge on the part. A level of 0 indicates this is a new part that has not been merged. It is important to remember that all parts in ClickHouse are always immutable
      • data_version - optional value, incremented when a part is mutated (again, mutated data is always only written to a new part, since parts are immutable)

  • uuid (UUID) — The UUID of data part.

  • part_type (String) — The data part storing format. Possible values: Wide — each column is stored in a separate file, Compact — all columns are stored in one file. Data storing format is controlled by the min_bytes_for_wide_part and min_rows_for_wide_part settings of the MergeTree table.

  • part_storage_type (String) — The type of DataPartStorage. Possible values: Packed - most part files are stored in a single archive (projections and a few service files such as txn_version.txt are written separately), Full - each file is stored separately.

  • active (UInt8) — Flag that indicates whether the data part is active. If a data part is active, it’s used in a table. Otherwise, it’s about to be deleted. Inactive data parts appear after merging and mutating operations.

  • marks (UInt64) — The number of marks. To get the approximate number of rows in a data part, multiply marks by the index granularity (usually 8192) (this hint does not work for adaptive granularity).

  • rows (UInt64) — The number of rows.

  • files (UInt64) — The number of files in the data part.

  • bytes_on_disk (UInt64) — Total size of all the data part files in bytes.

  • data_compressed_bytes (UInt64) — Total size of compressed data in the data part. All the auxiliary files (for example, files with marks) are not included.

  • data_uncompressed_bytes (UInt64) — Total size of uncompressed data in the data part. All the auxiliary files (for example, files with marks) are not included.

  • primary_key_size (UInt64) — The amount of memory (in bytes) used by primary key values in the primary.idx/cidx file on disk.

  • marks_bytes (UInt64) — The size of the file with marks.

  • secondary_indices_compressed_bytes (UInt64) — Total size of compressed data for secondary indices in the data part. All the auxiliary files (for example, files with marks) are not included.

  • secondary_indices_uncompressed_bytes (UInt64) — Total size of uncompressed data for secondary indices in the data part. All the auxiliary files (for example, files with marks) are not included.

  • secondary_indices_marks_bytes (UInt64) — The size of the file with marks for secondary indices.

  • modification_time (DateTime) — The time the directory with the data part was modified. This usually corresponds to the time of data part creation.

  • remove_time (DateTime) — The time when the data part became inactive.

  • refcount (UInt32) — The number of places where the data part is used. A value greater than 2 indicates that the data part is used in queries or merges.

  • min_date (Date) — The minimum value of the date key in the data part.

  • max_date (Date) — The maximum value of the date key in the data part.

  • min_time (DateTime) — The minimum value of the date and time key in the data part.

  • max_time (DateTime) — The maximum value of the date and time key in the data part.

  • partition_id (String) — ID of the partition.

  • min_block_number (Int64) — The minimum number of data parts that make up the current part after merging.

  • max_block_number (Int64) — The maximum number of data parts that make up the current part after merging.

  • level (UInt32) — Depth of the merge tree. Zero means that the current part was created by insert rather than by merging other parts.

  • data_version (UInt64) — Number that is used to determine which mutations should be applied to the data part (mutations with a version higher than data_version).

  • primary_key_bytes_in_memory (UInt64) — The amount of memory (in bytes) used by primary key values. Will be 0 when primary_key_lazy_load is enabled and the key is not loaded. When non-zero the bytes live in the part itself and are accounted within jemalloc.mergetree_arena.active_bytes. They are NEVER counted in PrimaryIndexCacheBytes — those are mutually exclusive per part: an index lives either in the part (this metric) or in the shared PrimaryIndexCache (the other), depending on primary_key_lazy_load and use_primary_key_cache.

  • primary_key_bytes_in_memory_allocated (UInt64) — The amount of memory (in bytes) reserved for primary key values. Will be 0 when primary_key_lazy_load is enabled and the key is not loaded. When non-zero, included in jemalloc.mergetree_arena.active_bytes. See the note on primary_key_bytes_in_memory for the relationship with PrimaryIndexCacheBytes.

  • index_granularity_bytes_in_memory (UInt64) — The amount of memory (in bytes) used by index granularity values (will be 0 in case of primary_key_lazy_load=1 and use_primary_key_cache=1). When non-zero the bytes are part-owned and accounted within jemalloc.mergetree_arena.active_bytes.

  • index_granularity_bytes_in_memory_allocated (UInt64) — The amount of memory (in bytes) reserved for index granularity values (will be 0 in case of primary_key_lazy_load=1 and use_primary_key_cache=1). When non-zero, included in jemalloc.mergetree_arena.active_bytes.

  • is_frozen (UInt8) — Flag that shows that a partition data backup exists. 1, the backup exists. 0, the backup does not exist. For more details, see FREEZE PARTITION.

  • database (String) — Name of the database.

  • table (String) — Name of the table.

  • engine (String) — Name of the table engine without parameters.

  • disk_name (String) — Name of a disk that stores the data part.

  • path (String) — Absolute path to the folder with data part files.

  • hash_of_all_files (String) — sipHash128 of compressed files.

  • hash_of_uncompressed_files (String) — sipHash128 of uncompressed files (files with marks, index file etc.).

  • uncompressed_hash_of_compressed_files (String) — sipHash128 of data in the compressed files as if they were uncompressed.

  • delete_ttl_info_min (DateTime) — The minimum value of the date and time key for TTL DELETE rule.

  • delete_ttl_info_max (DateTime) — The maximum value of the date and time key for TTL DELETE rule.

  • move_ttl_info.expression (Array(String)) — Array of expressions. Each expression defines a TTL MOVE rule.

  • move_ttl_info.min (Array(DateTime)) — Array of date and time values. Each element describes the minimum key value for a TTL MOVE rule.

  • move_ttl_info.max (Array(DateTime)) — Array of date and time values. Each element describes the maximum key value for a TTL MOVE rule.

  • default_compression_codec (String) — The name of the codec used to compress this data part when a column has no explicit codec or uses CODEC(Default). With enable_adaptive_codec_selection, individual blocks of such columns may use other codecs; see mergeTreeCodecBlockCounts.

  • recompression_ttl_info.expression (Array(String)) — The TTL expression.

  • recompression_ttl_info.min (Array(DateTime)) — The minimum value of the calculated TTL expression within this part. Used to understand whether we have at least one row with expired TTL.

  • recompression_ttl_info.max (Array(DateTime)) — The maximum value of the calculated TTL expression within this part. Used to understand whether we have all rows with expired TTL.

  • group_by_ttl_info.expression (Array(String)) — The TTL expression.

  • group_by_ttl_info.min (Array(DateTime)) — The minimum value of the calculated TTL expression within this part. Used to understand whether we have at least one row with expired TTL.

  • group_by_ttl_info.max (Array(DateTime)) — The maximum value of the calculated TTL expression within this part. Used to understand whether we have all rows with expired TTL.

  • rows_where_ttl_info.expression (Array(String)) — The TTL expression.

  • rows_where_ttl_info.min (Array(DateTime)) — The minimum value of the calculated TTL expression within this part. Used to understand whether we have at least one row with expired TTL.

  • rows_where_ttl_info.max (Array(DateTime)) — The maximum value of the calculated TTL expression within this part. Used to understand whether we have all rows with expired TTL.

  • projections (Array(String)) — The list of projection names calculated for this part.

  • visible (UInt8) — Flag which indicated whether this part is visible for SELECT queries.

  • creation_tid (Tuple(UInt64, UInt64, UUID)) — ID of transaction that has created/is trying to create this object.

  • removal_tid_lock (UInt64) — Hash of removal_tid, used to lock an object for removal.

  • removal_tid (Tuple(UInt64, UInt64, UUID)) — ID of transaction that has removed/is trying to remove this object

  • creation_csn (UInt64) — CSN of transaction that has created this object

  • removal_csn (UInt64) — CSN of transaction that has removed this object

  • has_lightweight_delete (UInt8) — The flag which indicated whether the part has lightweight delete mask.

  • last_removal_attempt_time (DateTime) — The last time the server tried to delete this part.

  • removal_state (String) — The current state of part removal process.

Aliases:

  • bytes — Alias for bytes_on_disk.
  • marks_size — Alias for marks_bytes.
  • part_name — Alias for name.

See Also

Navigation